Changelog (2022)¶

This document records the updates and release notes for each deployment of Guance, including DataKit, Guance best practices, Guance integration documentation, and Guance.

December 29, 2022¶

Guance Updates¶

Added MFA Authentication Management¶

Guance provides MFA authentication management to add an extra layer of security beyond username and password. After enabling MFA authentication, you will need to perform a secondary verification during login to enhance account security. For more details, refer to the MFA Management documentation.

Added Workspace IP Access Whitelist¶

Guance supports configuring an IP whitelist for workspaces to restrict user access. Once the IP whitelist is enabled, only requests from whitelisted IPs can log in, and all other requests will be denied. For more details, refer to the IP Whitelist documentation.

Note: The IP whitelist can only be set by administrators and owners, and "owners" are not restricted by the IP whitelist.

Added Service Network Topology¶

In a K8S environment, you can use the Service network topology map to view the request relationships, response times, error rates, etc., between Services in the K8S environment. If a Service connection issue is detected, you can click to view the corresponding logs to locate the problem. For more details, refer to the Service Network documentation.

Other Functional Optimizations¶

Pipeline usage optimization
Log clustering analysis supports custom fields
Support for viewing associated logs after large log segmentation
Backup log display optimization
Sensitive field support for data authorization expanded to all data types except Metrics

DataKit Updates¶

Prometheus collector supports data collection via Unix Socket
Allows non-root users to run DataKit
Optimized eBPF httpflow protocol determination
Optimized Datakit installation and upgrade commands on Windows
Optimized Python encapsulation
Pipeline provides more detailed error messages
Pipeline reftable provides a SQLite-based local storage implementation

For more DataKit updates, refer to DataKit Version History.

Intelligent Inspection Updates¶

Official Intelligent Inspection Discontinued¶

The official intelligent inspections for "Memory Leak," "Application Performance Detection," and "Disk Usage Rate" are now discontinued. Users can configure these via the Self-built Inspection script library.

Added Cloud Account Instance-Level Bill Inspection¶

Cloud account instance-level bill inspection helps users manage abnormal cost alerts, predict expenses, and provide high-growth, high-consumption instance prompts and bill visualization capabilities, supporting multi-dimensional visualization of cloud service resource consumption.

Added Alibaba Cloud Spot Instance Survival Inspection¶

Since the market price of spot instances fluctuates with supply and demand, a bid mode must be specified when creating spot instances. Spot instances can only be successfully created when the real-time market price for the specified instance type is lower than the bid and inventory is sufficient. Therefore, inspecting cloud assets for spot instances is crucial. The inspection will prompt the latest prices for all available zones of the spot instance and provide appropriate handling suggestions when the spot instance is about to be released.

For more intelligent inspection updates, refer to Intelligent Inspection Changelog.

December 15, 2022¶

Guance Updates¶

Added Profile and Network Billing¶

Guance added Profile and Network billing items. Profile counts the number of application performance Profiles reported in the workspace that day, and Network counts the number of hosts (host) with network data reported in the workspace that day. For more details, refer to the Billing Methods documentation.

Guance Registration Process Optimization¶

Guance simplified the registration process to help you quickly complete registration and start using Guance. For more details, refer to the Register Guance Commercial Plan documentation.

Added Warroom Feature¶

Guance provides a "Warroom" dashboard where you can view key metric trends across all workspaces, helping you quickly understand key data in each workspace and promptly detect and resolve anomalies. For more details, refer to the Key Metric Management documentation.

Added Dashboard Carousel Feature¶

Guance provides a carousel feature for multiple related business dashboards. Once set up, you can display them on large screens. For more details, refer to the Carousel Dashboard documentation.

Workspace Binding External SLS Index¶

Guance added support for binding SLS indexes, helping you quickly view and analyze your log data. Additionally, Guance added field mapping functionality to help map SLS index fields for clustering analysis. For more details, refer to the Log Index documentation.

Link Viewer Chart Display Optimization¶

Added "Span Count" and "Error Span Count" trend charts to the link viewer. You can quickly view trends in Span count, Error Span count, request count, Error request count, and response time metrics through the viewer's charts.

Other Functional Optimizations¶

View variable interaction optimization
Built-in view binding configuration interaction optimization
Workspace overdue lock process optimization
Workspace invitation user experience optimization
Help documentation added a rating system, including "Good" and "Poor"
Monitor batch function optimization
SLO added enable/disable functionality
Fuzzy matching Wildcard left * matching query limit optimization

DataKit Updates¶

Added Golang Profiling integration
logfwd supports LOGFWD_TARGET_CONTAINER_IMAGE for image field injection
trace collector:
- Optimized error-stack/error-message format issues
- SkyWalking compatibility adjustments, supporting 8.X full series
eBPF httpflow added pid/process_name fields, optimized kernel version support
datakit.yaml adjustments, recommended to update yaml
GPU graphics card collection supports remote mode

For more DataKit updates, refer to DataKit Version History.

Intelligent Inspection Updates¶

Intelligent Inspection Added Guide Page¶

Guance defaults to three intelligent inspection templates: Memory Leak, Disk Usage Rate, and Application Performance Detection. After this update, existing workspaces support manually deleting default intelligent inspection templates, while new workspaces no longer provide these three by default, adding a new user guide prompt.

Intelligent Inspection Components Support Custom Redirect Links¶

When configuring self-built inspections, custom redirect links can be configured. For how to configure self-built inspections, refer to the Self-built Inspection documentation.

For more intelligent inspection updates, refer to Intelligent Inspection Changelog.

Best Practices Updates¶

Insights
- Scene - SpringBoot Project External Tomcat Scene Link Observability.

For more best practices updates, refer to Best Practices Version History.

December 1, 2022¶

Guance Updates¶

APM Added Service List Feature¶

The APM service list supports real-time viewing of service ownership, dependencies, performance, associated dashboards, and correlation analysis, helping teams efficiently build and manage large-scale end-to-end distributed applications. For more details, refer to the Service List documentation.

Dashboard Chart User Experience Optimization¶

Added manual input for chart units, colors, and aliases. You can customize preset units, colors, and aliases according to current specifications, such as unit input format: aggregation function(metric), e.g., last(usage_idle)
Time series charts added Y-axis configuration, allowing manual configuration of Y-axis maximum and minimum values
Time series charts and pie charts added group display, enabling only label values to be displayed in the legend
Honeycomb charts, China maps, and world maps added gradient intervals, including automatic and custom
Bar charts and histograms display optimization

For more details, refer to the Visualization Charts documentation.

View Variable User Experience Optimization¶

View variables now support multi-select
View variable configuration added the option to set multiple default values

For more details, refer to the View Variables documentation.

RUM Session Viewer Adjustment¶

In the RUM Session Viewer, added "Session" and "All Records" view lists:

Session: Statistics on deduplicated Session data within the current time range, displaying the latest Session data by default
All Records: Displays all reported Session data, where the same Session may correspond to multiple records

Note: In the Session list, adding display columns is supported. If a user adds a display column that does not exist in the current Session data, the Session list may contain empty data. For more details, refer to the Session documentation.

Events Added Mobile Redirect Option¶

After receiving an alert event notification, users can click "Go to Guance to view" to access the Guance mobile app and view detailed information about the abnormal event.

Other Functional Optimizations¶

New user guide page optimization, supports minimization
RUM application list optimization, added time widget custom interval switch query
Host Label addition interaction optimization

DataKit Updates¶

Added Python Profiling integration
Python added custom event reporting functionality
netstat supports specific port metric collection
Optimized Redis collector CPU usage collection, added new metric fields
Optimized logfwd collector configuration
Completed host object field collection, added network, disk, and related fields

For more DataKit updates, refer to DataKit Version History.

Intelligent Inspection Updates¶

Kubernetes Pod abnormal restart inspection
MySQL performance inspection
Server application error inspection
Memory leak inspection
Disk usage rate inspection
Application performance inspection
Frontend application log error inspection

For more intelligent inspection updates, refer to Intelligent Inspection Changelog.

Best Practices Updates¶

Monitoring
- Application Performance Monitoring (APM) - Performance Optimization - Using async-profiler for Application Performance Tuning

For more best practices updates, refer to Best Practices Version History.

November 17, 2022¶

Guance Updates¶

Pipeline User Experience Optimization¶

Pipeline supports multi-select filter conditions
Supports setting any Pipeline script as the "default Pipeline script." If no other Pipeline script is matched for the current data type during Pipeline processing, the data will be processed according to the default Pipeline script rules.
Script function categorization

Event Optimization¶

Supports writing custom events. For more details, refer to the Writing Event Data via openAPI documentation.
Unresolved event viewer left side added quick filter

Custom Viewer Supports Selecting More Data Types¶

When creating a viewer in a scene, you can select from logs, APM, RUM, Security Inspection, and Profile data types. Once saved, it cannot be changed.

Member Management Added Member Grouping Function¶

Member management added a member grouping function. You can edit member groups, and a member can belong to multiple groups. When configuring alert policy notification targets, member group tags are supported.

Optimized Built-in View Binding Function¶

In the scene "Built-in Views" - "User Views," binding fields now support fuzzy matching. After binding fields, you can view the corresponding built-in views in the viewer.

Added One-Click Import/Export of Dashboards, Custom Viewers, and Monitors in Workspace¶

In "Management" - "Basic Settings," added one-click import/export of dashboards, custom viewers, monitors, and other JSON configurations in the workspace. You can import dashboards, custom viewers, monitors, etc., from other workspaces into the current workspace.

APM Log Page Added Custom Association Fields¶

In the APM details page, on the associated logs page, if you are an administrator or above, you can customize associated fields. Click the settings button next to the associated fields, select the fields to associate in the dialog box, support manual input, drag-and-drop order, and confirm to complete the configuration.

Other Functional Optimizations¶

When using fuzzy matching and fuzzy non-matching in filter conditions, left * matching is supported
Infrastructure analysis dimension optimization, in the host details page, the last reported time of the host
Supports quick login to the last single sign-on
Blacklisted APM added support for filtering "All Services"
Users registered in "China Region 4 (Guangzhou)" optimized the upgrade process to the commercial plan
Field descriptions support viewing in quick filters, display columns, etc.

DataKit Updates¶

Added SNMP Collector
Added IPMI Collector
Added batch injection of DDTrace-Java tool
Latest DDTrace-Java SDK enhanced SQL desensitization functionality
Remote Pipeline optimization
- Pipeline supports source mapping configuration, facilitating batch configuration between Pipeline and data sources
- Pipeline provides function categorization information, facilitating remote Pipeline writing
Optimized Kafka Message Subscription, no longer limited to SkyWalking-related data, supports rate limiting, multi-version coverage, sampling, and load balancing
Added extra configuration parameters (ENV_INPUT_CONTAINER_LOGGING_SEARCH_INTERVAL) to alleviate short lifecycle Pod log collection issues
In pure container environments, supports label-based configuration of container log collection
Added Pipeline functions
- sample(): Sampling function
- b64enc(): Base64 encoding function
- b64dec(): Base64 decoding function
- append(): List append function

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

Insights
- Guance Tips (Skills) - DataKit HTTPS Configuration
Monitoring
- Application Performance Monitoring (APM) - ddtrace common parameter usage
- Application Performance Monitoring (APM) - ddtrace-api usage guide
- Application Performance Monitoring (APM) - ddtrace sampling
- Application Performance Monitoring (APM) - ddtrace log association

For more best practices updates, refer to Best Practices Version History.

November 11, 2022¶

Guance Added "China Region 4 (Guangzhou)" Site¶

Guance supports multi-site registration and login, adding "China Region 4 (Guangzhou)" site, combined with existing "China Region 1 (Hangzhou)," "China Region 2 (Ningxia)," and "Overseas Region 1 (Oregon)," covering domestic and international regions, providing comprehensive data observability.

Note: Guance accounts and data across different sites are independent and cannot be shared or migrated. You can choose the appropriate site for registration and login based on resource usage. Currently, Guance supports the following four sites.

Site	Login URL	Operator	Billing Method
China Region 1 (Hangzhou)	https://auth.guance.com/	Alibaba Cloud	Guance enterprise account, cloud account
China Region 2 (Ningxia)	https://aws-auth.guance.com/	AWS	Guance enterprise account, cloud account
Overseas Region 1 (Oregon)	https://us1-auth.guance.com/	AWS	Guance enterprise account, cloud account
China Region 4 (Guangzhou)	https://cn4-auth.guance.com/	Huawei Cloud	Guance enterprise account, Huawei Cloud prepaid card

November 3, 2022¶

Guance Updates¶

Added Guance and SLS Joint Solution¶

Guance added an SLS storage solution, enabling Alibaba Cloud SLS users to quickly use Guance for data viewing and analysis. When registering/upgrading to the commercial plan in Guance, after selecting "Alibaba Cloud Account Billing," you can choose the SLS storage solution to store data in your Alibaba Cloud account, achieving data exclusivity. For more details, refer to the SLS Storage documentation.

The joint solution of Guance and SLS supports synchronizing data from your Alibaba Cloud account to the Guance workspace for querying and analysis by binding log indexes. You can click "Bind Index" in the Guance workspace "Logs" - "Index" to synchronize log data from the index. For more details, refer to the Log Index documentation.

Optimized New User Guide Page¶

Guance added new user guide pages for scenarios, events, infrastructure, metrics, logs, APM, RUM, Synthetic Tests, Security Inspection, CI visualization, and monitoring modules. Additionally, the workspace welcome homepage was optimized to help you understand and use Guance more easily through the new user guide.

Added 3 Intelligent Inspection Configuration Documents¶

Cloud Account Bill Inspection: Helps users manage cloud service budget alerts, abnormal cost alerts, predict expenses, and provide visualization capabilities, supporting multi-dimensional visualization of cloud service resource consumption
Frontend Application Log Error Inspection: Helps discover new error messages (clustered Error Message) in the past hour, helping developers and operations fix code promptly to avoid continuous customer experience impact over time
Alibaba Cloud Asset Inspection: Helps users gain more insights into cloud vendor product performance status

Added Link Error Tracking Viewer¶

In APM, added an error tracking viewer to help you quickly view similar errors in the link and their distribution, quickly locating performance issues. For more details, refer to the Link Tracing documentation.

Optimized Time Series Chart and Overview Chart YoY Comparison Function¶

YoY comparison no longer links with locked time. The button is displayed by default and is turned off. After enabling YoY comparison, the comparison dimensions support 4 options: Hour (compared to one hour ago), Day (compared to one day ago), Week (compared to one week ago), Month (compared to one month ago). For more details, refer to the YoY Comparison documentation.

Other Functional Optimizations¶

Dashboards/notes/viewers added "Save Snapshot" button in "Settings"
Time widget added more options
Pipeline and blacklist functions added import, batch export, batch delete functions
Intelligent inspection added dashboard, bar chart components
Integration menu Func page optimization

DataKit Updates¶

Improved Prometheus ecosystem compatibility, added ServiceMonitor and PodMonitor collection recognition
Added Java Profiling integration based on async-profiler
eBPF collection added interval parameter, facilitating adjustment of collected data volume
All remote collectors default to their collection address as the host field value, avoiding potential host field value misinterpretation during remote collection
DDTrace collected APM data automatically extracts error-related fields, facilitating better APM error tracking
MySQL collector added additional fields Com_commit/Com_rollback collection

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

Monitoring
- Application Performance Monitoring (APM) - Kafka Observability Best Practices
Cloud Platform Integration
- Alibaba Cloud - Alibaba Cloud ACK Integration with Guance

For more best practices updates, refer to Best Practices Version History.

October 20, 2022¶

Guance Updates¶

Monitoring Optimization¶

Added Outlier Detection¶

Outlier detection is an algorithm that detects whether the metrics/statistics of detection objects under specific groups have outlier deviations. If inconsistencies exceeding a certain level are detected, outlier detection abnormal events are generated for subsequent alert tracking. For more details, refer to the Outlier Detection documentation.

Mutation Detection Logic Optimization¶

The new mutation detection compares the absolute or relative (%) changes of the same metric in two different time periods to determine if an abnormal situation has occurred. It is commonly used to track peak values or data changes of a metric, generating events more accurately when anomalies occur. For more details, refer to the Mutation Detection documentation.

Range Detection Logic Optimization¶

The new range detection performs anomaly detection on metric data within the selected detection range. When the percentage of abnormal data points exceeds the set threshold, range detection abnormal events are generated. It is commonly used to monitor stable trend data/metrics. For more details, refer to the Range Detection documentation.

Other Optimizations¶

Adjusted read-only member permissions to support viewing monitor, intelligent inspection, SLO, mute management, and alert policy configuration content
Data gap configuration selection "Trigger data gap events" and "Trigger recovery events" adjusted to time range configuration, supporting manual input

Supports configuring monitor detection based on "event" data

Alert configuration added "Info" event notification level selection

Scene Chart Optimization¶

Added Histogram Chart Component¶

Histogram, also known as mass distribution chart, is used to represent data distribution, a common statistical chart. Generally, the horizontal axis represents data intervals, and the vertical axis represents distribution. For more details, refer to the Histogram documentation.

Chart Function Optimization¶

Overview chart, treemap, funnel chart added time slice function
Time series chart "View similar trend metrics" adjusted from supporting only metric queries to supporting all data types, including logs, APM, RUM, etc.
Leaderboard supports viewing all content beyond chart width
Honeycomb chart display optimization

Viewer Optimization¶

Viewer Supports Analysis Mode¶

Added "Analysis" function in logs, APM, RUM, Synthetic Tests, Security Inspection, CI viewers. Infrastructure adjusted "Group" to "Analysis," supporting multi-dimensional analysis statistics based on 1-3 tags, reflecting data distribution characteristics and trends under different dimensions over time. In analysis mode, supports various data chart analysis, including time series chart, leaderboard, pie chart, and treemap. For more details, refer to the Viewer Analysis Mode documentation.

Optimized Associated Log Viewing Experience¶

In infrastructure, APM, RUM, CI visualization viewer details pages, optimized associated log viewing experience, defaulting to display log content according to the "Maximum Display Rows" and "Display Columns" set in the log viewer, supporting custom adjustments through "Display Columns."

Log Index Optimization¶

In "Logs" - "Index," after setting the index, log-related queries added index options, defaulting to index default. You can query and analyze log data based on the index you set, involving functions including log viewer, scene custom viewer, chart log query, log monitor, etc. For more details, refer to the Log Index documentation.

Optimized Metric Analysis Chart Query¶

Added time interval and legend options in metric analysis, adjusted legend aggregation function display order. For more details, refer to Metric Analysis.

Other Functional Optimizations¶

In RUM application list, click into the application, added dropdown menu options in the top left corner, helping users quickly switch and view different application data
In metrics, RUM, APM, infrastructure, security inspection directories added Pipelines shortcut

DataKit Updates¶

DataKit collector configuration and Pipeline support synchronization via etcd/Consul and other configuration centers
Prometheus Remote Write optimization
- Collection supports tag filtering via regex
- Supports metric set name filtering via regex
Pipeline optimization
- Optimized grok() and other functions, enabling their use in if/else statements to determine if operations are effective
- Added match() function
- Added cidr() function
Process collector added open file list details field
Improved external access class data (T/R/L) disk caching and queue processing
Monitor added usage overrun prompt: at the bottom of the monitor, if the current space usage exceeds the limit, red text Beyond Usage will prompt
Optimized log collection position function, in container environments, the file will be mounted to the host to avoid losing original position records after DataKit restart
Optimized sparse log scenario collection delay issue

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

Monitoring
- Infrastructure Monitoring (ITIM) - Ansible Batch Processing Practice.
Cloud Native
- Logs - Guance Collecting Amazon ECS Logs.

For more best practices updates, refer to Best Practices Version History.

September 29, 2022¶

Guance Updates¶

Added Field Management¶

Guance supports unified management of field data in the current workspace, including system fields and custom fields. You can view field descriptions in scene chart queries, monitor detection metrics, DQL query simple query mode, etc., helping you quickly understand field meanings and apply fields. The figure below shows viewing the host field description in a scene chart query. For more details, refer to the Field Management documentation.

Optimized Metrics Function¶

Metrics Viewer Transformation¶

The original "Metrics Viewer" is renamed to "Metric Analysis," supporting users to visualize query data in time series chart mode (line chart, area chart, bar chart). For more details, refer to Metric Analysis.

Optimized Metric Management¶

Supports searching for "Metric Sets" and "Metrics" in "Metric Management"
Supports modifying metric "Unit" and "Description" in "Metric Management"
Supports viewing tag description information in "Metric Management"

For more details, refer to Metric Management.

Added Export Event Content in PDF Format¶

In the event details page, the Jump to Monitor button added text description. Click button, you can choose Export JSON File and Export PDF File to get all key data corresponding to the current event.

Monitor Adjustment¶

Monitor name does not support customization, event title input synchronously generates monitor name
Monitor supports "info" event generation logic. Trigger conditions can choose to enable or disable info: normal detection results also generate events
Monitor configuration step order adjusted to: detection configuration-event notification-association

Note: In the latest version, "Monitor Name" will be synchronously generated after "Event Title" input. Old monitors may have inconsistent "Monitor Name" and "Event Title." For a better user experience, please synchronize to the latest version as soon as possible, supporting one-click replacement of event titles.

Mute Rules Support Dynamic Configuration¶

In mute management, optimized mute scope, supporting monitors, intelligent inspection, self-built inspection, SLO, alert policies, and other options, added tag options.

Note: Mute scope is mandatory, tags are optional. Mute only takes effect when both "Mute Scope" and "Tags" conditions are met. For example, if mute scope selects APM and Disk Usage Rate, and tags select: host:izbp152ke14timzud0du15z, when conditions meet both APM andhost:izbp152ke14timzud0du15z or both Disk Usage Rate andhost:izbp152ke14timzud0du15z, the alert notification is muted and will not be sent to the alert notification targets.

Optimized Pipeline Configuration Page¶

In text processing (Pipeline), supports adding multiple sample parsing tests, fixes one-click sample acquisition error for metric data. For more details, refer to Text Processing (Pipeline).

Other Functional Optimizations¶

Notes added global lock time configuration. After configuring global lock time, all charts in the note page display data according to the lock time
Unresolved event query changed to the last 48 hours of data, supports manual refresh
RUM supports same user view override logic
RUM Web, WeChat Mini Program, and uniapp development framework mini program initialization parameters added isIntakeUrl configuration, used to determine whether to collect corresponding resource data based on the request resource URL, defaulting to collect all
Intelligent inspection added support for self-built inspection
Generate metric page operation column adjustment, added "Open in Metric Analysis" and "Open in Metric Management" operation icons
Management navigation menu position adjustment, SSO management migrated to member management, notification target management migrated to monitoring, built-in views migrated to scenes

Best Practices Updates¶

Cloud Native: Multiple Kubernetes Clusters Metric Collection Best Practices.

For more best practices updates, refer to Best Practices Version History.

September 15, 2022¶

Guance Updates¶

Added Log Viewer DQL Search Mode¶

In the log viewer, you can click the toggle icon in the search bar to switch to DQL manual input query mode, supporting custom input filter conditions and search conditions.

Filter conditions: Supports and / or any combination, supports using () parentheses to indicate search execution priority, supports =, != and other operators
Search conditions: Supports searching logs via DQL function query_string()

For more details, refer to the DQL Search documentation.

Optimized APM¶

Link Viewer Details Page Optimization¶

Optimized details page layout display, added duration, http method, http url, http status code, TraceId, etc.
Flame chart added thumbnail, double-click Span to zoom in, click service name to highlight corresponding Span
Span list added search, click select Span to switch to flame chart synchronized display
Service call relationship added search

For more details, refer to the Link Viewer documentation.

Profile Viewer Details Page Optimization¶

In the Profile viewer details page, added quick operations, including search, copy, and click select view method. For more details, refer to the Quick Operation Instructions documentation.

Optimized Monitor Event Notification Content Edit Mode¶

When creating a monitor, the event notification content sent when trigger conditions are met supports input and preview markdown format text information, supports using template variables.

Added Mute Management Supports Periodic Mute Configuration¶

Mute management added periodic mute function, in mute time, you can choose "Only Once," "Repeat." For more details, refer to Mute Management.

Other Functional Optimizations¶

Scene dashboard group display optimization, scene notes optimized text component Markdown format
Infrastructure viewer display optimization, added display column CPU usage rate, MEM usage rate, etc. prompt information; "Pods," "Deployments," "Services" viewer details page added view and copy corresponding YAML file
Metric viewer deleted list view mode, retained flat view mode and mixed view mode
Log multi-index supports jump view
Viewer quick filter value TOP 5 supports viewing proportion count, viewer time field format optimization, default display format is 2022/09/15 20:53:40
Link viewer time series chart added legend display, quick filter added HTTP related fields

DataKit Updates¶

Added automatic cloud synchronization function, no longer need to manually specify cloud vendor
Supports synchronizing k8s label as tag to pod metrics and logs
Supports collecting various yaml information in k8s to corresponding object data
Trace collection supports automatically extracting some key meta information
Supports specifying installation source address during installation, simplifying offline installation process
Pipeline new functions:
- Added for loop/dictionary/array support
- Added arithmetic expression support
- Pipeline error information will be displayed on collected data
- If time field cutting error, supports automatically correcting time field(time), to avoid time unable to display on console page
- Added len() function

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

Monitoring- Middleware (Middleware) - Insights MySQL.

For more best practices updates, refer to Best Practices Version History.

September 1, 2022¶

Guance Updates¶

Billing Updates¶

Guance billing item backup logs adjusted billing rules, adjusted backup logs to 0.007 yuan per 1 GB data/day. You can adjust corresponding data retention policies according to actual needs to save cost. For more details, refer to the Billing Methods documentation.

Help Documentation Directory Updates¶

Split changelog directory, supports viewing Guance updates by year
Added custom development directory, can view custom collector (Pythond), custom security inspection (Scheck), custom DDtrace, etc. documents
Added private deployment directory, can view Guance deployment related documents

Time Series Chart Added Event Correlation Analysis¶

Time series chart added event correlation analysis, supports matching abnormal events related to selected fields through "Add Filter Field," achieving time series data and event correlation display, helping users perceive whether related events occurred during data fluctuations while viewing trends, to locate issues.

After configuring event correlation in time series chart, on the time axis, if there are event records related to the selected correlation field (e.g., "host:DESKTOP-NEN89U3"), they will be marked with shaded blocks
After configuring event correlation in time series chart, in analysis mode, click highlighted shaded blocks to view abnormal events related to the selected field (e.g., "host:DESKTOP-NEN89U3")

For more details, refer to the Time Series Chart documentation.

Logs Added Multi-Index Mode¶

Guance supports setting log multi-index, saving logs meeting conditions in different log indexes, and selecting different data retention policies for log indexes, helping users save log data storage costs. For more details, refer to the Log Index documentation.

Optimized Backup Log Rules¶

Backup log new rule migrated to log index menu, backup cycle changed from backing up previous day's logs at 0:00 daily to executing rule verification and backup every 5 minutes, i.e., backup logs can be viewed at most 5 minutes after configuring backup rules. For more details, refer to the Backup Logs documentation.

Optimized Log Context¶

When viewing context in the log details page, opening a new log viewer will use "host," "source," "service," "filename" as filter conditions, viewing data before and after the current log time.

Optimized RUM¶

Added Custom RUM Application ID¶

RUM supports users to customize application ID as the unique identifier of the current workspace (original Guance application ID is globally unique, i.e., application IDs in different spaces cannot be repeated), different workspaces can use the same application ID as the unique identifier of the same application, used for SDK data upload matching. For more details, refer to:

Web Application Integration
Android Application Integration
iOS Application Integration
Mini Program Application Integration

Added RUM Network Request Error Correlation Link Viewing¶

RUM supports users to view network (network) error related links in the RUM viewer.

Intelligent Inspection Comprehensive Upgrade¶

Intelligent inspection list adjusted "Group" to "Alert Policy," supports selecting alert policies for intelligent inspection when editing
Intelligent inspection related event details page comprehensive adjustment, including details page related pages, such as basic attributes, event details, root cause analysis, alert notification, history records, related events, etc.; optimized abnormal chart analysis, added data correlation jump links, abnormal interval prompts, root cause analysis interval prompts, legend display operations, etc.

For more details, refer to Intelligent Inspection.

Optimized Monitoring¶

Adjusted Group to Alert Policy¶

In "Monitoring," adjusted "Group Management" page to "Alert Policy Management," creating alert policies to filter monitors and set alert notifications.

In Monitor, original "Group" filter adjusted to "Alert Policy" filter, supports selecting alert policies when configuring monitors, supports clicking monitor alert policies to modify alert settings.

Optimized Monitor Configuration¶

Adjusted monitor configuration process steps, including detection frequency, detection interval, alert policy, etc.
Optimized detection metrics, supports configuring outer functions (fx), including "Label Filter," "Conversion Function," "Data Gap Fill"; supports switching to DQL query mode
Optimized trigger condition text prompts
Optimized event notification, removed part of monitor custom data gap event titles and content; adjusted template variable prompt text; adjusted group to alert policy, and supports editing alert policy
Optimized log detection, APM metrics detection, RUM metrics detection "Detection Metrics" configuration

For more details, refer to Monitor Management.

Added "Infrastructure Survival Detection"¶

"Infrastructure Survival Detection" is used to monitor the running status of infrastructure. For more details, refer to Infrastructure Survival Detection.

Added "Process Abnormal Detection"¶

"Process Abnormal Detection" is used to monitor process data in the workspace, supports setting alerts for one or more field types of process data. For more details, refer to Process Abnormal Detection.

Note: Infrastructure object detection has been removed, existing related monitors can continue to use, but no longer supports creating new ones.

Optimized "APM Metrics Detection"¶

"APM Metrics Detection" added "Link Statistics" detection method, counting the number of links meeting conditions within a specified time, triggering abnormal events when exceeding custom thresholds. Can be used for service link abnormal error notifications. For more details, refer to APM Metrics Detection

Optimized Member Management¶

Read-only members no longer support viewing member management page
Supports filtering regular members and SSO members, SSO members only display members corresponding to the currently configured identity provider (IDP)

For more details, refer to Member Management.

Added DEMO Workspace¶

Guance provides workspace Demo to help you better use Guance various functional modules. You can click "Workspace" in the top left corner, click "Experience Demo Space" in the pop-up dialog box, to enter the Demo space for viewing.

Other Functional Optimizations¶

Chart metric aggregation function changed from default last to avg, log data aggregation function changed from default last to count
Optimized time series chart, pie chart legend copy experience
Optimized note edit mode interaction display
Snapshot supports saving current viewer display column information
Link details page formatted display for time fields, converting timestamps to date format display
Deployment version management backend supports modifying workspace data retention policy

DataKit Updates¶

Breaking changes¶

Gitlab and Jenkins collectors, CI/CD data related time fields adjusted, to unify front-end page data display effect

Collector Function Adjustment¶

Optimized IO module data processing, improving data throughput efficiency
Added disk cache function on various Trace
DataKit own metric set added goroutine usage related metric set (datakit_goroutine)
MySQL collector added mysql_dbm_activity metric set
Added netstat collector
TDengine added log collection
Optimized disk collector fstype filter, default only collects common file systems
Log collector, for each log, added field message_length representing current log length, facilitating filtering logs by length
CRD supports locating Pod range via DaemonSet
eBPF removed go-bindata dependency
Container collector default opens k8s and container related metrics, this will consume additional time series to some extent

Bug Fixes¶

Fixed DataKit own CPU usage calculation error
Fixed SkyWalking middleware recognition issue
Fixed Oracle exit issue
Fixed Sink DataWay failure issue
Fixed HTTP /v1/write/:category interface JSON write issue

Document Adjustment¶

Almost every chapter added jump labels, facilitating permanent references from other documents
pythond document moved to custom development directory
Collector documents migrated from original "Integration" to "DataKit" document library
DataKit document directory structure adjustment, reduced directory levels
Almost every collector added k8s configuration entry
Adjusted document header display, in addition to operating system identifier, added election identifier for collectors supporting election

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

Cloud Native
- Using CRD to Start Your Ingress Observability Journey
Monitoring
- Application Performance Monitoring (APM) - DDtrace Custom Instrumentation
- Application Performance Monitoring (APM) - DDtrace Guance Secondary Development Practice

For more best practices updates, refer to Best Practices Version History.

August 18, 2022¶

Guance Updates¶

Guance Billing Updates¶

Guance billing items APM, RUM, logs added data retention policies and corresponding unit prices, log data added 7-day data retention policy, APM and RUM added 3-day data retention policy, you can adjust corresponding data retention policies according to actual needs to save cost. For more details, refer to the Billing Methods documentation.

Optimized Viewer¶

Added Filter History¶

Guance added viewer filter history function, supports current user saving viewer key:value search condition history locally in the browser, in the current workspace, you can use history search conditions directly in different viewers, helping avoid repeated filter condition configuration.

Open filter history: Supports clicking the expand icon in the lower right corner of the viewer, or directly using shortcut keys ( Mac OS: shift+cmd+k / Windows: shift+ctrl+k ) to quickly open filter history
Close filter history: Click close button x or use esc key to close filter history

For more details, refer to the Filter History Instructions documentation.

Added Quick Filter Value Sorting¶

In viewer quick filter, added support for field value sorting by percentage, click the "Settings" button in the upper right corner of the quick filter item, select "Query Value TOP 5," to view the top five field attribute value statistics percentage. On the right side of the leaderboard, supports clicking "Positive Filter," "Reverse Filter" buttons, to filter query data in key:value form for current ranking field attribute values. More viewer quick filter details refer to Quick Filter Instructions documentation.

In viewer time widget, added time widget input format hint page, optimized time widget text input box, supports and hints box real-time linkage, helping users quickly understand time widget supported input format types. More viewer time widget details refer to Time Widget Instructions documentation.

Added Display Column Field Separator Line and Text Prompt¶

In viewer adding display columns, added field separator line and its add text prompt. When inputting fields in display columns, preset fields are distinguished from existing fields by the separator line, and prompt text "Create and Add," supports selecting add display columns through keyboard up and down arrow keys (↑ ↓ ); more viewer display columns refer to Display Column Instructions documentation.

Added Scene Dashboard/Note/Viewer View Permissions.¶

In scene new Dashboard, Note, Viewer, supports creator custom view permissions, to prevent creator's own dashboard from being mistakenly moved, or prematurely publishing incomplete or inconvenient to publish dashboard / note / viewer. Permission settings include "Public" and "Only Visible to Self."

Public: Open to all members in the current workspace, other members' view and edit permissions are not affected
Only Visible to Self: Only the creator is visible, other members do not have view permissions

Note: When accessing non-public dashboard/note/viewer through links, non-creators are not visible, prompt user no permission to view.

Added Snapshot View Permissions¶

In scene or viewer saving snapshot, supports custom view permissions, permission settings include "Public" and "Only Visible to Self."

Public: Indicates users in the current workspace can view saved snapshots
Only Visible to Self: Indicates except the current user, other users cannot view saved snapshots

In viewer saving snapshot, supports viewing history snapshot time range, filter conditions, time range is divided into "Absolute Time," "Relative Time" and "Default" three types according to the selection when saving snapshot. More snapshot usage details refer to Snapshot documentation.

Optimized Monitors and Events¶

Added Monitor Test¶

Monitor added manually trigger monitor detection. If the current detection rule triggers, you can view related details in the event viewer.

Optimized Intelligent Inspection Information Display¶

Intelligent inspection list added "Data Range," "Detection Frequency," "Group," "Last Trigger Time," "Trigger Status." Operations added "Export JSON Configuration," export file name format: intelligent inspection name.json.

Intelligent inspection event details page added "Basic Attributes," "History Records," "Related Events" and other common pages.

Optimized Event Details Page¶

In event details page, optimized "Basic Attributes" page; "Copy Current Event Content" adjusted to "Export Event JSON" button, meanwhile added "View Monitor Configuration" button on the left, supports one-click jump to the current event's monitor configuration page, facilitating real-time adjustment of monitor rules.

If monitor configured alert, related event details page added "Alert Notification" page. If monitor set alert mute, during alert mute period, the same alert event will not be sent to notification targets, in event details page "Alert Notification" page, the alert notification is marked as "Notification Not Sent."

Other Functional Optimizations¶

Guance added support for email verification method authentication
Viewer details page associated network page optimized host, Pod, Deployment type display
Dashboard and built-in views and other places adding charts added switch icon, adjusted view variable edit button position
Time series chart legend value added sum summation statistics, meanwhile optimized legend display and interaction
Monitor, chart query log data filter conditions added wildcard and not wildcard

DataKit Updates¶

New Features¶

Pipeline added reftable function
DataKit 9529 HTTP supports binding to domain socket
- Corresponding eBPF collection and Oracle collection, their configuration methods also need corresponding changes.
RUM sourcemap added Android R8 support
CRD added log configuration support
- Complete example

Optimizations¶

Optimized container collector documentation
Added Common Tag documentation
Optimized election configuration and some related naming
Election collectors still support turning off election function on specific collectors when DataKit election is enabled
Supports specifying data type io block configuration
DDTrace collector sampling added meta information recognition
DataKit own metric set added 9529 HTTP request related metrics
Optimized Zipkin collection memory usage
DDTrace collector becomes blocking IO feed by default after enabling disk cache
eBPF added process name (process_name) field
DCA new version released
Log class HTTP data writing (logstreaming/Jaeger/OpenTelemetry/Zipkin) all added queue support
Log collection added automatic multi-line support

Bug Fixes¶

Fixed MySQL collector connection leak issue
Fixed Pipeline Json value issue
Fixed macOS ulimit setting invalid issue
Fixed sinker-Dataway invalid in Kubernetes issue
Fixed HTTP data writing class interface data verification issue
Fixed eBPF collector structure offset calculation failure issue after kernel change
Fixed DDTrace close-resource issue

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

Monitoring
- Using extract + TextMapAdapter to implement custom traceId
Insights
- Scene - Intranet Scene Dubbo Microservice Integration with Guance

For more best practices updates, refer to Best Practices Version History.

August 4, 2022¶

Guance Updates¶

DCA Web Version Online¶

Guance added DataKit web version management tool DCA, aiming to facilitate management of installed and configured collectors, supports viewing collector running status, collector configuration management, Pipeline management, blacklist management and collector document help and other functions. For more details, refer to DCA documentation.

Viewer Search¶

In viewer search bar, added "Exist," "Not Exist" filter logic, by judging whether the filter field exists to return search results
In viewer search bar, added number type operation methods, supports including equal, greater than or equal, less than or equal, greater than, less than, not equal and other operators
Added field data type prompt, matching mode description

More viewer search details refer to Search Instructions documentation.

Quick Filter¶

In quick filter items, added tag field search function, when quick filter items exceed 10 tag fields, supports fuzzy search by "Field Name" or "Display Name"
In quick filter items added "Settings" button, supports adding / removing display columns
In quick filter items added "Settings" button, custom added personal level filter item fields support editing display name and deleting fields

More viewer quick filter details refer to Quick Filter Instructions documentation.

Added interval display, supports clicking time widget display box manually input time range, including "Interval Range," "Timestamp Range" and "Standard Time Format"
Dropdown list added custom options, custom range supports hour:minute:second format input
Added last 20 history absolute time records view

More viewer time widget details refer to Time Widget Instructions documentation.

Display Columns¶

In viewer list, when mouse hovers on display columns, added "Settings" button, supports ascending, descending, move column left, move column right, add column left, add column right, replace column, add to quick filter, add to group, remove column and other operations for display columns. More viewer display columns refer to Display Column Instructions documentation.

Optimized Viewer Details Page¶

Adjusted extended field quick filter "Filter Field Value," "Reverse Filter Field Value," "Add to Display Columns" and "Copy" and other operation positions
Supports switching up and down log details through keyboard up and down arrow keys (↑ ↓)
Supports directly closing details page popup through keyboard esc button
Added "View Context" function: in log details page view context opening new log viewer, will use "host," "source," "service," "filename" as filter conditions, using current log time as start time, current log time + 30 minutes as end time to bring to time widget for context log filter. More details refer to View Context documentation.

Added Global Viewer Auto Refresh Configuration¶

In Guance workspace, click "Account," can enable / disable "Viewer Auto Refresh."

Enable: Viewer data according to time widget default data refresh time 30 seconds for auto refresh, such as selecting last 15 minutes, according to 30 seconds refresh once display last 15 minutes data
Disable: Viewer time widget enters closed 30 seconds auto refresh, such as selecting last 15 minutes, display the 15 minutes absolute time content data and no longer auto refresh, can click "Play" button refresh view last 15 minutes data

Note: Viewer auto refresh only takes effect locally in the browser. More viewer time widget details refer to Time Widget Instructions documentation.

Added Global Blacklist Function¶

Guance supports filtering data meeting conditions of different types by setting blacklist, i.e., after configuring blacklist, data meeting conditions will no longer be reported to Guance workspace, helping you save data storage costs. Global blacklist function currently supports filtering data types including logs, basic objects, resource catalog, network, APM, RUM, security inspection, events, metrics, Profile. For more details, refer to Blacklist documentation.

Guance supports manually setting function menu, including hide/display and adjusting menu order, helping you customize current workspace menu display. In Guance workspace, click account in the lower left corner, select "Function Menu Management," to adjust the menu. For more details, refer to Function Menu Management documentation.

Added Chart Query Alias¶

In scene visualization charts, added chart query alias, after adding alias, chart legend name also changes accordingly, facilitating more intuitive differentiation of related metrics. Currently supported charts include time series chart, pie chart, bar chart, scatter chart, bubble chart, funnel chart.

Added Time Series Chart, Pie Chart Legend Style¶

In scene visualization charts, pie chart added support including bottom, right, surround, hide legend styles, time series chart supports including bottom, right and hide legend styles, in default state hide legend style.

Optimized Object History Data Retention Policy¶

Guance stores 48 hours history data for all objects (host, container, pod) reported to the workspace, facilitating users to trace back object data performance at a certain moment in the past two days. When viewing a log, link, security inspection data, you can view the corresponding object situation at that moment in the "Attribute View" of the associated host, container, Pod.

Adjusted Save Snapshot Position¶

Viewer top navigation bar removed "Save Snapshot" button, uniformly migrated to "History Snapshot," scene dashboard and note can create snapshots through shortcut keys. For more details, refer to Snapshot documentation.

Other Functional Optimizations¶

Time series chart time interval added to millisecond level
Management backend added workspace level index configuration adjustment entry
Log viewer distribution chart added support custom select time interval
RUM viewer page added current data extended field page display

DataKit Updates¶

Part of data type sending failure, supports caching to disk, sending later
Supports sending data meeting conditions to different workspaces through different dataway addresses
Sourcemap added Android and iOS support
Container collector related updates:
- Fixed Kubernetes Node host operating system information collection error
- Kubernetes Prom collection no longer automatically appends pod related information, avoiding time series explosion
- Pod object appended corresponding yaml information
Pipeline related updates:
- Optimized Pipeline execution steps
- grok() and json() functions default execute trim-space operation
DDTrace related updates:
- Fixed potential goroutine leak issue
- Supports configuring disk cache to alleviate memory usage issue
Other Bug Fixes:
- Optimized line protocol construction
- Log collection, removed periodic clean tail data function, to alleviate possible log truncation issue

For more DataKit updates, refer to DataKit Version History.

July 21, 2022¶

Guance Updates¶

Added Intelligent Inspection Function¶

Intelligent inspection based on Guance intelligent detection algorithm, supports automatically detecting infrastructure and application problems, helping users discover IT system operation problems, through root cause analysis, quickly locate abnormal problem causes; through Guance intelligent prediction algorithm, helping users foresee infrastructure and application potential problems in advance, evaluate problem impact level on system operation, better determine troubleshooting work priority, reduce troubleshooting process uncertainty.

Intelligent inspection currently supports three inspection templates:

Memory Leak: Detect current workspace host memory leak problem
Disk Usage Rate: Detect current workspace host disk usage rate too high problem
Application Performance Detection: Detect current workspace service QPS, average response time, P90 response time and error rate fluctuation changes

Optimized Viewer Search and Filter Function¶

Viewer search added "not wildcard reverse fuzzy matching," i.e., not matching fuzzy query results.

Viewer quick filter added workspace level and personal level filter methods
Workspace level filter items: Configured by administrator/owner, click "Settings" button next to quick filter, to configure workspace level filter items
Personal level filter items: All members can configure quick filter items based on local browser, click "Edit" on the right side of quick filter, to configure personal level filter items

For more details, refer to Viewer Search and Filter documentation.

Added Modify URL Time Range for Data Query¶

Guance supports directly modifying the time parameter time range in the browser URL for current workspace viewer/dashboard data query, supports second, minute, hour, day 4 units, such as time=30s, time=20m, time=6h, time=2d, etc., as shown below modifying time=2h in the browser, viewer displays last 2 hours data. For more details, refer to URL Time Range documentation.

Added Dashboard View Variable Logs, APM, RUM, Security Inspection Data Source Configuration¶

Dashboard view variable added "Logs," "APM," "RUM," "Security Inspection" data source configuration, meanwhile optimized dashboard new and edit view variable interaction.

In dashboard without added view variables, top navigation bar added "Add View Variable" button, click to add view variable
If dashboard already added view variables, top navigation bar below directly displays view variable name, click "Edit" button on the right, to enter view variable edit page

For more details, refer to View Variable documentation.

Optimized Chart Query Interaction¶

Click "Separator Bar" between chart and query to drag up and down
Click "Drag" button on the left of query statement, drag up and down to adjust query order
Scroll bar only acts on query statement area, not affecting chart

Added RUM Metrics Detection Event Notification Template Variables¶

In "RUM Metrics Detection" monitor configuring notification events, besides general template variables, additionally supports the following template variables. For more details, refer to Event Title, Content Template documentation.

Template Variable	Type	Description
`app_id`	String	Application ID
`app_name`	String	Application Name
`app_type`	String	Application Type

Optimized Event Content One-Click Open Link¶

Configuring monitor, adding link in event content, when event triggers, in event details page "Event Content," click link to open new page jump page.

DataKit Updates¶

prom collector built-in timeout duration is 3 seconds
Log related issue fixes:
- Added log collection log_read_offset field
- Fixed log file rotate not correctly readAll bug
Container collection related issue fixes:
- Fixed environment variable NODE_NAME incompatibility issue
- k8s auto discovered prom collector changed to serial, node scattered collection
- Added log source and multi-line mapping configuration
- Fixed container log replace source still using previous multiline and pipeline bug
- Corrected container log, set file active duration is 12 hours
- Optimized docker container log image field
- Optimized k8s pod object host field
- Fixed container metrics and object collection not adding host tag issue
eBPF related:
- Fixed uprobe event name naming conflict issue
- Added more environment variable configuration, facilitating cloud k8s environment deployment
Optimized APM data receiving interface data processing, alleviating client stuck and memory usage issue
SQLServer collector fixes:
- Restored TLS1.0 support
- Supports instance collection filtering, to reduce time series consumption
Pipeline function adjust_timezone() adjusted
IO module optimization, improving overall data processing capability, maintaining relatively controllable memory consumption
Monitor updates:
- Fixed Monitor possible long time stuck when busy
- Optimized Monitor display, added IO module information display, facilitating user adjust IO module parameters
Fixed Redis crash issue
Removed part of redundant redundant logs
Fixed election collector not appending host tag issue in non-election mode

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

Cloud Platform Integration
- Rancher Deployment DataKit Best Practices
- Tencent Cloud Product Observability Best Practices (Function)

For more best practices updates, refer to Best Practices Version History.

July 7, 2022¶

Guance Updates¶

Optimized Viewer Positive Selection, Reverse Selection, Fuzzy Matching Three Filter Modes¶

Guance viewer supports exact filter, fuzzy filter (wildcard) and reverse selection according to "field:value" method, supports editing and modifying the filtered "field:value". For more details, refer to Viewer Search and Filter documentation.

Optimized Viewer Quick Filter¶

In Guance viewer quick filter, default select all, supports "positive selection," "reverse selection," "reset," "All" and "only" multiple filters, if search box includes both positive selection and reverse selection, corresponding quick filter tags gray out cannot select. For more details, refer to Quick Filter documentation.

Added Viewer Display Columns Multiple Quick Operations¶

In Guance viewer, through "Display Columns," you can add, remove display columns to viewer list.

When mouse hovers on added display columns, supports ascending, descending, move column left, move column right, remove column and other operations for added display columns.
If display column content display incomplete, supports double clicking display column right separator line "Double Click Separator Line," to expand the column content.

Optimized Viewer Details Page Attribute/Field Quick Filter¶

In viewer details page, when mouse clicks attribute fields such as "host," "source," supports "positive filter," "reverse filter," "add to display columns" and "copy" for quick filter view; in log viewer details page, when mouse selects extended fields, displays "copy," "positive filter," "reverse filter" and "add to display columns" icons for quick filter view.

"Copy," i.e., copy the field to clipboard
"Positive Filter," i.e., add the field to viewer, view all data related to the field
"Reverse Filter," i.e., add the field to viewer, view other data except the field
"Add to Display Columns," i.e., add the field to viewer list for view

Optimized History Snapshot Function, Supports Three Time Save Policies¶

In metrics, logs, events, APM, RUM, cloud dial testing, security inspection, CI visualization and other viewers, you can click "Save Snapshot" to save current viewer displayed data content, supports selecting enabling/disabling "Time Filter."

Snapshot enabling time filter, save according to current page selected time, shared link does not support switching time widget
Snapshot enabling time filter, and enabling lock absolute time, convert current page selected time range to "absolute time" for save
Snapshot disabling time filter, follow system default time, shared snapshot can switch time widget

Snapshot saved, can view in viewer history snapshot list, select and open history snapshot, click "Return Viewer" in the upper right corner to return to default viewer.

Added Pipeline One-Click Get Sample Test Data¶

In new or edit Pipeline, added "One-Click Get" button on the right of sample parsing test, facilitating you get data for cutting debugging.

Log data: Returns message data
Other data types: Returns line protocol format data

For more details, refer to Text Processing Pipeline documentation.

Added Scene Custom Viewer Text Analysis Mode¶

In scene custom viewer, edit viewer, in custom configuration display columns, supports selecting "Approximate Text Analysis" viewer field, default uses message field corresponding content for approximate text analysis. For more details, refer to Scene Custom Viewer documentation.

Added Log Viewer Details Page Associated Network Pod and Deployment View¶

Guance supports in log viewer details page "Network," selecting view host, Pod and Deployment view data connection situation.

Note: In log details view related network, need to match corresponding fields.

Added Viewer Details Page Associated Network 48 Hours Data Replay Function¶

In log, process, link, host, Pod viewer details page associated network, supports clicking time widget selecting replay 48 hours network data.

Time range: Default view before and after 30 minutes data, if currently happening, default view last 1 hour data
Supports arbitrary drag time range view corresponding network traffic
After dragging, click "Play" button or refresh page, return to view "Last 1 Hour" network data.

Adjusted Unresolved Event Save Policy, Supports Manually Resolve Event¶

In unresolved event list, mouse moves to event, on the right of event can view "Resolved" function. Click "Resolved" to resolve event, meanwhile generates a resolved event, in the event can view corresponding operator.

Other Functional Optimizations¶

Chart lock time added [Last 5 Minutes] time range, time interval added [5s][10s][30s] three second level time selection
Scene viewer display columns, view variable basic object field attributes/tags supports custom input
Adjusted event details associated dashboard position
In metric management added time series count statistics
Optimized log details page associated link, according to log trace_id and span_id display flame chart and select corresponding span all data
Optimized RUM service display and interaction
RUM, network, synthetic testing, CI viewer dropdown options adjusted to flat display
Monitor event notification content supports configuring template variable field mapping, supports configuring template variable corresponding values through DQL query statement.
Help center homepage added key function quick jump entry

DataKit Updates¶

Adjusted global tag behavior, avoiding election collector tag split
SQLServer collector added election support
Line protocol filter supports all data types
9529 HTTP service added timeout mechanism
MySQL
- dbm metric set name adjustment
- service field conflict issue
Container object added field container_runtime_name to distinguish different level container names
Redis adjusted slowlog collection, changed its data to log storage
Optimized TDEngine collection
Improved Containerd log collection
Pipeline added Profile class data support
Container/Pod log collection supports additional tag appending on Label/Annotation
Fixed Jenkins CI data collection time accuracy issue
Fixed Tracing resource-type value inconsistency issue
eBPF added HTTPS support
Fixed log collector possible crash issue
Fixed prom collector leak issue
Supports configuring io disk cache through environment variables
Added Kubernetes CRD support

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

APM
- GraalVM and Spring Native Project Link Observability
Integration
- Host Observability Best Practices (Linux)

For more best practices updates, refer to Best Practices Version History.

Integration Template Updates¶

Added Documents¶

Alibaba Cloud
- Alibaba Cloud NAT
- Alibaba Cloud CDN

Added Views¶

Alibaba Cloud
- Alibaba Cloud NAT
- Alibaba Cloud CDN

June 6, 2022¶

Guance Billing Updates¶

Guance billing optimized time series billing logic, and metric data data retention policy. Original every 300 lines 3 yuan reduced to every 1000 lines 3 yuan. Meanwhile metric data added 3 days, 7 days, 14 days data retention policy, metric set supports custom data retention policy.

Time series statistics is the current workspace, reported metric data based on tags can combine all combination numbers. Data retention policy is data storage duration, is data reported to current workspace save time, data beyond storage duration will be automatically deleted.

Time series is full statistics, i.e., daily generated time series during data retention policy period will accumulate, the longer the data retention policy, the higher the time series cost.

This optimization through reducing time series cost and shortening metric data retention policy, you can more flexibly adjust metric data retention policy, helping you save cost.

Guance Updates¶

Added Jenkins CI Observability¶

Guance added Jenkins CI observability, you can directly view CI results in Jenkins through Guance CI visualization function. CI process is continuous integration, developers when push code, if encounter problems, can view all CI pipeline and its success rate, failure reason, specific failure link in Guance, helping you provide code update guarantee. For more details, refer to CI Visualization documentation.

Added Custom Viewer Chart Synchronized Search¶

Custom viewer added chart synchronized search switch, used to determine whether search conditions affect chart query, default enabled. When search box has content, close switch, i.e., chart query returns to default state; enable switch, i.e., chart query affected by filter content.

Added Network Topology and Service Topology Drill-down Analysis¶

In infrastructure network topology map, click host/Pod icon, click "View Upstream and Downstream," to view current node upstream and downstream node association. In upstream and downstream nodes, click "Return Overview" in the upper left corner to return to original network topology map, in search box search or filter can filter associated upstream and downstream nodes, according to search or filter results display matched associated upstream and downstream nodes. For more details, refer to Network View Upstream and Downstream documentation.

In service topology map, click service icon, click "View Upstream and Downstream," to view current service upstream and downstream service association. In upstream and downstream services, click "Return Overview" in the upper left corner to return to original service topology map, in search box search or filter can filter associated upstream and downstream services, according to search or filter results display matched associated upstream and downstream services. For more details, refer to Service View Upstream and Downstream documentation.

Added Delete Resource Catalog Data and Index¶

Guance supports owner and administrator delete specified resource catalog classification and all resource catalog, enter "Management" - "Basic Settings," click "Delete Resource Catalog," select delete resource catalog method, to delete corresponding object data.

Specified resource catalog classification: Only delete selected object classification data, does not delete index
All resource catalog: Delete all resource catalog data and index

Note: All resource catalog once deleted, reported to infrastructure custom all data and index all will be deleted and cannot be recovered, all set resource catalog classification data need to be reported again, daily limit 5 times delete all resource catalog operation.

More resource catalog introduction refer to Custom documentation.

Added Viewer Snapshot View Entry¶

In Guance metrics, logs, events, APM, RUM, cloud dial testing, security inspection, CI visualization and other viewers, save snapshot, can directly click view snapshot icon in the upper right corner slide to view already saved snapshots.

Supports snapshot name keyword search, through keyword fuzzy match related snapshot names
First is default view, does not support share, copy link and delete function
Except first default view, other snapshots support share, copy link and delete function, click "Snapshot Name," to open corresponding data copy in current viewer

Added Viewer Filter Condition Edit Function¶

In Guance viewer search bar through "field:value" method filter, supports clicking "field:value" edit "field:value," and filter with modified results.

Optimized RUM View Viewer Associated Link to Fetch/XHR¶

In Guance RUM View Viewer details page, switch to "Fetch/XHR," supports viewing each network request RUM view viewer sends to backend application, including occurrence time, requested link and duration.

If network request has corresponding trace_id, before request has prompt icon, click request, can jump to corresponding link details page.

Added Chart Data Load High Performance Mode¶

Guance supports chart data load high performance mode, default disabled, can click account in the lower left corner, select "High Performance Mode" to enable. High performance mode enabled, all charts do not dynamic load, when click enter page directly load simultaneously, i.e., beyond current page use scroll down view charts already all loaded, can directly view display results.

Note: High performance mode enabled only for current user view charts.

Added Alert Configuration Event Notification Level¶

Alert configuration supports custom select event notification level, including emergency, important, warning, recovery, data gap, data gap recovery, data gap considered recovery 7 choices, supports multi-select, supports one-click clear options, after clear options clear, need manually select corresponding values. More alert configuration refer to Alert Settings documentation.

Other Functional Optimizations¶

Scene dashboard combination chart supports hide/display big title
Optimized event details page event type text display
Infrastructure list view added sort by field function
Log viewer added hide distribution chart button
Viewer supports keyword search display columns, supports custom display columns as preset fields, later through Pipeline cutting fields and report data directly display reported data.
In built-in template library and built-in views added one-click view corresponding integration documents, helping you youquickly configure corresponding collectors
Built-in views, besides supporting binding link services, applications, log sources, projects, tags and other related views in the viewer, added support for custom key and value binding related views, meanwhile supports service side slide details page binding built-in views
Optimized notification object Lark robot, supports custom whether need key security verification
Configuring monitor, if configured data range less than detection frequency, triggers prompt configuration may exist data gap issue

DataKit Updates (2022/05/26)¶

Pipeline adjusted, all data types, can be additionally processed through configuring Pipeline
grok() supports directly extracting fields as specified types, no longer need additional type conversion through cast() function
Pipeline added multi-line string support, for very long strings (such as regular cutting in grok), can improve readability by writing them in multiple lines
Each Pipeline running status, can directly view through datakit monitor -V
Added Kubernetes Pod object CPU/memory metrics
Helm added more Kubernetes version installation adaptation
Optimized OpenTelemetry, HTTP protocol added JSON support
DataKit automatically corrects line protocol, added log records for correction behavior, facilitating debugging data issues
Removed all string metrics in time series data
In DaemonSet installation, if election namespace configured, for collectors participating in election, their data will add specific tag (election_namespace)
CI observability, added Jenkins support

Breaking changes¶

For Docker container log collection, need to mount host (Node) /varl/lib path to DataKit (because Docker logs default fall under host /var/lib/ ), in datakit.yaml, volumeMounts and volumes added the following configuration:

volumeMounts:
- mountPath: /var/lib
  name: lib

# Omit other parts...

volumes:
- hostPath:
    path: /var/lib
  name: lib

Best Practices Updates¶

APM
- GraalVM and Spring Native Project Link Observability
Integration
- Host Observability Best Practices (Linux)

For more best practices updates, refer to Best Practices Version History.

Integration Template Updates¶

Added Documents¶

Alibaba Cloud
- Alibaba Cloud NAT
- Alibaba Cloud CDN

Added Views¶

Alibaba Cloud
- Alibaba Cloud NAT
- Alibaba Cloud CDN

June 6, 2022¶

Guance Billing Updates¶

Guance billing optimized time series billing logic, and metric data data retention policy. Original every 300 lines 3 yuan reduced to every 1000 lines 3 yuan. Meanwhile metric data added 3 days, 7 days, 14 days data retention policy, metric set supports custom data retention policy.

Time series statistics is the current workspace, reported metric data based on tags can combine all combination numbers. Data retention policy is data storage duration, is data reported to current workspace save time, data beyond storage duration will be automatically deleted.

Time series is full statistics, i.e., daily generated time series during data retention policy period will accumulate, the longer the data retention policy, the higher the time series cost.

This optimization through reducing time series cost and shortening metric data retention policy, you can more flexibly adjust metric data retention policy, helping you save cost.

Guance Updates¶

Added Jenkins CI Observability¶

Guance added Jenkins CI observability, you can directly view CI results in Jenkins through Guance CI visualization function. CI process is continuous integration, developers when push code, if encounter problems, can view all CI pipeline and its success rate, failure reason, specific failure link in Guance, helping you provide code update guarantee. For more details, refer to CI Visualization documentation.

Added Custom Viewer Chart Synchronized Search¶

Custom viewer added chart synchronized search switch, used to determine whether search conditions affect chart query, default enabled. When search box has content, close switch, i.e., chart query returns to default state; enable switch, i.e., chart query affected by filter content.

Added Network Topology and Service Topology Drill-down Analysis¶

In infrastructure network topology map, click host/Pod icon, click "View Upstream and Downstream," to view current node upstream and downstream node association. In upstream and downstream nodes, click "Return Overview" in the upper left corner to return to original network topology map, in search box search or filter can filter associated upstream and downstream nodes, according to search or filter results display matched associated upstream and downstream nodes. For more details, refer to Network View Upstream and Downstream documentation.

In service topology map, click service icon, click "View Upstream and Downstream," to view current service upstream and downstream service association. In upstream and downstream services, click "Return Overview" in the upper left corner to return to original service topology map, in search box search or filter can filter associated upstream and downstream services, according to search or filter results display matched associated upstream and downstream services. For more details, refer to Service View Upstream and Downstream documentation.

Added Delete Resource Catalog Data and Index¶

Guance supports owner and administrator delete specified resource catalog classification and all resource catalog, enter "Management" - "Basic Settings," click "Delete Resource Catalog," select delete resource catalog method, to delete corresponding object data.

Specified resource catalog classification: Only delete selected object classification data, does not delete index
All resource catalog: Delete all resource catalog data and index

Note: All resource catalog once deleted, reported to infrastructure custom all data and index all will be deleted and cannot be recovered, all set resource catalog classification data need to be reported again, daily limit 5 times delete all resource catalog operation.

More resource catalog introduction refer to Custom documentation.

Added Viewer Snapshot View Entry¶

In Guance metrics, logs, events, APM, RUM, cloud dial testing, security inspection, CI visualization and other viewers, save snapshot, can directly click view snapshot icon in the upper right corner slide to view already saved snapshots.

Supports snapshot name keyword search, through keyword fuzzy match related snapshot names
First is default view, does not support share, copy link and delete function
Except first default view, other snapshots support share, copy link and delete function, click "Snapshot Name," to open corresponding data copy in current viewer

Added Viewer Filter Condition Edit Function¶

In Guance viewer search bar through "field:value" method filter, supports clicking "field:value" edit "field:value," and filter with modified results.

Optimized RUM View Viewer Associated Link to Fetch/XHR¶

In Guance RUM View Viewer details page, switch to "Fetch/XHR," supports viewing each network request RUM view viewer sends to backend application, including occurrence time, requested link and duration.

If network request has corresponding trace_id, before request has prompt icon, click request, can jump to corresponding link details page.

Added Chart Data Load High Performance Mode¶

Guance supports chart data load high performance mode, default disabled, can click account in the lower left corner, select "High Performance Mode" to enable. High performance mode enabled, all charts do not dynamic load, when click enter page directly load simultaneously, i.e., beyond current page use scroll down view charts already all loaded, can directly view display results.

Note: High performance mode enabled only for current user view charts.

Added Alert Configuration Event Notification Level¶

Alert configuration supports custom select event notification level, including emergency, important, warning, recovery, data gap, data gap recovery, data gap considered recovery 7 choices, supports multi-select, supports one-click clear options, after clear options clear, need manually select corresponding values. More alert configuration refer to Alert Settings documentation.

Other Functional Optimizations¶

Scene dashboard combination chart supports hide/display big title
Optimized event details page event type text display
Infrastructure list view added sort by field function
Log viewer added hide distribution chart button
Viewer supports keyword search display columns, supports custom display columns as preset fields, later through Pipeline cutting fields and report data directly display reported data.
In built-in template library and built-in views added one-click view corresponding integration documents, helping you quickly configure corresponding collectors
Built-in views, besides supporting binding link services, applications, log sources, projects, tags and other related views in the viewer, added support for custom key and value binding related views, meanwhile supports service side slide details page binding built-in views
Optimized notification object Lark robot, supports custom whether need key security verification
Configuring monitor, if configured data range less than detection frequency, triggers prompt configuration may exist data gap issue

DataKit Updates (2022/05/26)¶

Pipeline adjusted, all data types, can be additionally processed through configuring Pipeline
grok() supports directly extracting fields as specified types, no longer need additional type conversion through cast() function
Pipeline added multi-line string support, for very long strings (such as regular cutting in grok), can improve readability by writing them in multiple lines
Each Pipeline running status, can directly view through datakit monitor -V
Added Kubernetes Pod object CPU/memory metrics
Helm added more Kubernetes version installation adaptation
Optimized OpenTelemetry, HTTP protocol added JSON support
DataKit automatically corrects line protocol, added log records for correction behavior, facilitating debugging data issues
Removed all string metrics in time series data
In DaemonSet installation, if election namespace configured, for collectors participating in election, their data will add specific tag (election_namespace)
CI observability, added Jenkins support

Breaking changes¶

For Docker container log collection, need to mount host (Node) /varl/lib path to DataKit (because Docker logs default fall under host /var/lib/ ), in datakit.yaml, volumeMounts and volumes added the following configuration:

volumeMounts:
- mountPath: /var/lib
  name: lib

# Omit other parts...

volumes:
- hostPath:
    path: /var/lib
  name: lib

Best Practices Updates¶

APM
- GraalVM and Spring Native Project Link Observability
Integration
- Host Observability Best Practices (Linux)

For more best practices updates, refer to Best Practices Version History.

Integration Template Updates¶

Added Documents¶

Alibaba Cloud
- Alibaba Cloud NAT
- Alibaba Cloud CDN

Added Views¶

Alibaba Cloud
- Alibaba Cloud NAT
- Alibaba Cloud CDN