Skip to content

Changelog (2022)


This document records the updates and release notes for each deployment of Guance, including DataKit, Guance best practices, Guance integration documentation, and Guance.

December 29, 2022

Guance Updates

Added MFA Authentication Management

Guance provides MFA authentication management to add an extra layer of security beyond username and password. After enabling MFA authentication, you will need to perform a secondary verification during login to enhance account security. For more details, refer to the MFA Management documentation.

Added Workspace IP Access Whitelist

Guance supports configuring an IP whitelist for workspaces to restrict user access. Once the IP whitelist is enabled, only requests from whitelisted IPs can log in, and all other requests will be denied. For more details, refer to the IP Whitelist documentation.

Note: The IP whitelist can only be set by administrators and owners, and "owners" are not restricted by the IP whitelist.

Added Service Network Topology

In a K8S environment, you can use the Service network topology map to view the request relationships, response times, error rates, etc., between Services in the K8S environment. If a Service connection issue is detected, you can click to view the corresponding logs to locate the problem. For more details, refer to the Service Network documentation.

Other Functional Optimizations

  • Pipeline usage optimization
  • Log clustering analysis supports custom fields
  • Support for viewing associated logs after large log segmentation
  • Backup log display optimization
  • Sensitive field support for data authorization expanded to all data types except Metrics

DataKit Updates

  • Prometheus collector supports data collection via Unix Socket
  • Allows non-root users to run DataKit

  • Optimized eBPF httpflow protocol determination

  • Optimized Datakit installation and upgrade commands on Windows
  • Optimized Python encapsulation
  • Pipeline provides more detailed error messages
  • Pipeline reftable provides a SQLite-based local storage implementation

For more DataKit updates, refer to DataKit Version History.

Intelligent Inspection Updates

Official Intelligent Inspection Discontinued

The official intelligent inspections for "Memory Leak," "Application Performance Detection," and "Disk Usage Rate" are now discontinued. Users can configure these via the Self-built Inspection script library.

Added Cloud Account Instance-Level Bill Inspection

Cloud account instance-level bill inspection helps users manage abnormal cost alerts, predict expenses, and provide high-growth, high-consumption instance prompts and bill visualization capabilities, supporting multi-dimensional visualization of cloud service resource consumption.

Added Alibaba Cloud Spot Instance Survival Inspection

Since the market price of spot instances fluctuates with supply and demand, a bid mode must be specified when creating spot instances. Spot instances can only be successfully created when the real-time market price for the specified instance type is lower than the bid and inventory is sufficient. Therefore, inspecting cloud assets for spot instances is crucial. The inspection will prompt the latest prices for all available zones of the spot instance and provide appropriate handling suggestions when the spot instance is about to be released.

For more intelligent inspection updates, refer to Intelligent Inspection Changelog.

December 15, 2022

Guance Updates

Added Profile and Network Billing

Guance added Profile and Network billing items. Profile counts the number of application performance Profiles reported in the workspace that day, and Network counts the number of hosts (host) with network data reported in the workspace that day. For more details, refer to the Billing Methods documentation.

Guance Registration Process Optimization

Guance simplified the registration process to help you quickly complete registration and start using Guance. For more details, refer to the Register Guance Commercial Plan documentation.

Added Warroom Feature

Guance provides a "Warroom" dashboard where you can view key metric trends across all workspaces, helping you quickly understand key data in each workspace and promptly detect and resolve anomalies. For more details, refer to the Key Metric Management documentation.

Guance provides a carousel feature for multiple related business dashboards. Once set up, you can display them on large screens. For more details, refer to the Carousel Dashboard documentation.

Workspace Binding External SLS Index

Guance added support for binding SLS indexes, helping you quickly view and analyze your log data. Additionally, Guance added field mapping functionality to help map SLS index fields for clustering analysis. For more details, refer to the Log Index documentation.

Added "Span Count" and "Error Span Count" trend charts to the link viewer. You can quickly view trends in Span count, Error Span count, request count, Error request count, and response time metrics through the viewer's charts.

Other Functional Optimizations

  • View variable interaction optimization
  • Built-in view binding configuration interaction optimization
  • Workspace overdue lock process optimization
  • Workspace invitation user experience optimization
  • Help documentation added a rating system, including "Good" and "Poor"
  • Monitor batch function optimization
  • SLO added enable/disable functionality
  • Fuzzy matching Wildcard left * matching query limit optimization

DataKit Updates

  • Added Golang Profiling integration
  • logfwd supports LOGFWD_TARGET_CONTAINER_IMAGE for image field injection
  • trace collector:
    • Optimized error-stack/error-message format issues
    • SkyWalking compatibility adjustments, supporting 8.X full series
  • eBPF httpflow added pid/process_name fields, optimized kernel version support
  • datakit.yaml adjustments, recommended to update yaml
  • GPU graphics card collection supports remote mode

For more DataKit updates, refer to DataKit Version History.

Intelligent Inspection Updates

Intelligent Inspection Added Guide Page

Guance defaults to three intelligent inspection templates: Memory Leak, Disk Usage Rate, and Application Performance Detection. After this update, existing workspaces support manually deleting default intelligent inspection templates, while new workspaces no longer provide these three by default, adding a new user guide prompt.

When configuring self-built inspections, custom redirect links can be configured. For how to configure self-built inspections, refer to the Self-built Inspection documentation.

For more intelligent inspection updates, refer to Intelligent Inspection Changelog.

Best Practices Updates

  • Insights
    • Scene - SpringBoot Project External Tomcat Scene Link Observability.

For more best practices updates, refer to Best Practices Version History.

December 1, 2022

Guance Updates

APM Added Service List Feature

The APM service list supports real-time viewing of service ownership, dependencies, performance, associated dashboards, and correlation analysis, helping teams efficiently build and manage large-scale end-to-end distributed applications. For more details, refer to the Service List documentation.

Dashboard Chart User Experience Optimization

  • Added manual input for chart units, colors, and aliases. You can customize preset units, colors, and aliases according to current specifications, such as unit input format: aggregation function(metric), e.g., last(usage_idle)
  • Time series charts added Y-axis configuration, allowing manual configuration of Y-axis maximum and minimum values
  • Time series charts and pie charts added group display, enabling only label values to be displayed in the legend
  • Honeycomb charts, China maps, and world maps added gradient intervals, including automatic and custom
  • Bar charts and histograms display optimization

For more details, refer to the Visualization Charts documentation.

View Variable User Experience Optimization

  • View variables now support multi-select
  • View variable configuration added the option to set multiple default values

For more details, refer to the View Variables documentation.

RUM Session Viewer Adjustment

In the RUM Session Viewer, added "Session" and "All Records" view lists:

  • Session: Statistics on deduplicated Session data within the current time range, displaying the latest Session data by default
  • All Records: Displays all reported Session data, where the same Session may correspond to multiple records

Note: In the Session list, adding display columns is supported. If a user adds a display column that does not exist in the current Session data, the Session list may contain empty data. For more details, refer to the Session documentation.

Events Added Mobile Redirect Option

After receiving an alert event notification, users can click "Go to Guance to view" to access the Guance mobile app and view detailed information about the abnormal event.

Other Functional Optimizations

  • New user guide page optimization, supports minimization
  • RUM application list optimization, added time widget custom interval switch query
  • Host Label addition interaction optimization

DataKit Updates

  • Added Python Profiling integration
  • Python added custom event reporting functionality
  • netstat supports specific port metric collection

  • Optimized Redis collector CPU usage collection, added new metric fields

  • Optimized logfwd collector configuration
  • Completed host object field collection, added network, disk, and related fields

For more DataKit updates, refer to DataKit Version History.

Intelligent Inspection Updates

  • Kubernetes Pod abnormal restart inspection
  • MySQL performance inspection
  • Server application error inspection
  • Memory leak inspection
  • Disk usage rate inspection
  • Application performance inspection
  • Frontend application log error inspection

For more intelligent inspection updates, refer to Intelligent Inspection Changelog.

Best Practices Updates

  • Monitoring
    • Application Performance Monitoring (APM) - Performance Optimization - Using async-profiler for Application Performance Tuning

For more best practices updates, refer to Best Practices Version History.

November 17, 2022

Guance Updates

Pipeline User Experience Optimization

  • Pipeline supports multi-select filter conditions

  • Supports setting any Pipeline script as the "default Pipeline script." If no other Pipeline script is matched for the current data type during Pipeline processing, the data will be processed according to the default Pipeline script rules.

  • Script function categorization

Event Optimization

  • Supports writing custom events. For more details, refer to the Writing Event Data via openAPI documentation.

  • Unresolved event viewer left side added quick filter

Custom Viewer Supports Selecting More Data Types

When creating a viewer in a scene, you can select from logs, APM, RUM, Security Inspection, and Profile data types. Once saved, it cannot be changed.

Member Management Added Member Grouping Function

Member management added a member grouping function. You can edit member groups, and a member can belong to multiple groups. When configuring alert policy notification targets, member group tags are supported.

Optimized Built-in View Binding Function

In the scene "Built-in Views" - "User Views," binding fields now support fuzzy matching. After binding fields, you can view the corresponding built-in views in the viewer.

Added One-Click Import/Export of Dashboards, Custom Viewers, and Monitors in Workspace

In "Management" - "Basic Settings," added one-click import/export of dashboards, custom viewers, monitors, and other JSON configurations in the workspace. You can import dashboards, custom viewers, monitors, etc., from other workspaces into the current workspace.

APM Log Page Added Custom Association Fields

In the APM details page, on the associated logs page, if you are an administrator or above, you can customize associated fields. Click the settings button next to the associated fields, select the fields to associate in the dialog box, support manual input, drag-and-drop order, and confirm to complete the configuration.

Other Functional Optimizations

  • When using fuzzy matching and fuzzy non-matching in filter conditions, left * matching is supported
  • Infrastructure analysis dimension optimization, in the host details page, the last reported time of the host
  • Supports quick login to the last single sign-on
  • Blacklisted APM added support for filtering "All Services"
  • Users registered in "China Region 4 (Guangzhou)" optimized the upgrade process to the commercial plan
  • Field descriptions support viewing in quick filters, display columns, etc.

DataKit Updates

  • Added SNMP Collector
  • Added IPMI Collector
  • Added batch injection of DDTrace-Java tool
  • Latest DDTrace-Java SDK enhanced SQL desensitization functionality
  • Remote Pipeline optimization
    • Pipeline supports source mapping configuration, facilitating batch configuration between Pipeline and data sources
    • Pipeline provides function categorization information, facilitating remote Pipeline writing
  • Optimized Kafka Message Subscription, no longer limited to SkyWalking-related data, supports rate limiting, multi-version coverage, sampling, and load balancing
  • Added extra configuration parameters (ENV_INPUT_CONTAINER_LOGGING_SEARCH_INTERVAL) to alleviate short lifecycle Pod log collection issues
  • In pure container environments, supports label-based configuration of container log collection
  • Added Pipeline functions
    • sample(): Sampling function
    • b64enc(): Base64 encoding function
    • b64dec(): Base64 decoding function
    • append(): List append function

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates

  • Insights

    • Guance Tips (Skills) - DataKit HTTPS Configuration
  • Monitoring

    • Application Performance Monitoring (APM) - ddtrace common parameter usage
    • Application Performance Monitoring (APM) - ddtrace-api usage guide
    • Application Performance Monitoring (APM) - ddtrace sampling
    • Application Performance Monitoring (APM) - ddtrace log association

For more best practices updates, refer to Best Practices Version History.

November 11, 2022

Guance Added "China Region 4 (Guangzhou)" Site

Guance supports multi-site registration and login, adding "China Region 4 (Guangzhou)" site, combined with existing "China Region 1 (Hangzhou)," "China Region 2 (Ningxia)," and "Overseas Region 1 (Oregon)," covering domestic and international regions, providing comprehensive data observability.

Note: Guance accounts and data across different sites are independent and cannot be shared or migrated. You can choose the appropriate site for registration and login based on resource usage. Currently, Guance supports the following four sites.

Site Login URL Operator Billing Method
China Region 1 (Hangzhou) https://auth.guance.com/ Alibaba Cloud Guance enterprise account, cloud account
China Region 2 (Ningxia) https://aws-auth.guance.com/ AWS Guance enterprise account, cloud account
Overseas Region 1 (Oregon) https://us1-auth.guance.com/ AWS Guance enterprise account, cloud account
China Region 4 (Guangzhou) https://cn4-auth.guance.com/ Huawei Cloud Guance enterprise account, Huawei Cloud prepaid card

November 3, 2022

Guance Updates

Added Guance and SLS Joint Solution

Guance added an SLS storage solution, enabling Alibaba Cloud SLS users to quickly use Guance for data viewing and analysis. When registering/upgrading to the commercial plan in Guance, after selecting "Alibaba Cloud Account Billing," you can choose the SLS storage solution to store data in your Alibaba Cloud account, achieving data exclusivity. For more details, refer to the SLS Storage documentation.

The joint solution of Guance and SLS supports synchronizing data from your Alibaba Cloud account to the Guance workspace for querying and analysis by binding log indexes. You can click "Bind Index" in the Guance workspace "Logs" - "Index" to synchronize log data from the index. For more details, refer to the Log Index documentation.

Optimized New User Guide Page

Guance added new user guide pages for scenarios, events, infrastructure, metrics, logs, APM, RUM, Synthetic Tests, Security Inspection, CI visualization, and monitoring modules. Additionally, the workspace welcome homepage was optimized to help you understand and use Guance more easily through the new user guide.

Added 3 Intelligent Inspection Configuration Documents

  • Cloud Account Bill Inspection: Helps users manage cloud service budget alerts, abnormal cost alerts, predict expenses, and provide visualization capabilities, supporting multi-dimensional visualization of cloud service resource consumption
  • Frontend Application Log Error Inspection: Helps discover new error messages (clustered Error Message) in the past hour, helping developers and operations fix code promptly to avoid continuous customer experience impact over time
  • Alibaba Cloud Asset Inspection: Helps users gain more insights into cloud vendor product performance status

In APM, added an error tracking viewer to help you quickly view similar errors in the link and their distribution, quickly locating performance issues. For more details, refer to the Link Tracing documentation.

Optimized Time Series Chart and Overview Chart YoY Comparison Function

YoY comparison no longer links with locked time. The button is displayed by default and is turned off. After enabling YoY comparison, the comparison dimensions support 4 options: Hour (compared to one hour ago), Day (compared to one day ago), Week (compared to one week ago), Month (compared to one month ago). For more details, refer to the YoY Comparison documentation.

Other Functional Optimizations

  • Dashboards/notes/viewers added "Save Snapshot" button in "Settings"
  • Time widget added more options

  • Pipeline and blacklist functions added import, batch export, batch delete functions

  • Intelligent inspection added dashboard, bar chart components
  • Integration menu Func page optimization

DataKit Updates

  • Improved Prometheus ecosystem compatibility, added ServiceMonitor and PodMonitor collection recognition
  • Added Java Profiling integration based on async-profiler

  • eBPF collection added interval parameter, facilitating adjustment of collected data volume

  • All remote collectors default to their collection address as the host field value, avoiding potential host field value misinterpretation during remote collection
  • DDTrace collected APM data automatically extracts error-related fields, facilitating better APM error tracking
  • MySQL collector added additional fields Com_commit/Com_rollback collection

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates

  • Monitoring

    • Application Performance Monitoring (APM) - Kafka Observability Best Practices
  • Cloud Platform Integration

    • Alibaba Cloud - Alibaba Cloud ACK Integration with Guance

For more best practices updates, refer to Best Practices Version History.

October 20, 2022

Guance Updates

Monitoring Optimization

Added Outlier Detection

Outlier detection is an algorithm that detects whether the metrics/statistics of detection objects under specific groups have outlier deviations. If inconsistencies exceeding a certain level are detected, outlier detection abnormal events are generated for subsequent alert tracking. For more details, refer to the Outlier Detection documentation.

Mutation Detection Logic Optimization

The new mutation detection compares the absolute or relative (%) changes of the same metric in two different time periods to determine if an abnormal situation has occurred. It is commonly used to track peak values or data changes of a metric, generating events more accurately when anomalies occur. For more details, refer to the Mutation Detection documentation.

Range Detection Logic Optimization

The new range detection performs anomaly detection on metric data within the selected detection range. When the percentage of abnormal data points exceeds the set threshold, range detection abnormal events are generated. It is commonly used to monitor stable trend data/metrics. For more details, refer to the Range Detection documentation.

Other Optimizations
  • Adjusted read-only member permissions to support viewing monitor, intelligent inspection, SLO, mute management, and alert policy configuration content
  • Data gap configuration selection "Trigger data gap events" and "Trigger recovery events" adjusted to time range configuration, supporting manual input

  • Supports configuring monitor detection based on "event" data

  • Alert configuration added "Info" event notification level selection

Scene Chart Optimization

Added Histogram Chart Component

Histogram, also known as mass distribution chart, is used to represent data distribution, a common statistical chart. Generally, the horizontal axis represents data intervals, and the vertical axis represents distribution. For more details, refer to the Histogram documentation.

Chart Function Optimization
  • Overview chart, treemap, funnel chart added time slice function
  • Time series chart "View similar trend metrics" adjusted from supporting only metric queries to supporting all data types, including logs, APM, RUM, etc.
  • Leaderboard supports viewing all content beyond chart width
  • Honeycomb chart display optimization

Viewer Optimization

Viewer Supports Analysis Mode

Added "Analysis" function in logs, APM, RUM, Synthetic Tests, Security Inspection, CI viewers. Infrastructure adjusted "Group" to "Analysis," supporting multi-dimensional analysis statistics based on 1-3 tags, reflecting data distribution characteristics and trends under different dimensions over time. In analysis mode, supports various data chart analysis, including time series chart, leaderboard, pie chart, and treemap. For more details, refer to the Viewer Analysis Mode documentation.

Optimized Associated Log Viewing Experience

In infrastructure, APM, RUM, CI visualization viewer details pages, optimized associated log viewing experience, defaulting to display log content according to the "Maximum Display Rows" and "Display Columns" set in the log viewer, supporting custom adjustments through "Display Columns."

Log Index Optimization

In "Logs" - "Index," after setting the index, log-related queries added index options, defaulting to index default. You can query and analyze log data based on the index you set, involving functions including log viewer, scene custom viewer, chart log query, log monitor, etc. For more details, refer to the Log Index documentation.

Optimized Metric Analysis Chart Query

Added time interval and legend options in metric analysis, adjusted legend aggregation function display order. For more details, refer to Metric Analysis.

Other Functional Optimizations

  • In RUM application list, click into the application, added dropdown menu options in the top left corner, helping users quickly switch and view different application data
  • In metrics, RUM, APM, infrastructure, security inspection directories added Pipelines shortcut

DataKit Updates

  • DataKit collector configuration and Pipeline support synchronization via etcd/Consul and other configuration centers
  • Prometheus Remote Write optimization
    • Collection supports tag filtering via regex
    • Supports metric set name filtering via regex
  • Pipeline optimization
    • Optimized grok() and other functions, enabling their use in if/else statements to determine if operations are effective
    • Added match() function
    • Added cidr() function
  • Process collector added open file list details field
  • Improved external access class data (T/R/L) disk caching and queue processing
  • Monitor added usage overrun prompt: at the bottom of the monitor, if the current space usage exceeds the limit, red text Beyond Usage will prompt
  • Optimized log collection position function, in container environments, the file will be mounted to the host to avoid losing original position records after DataKit restart
  • Optimized sparse log scenario collection delay issue

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates

  • Monitoring

    • Infrastructure Monitoring (ITIM) - Ansible Batch Processing Practice.
  • Cloud Native

    • Logs - Guance Collecting Amazon ECS Logs.

For more best practices updates, refer to Best Practices Version History.

September 29, 2022

Guance Updates

Added Field Management

Guance supports unified management of field data in the current workspace, including system fields and custom fields. You can view field descriptions in scene chart queries, monitor detection metrics, DQL query simple query mode, etc., helping you quickly understand field meanings and apply fields. The figure below shows viewing the host field description in a scene chart query. For more details, refer to the Field Management documentation.

Optimized Metrics Function

Metrics Viewer Transformation

The original "Metrics Viewer" is renamed to "Metric Analysis," supporting users to visualize query data in time series chart mode (line chart, area chart, bar chart). For more details, refer to Metric Analysis.

Optimized Metric Management
  • Supports searching for "Metric Sets" and "Metrics" in "Metric Management"

  • Supports modifying metric "Unit" and "Description" in "Metric Management"

  • Supports viewing tag description information in "Metric Management"

For more details, refer to Metric Management.

Added Export Event Content in PDF Format

In the event details page, the Jump to Monitor button added text description. Click button, you can choose Export JSON File and Export PDF File to get all key data corresponding to the current event.

Monitor Adjustment

  • Monitor name does not support customization, event title input synchronously generates monitor name
  • Monitor supports "info" event generation logic. Trigger conditions can choose to enable or disable info: normal detection results also generate events
  • Monitor configuration step order adjusted to: detection configuration-event notification-association

Note: In the latest version, "Monitor Name" will be synchronously generated after "Event Title" input. Old monitors may have inconsistent "Monitor Name" and "Event Title." For a better user experience, please synchronize to the latest version as soon as possible, supporting one-click replacement of event titles.

Mute Rules Support Dynamic Configuration

In mute management, optimized mute scope, supporting monitors, intelligent inspection, self-built inspection, SLO, alert policies, and other options, added tag options.

Note: Mute scope is mandatory, tags are optional. Mute only takes effect when both "Mute Scope" and "Tags" conditions are met. For example, if mute scope selects APM and Disk Usage Rate, and tags select: host:izbp152ke14timzud0du15z, when conditions meet both APM andhost:izbp152ke14timzud0du15z or both Disk Usage Rate andhost:izbp152ke14timzud0du15z, the alert notification is muted and will not be sent to the alert notification targets.

Optimized Pipeline Configuration Page

In text processing (Pipeline), supports adding multiple sample parsing tests, fixes one-click sample acquisition error for metric data. For more details, refer to Text Processing (Pipeline).

Other Functional Optimizations

  • Notes added global lock time configuration. After configuring global lock time, all charts in the note page display data according to the lock time
  • Unresolved event query changed to the last 48 hours of data, supports manual refresh
  • RUM supports same user view override logic
  • RUM Web, WeChat Mini Program, and uniapp development framework mini program initialization parameters added isIntakeUrl configuration, used to determine whether to collect corresponding resource data based on the request resource URL, defaulting to collect all
  • Intelligent inspection added support for self-built inspection
  • Generate metric page operation column adjustment, added "Open in Metric Analysis" and "Open in Metric Management" operation icons
  • Management navigation menu position adjustment, SSO management migrated to member management, notification target management migrated to monitoring, built-in views migrated to scenes

Best Practices Updates

  • Cloud Native: Multiple Kubernetes Clusters Metric Collection Best Practices.

For more best practices updates, refer to Best Practices Version History.

September 15, 2022

Guance Updates

Added Log Viewer DQL Search Mode

In the log viewer, you can click the toggle icon in the search bar to switch to DQL manual input query mode, supporting custom input filter conditions and search conditions.

  • Filter conditions: Supports and / or any combination, supports using () parentheses to indicate search execution priority, supports =, != and other operators
  • Search conditions: Supports searching logs via DQL function query_string()

For more details, refer to the DQL Search documentation.

Optimized APM

  • Optimized details page layout display, added duration, http method, http url, http status code, TraceId, etc.
  • Flame chart added thumbnail, double-click Span to zoom in, click service name to highlight corresponding Span
  • Span list added search, click select Span to switch to flame chart synchronized display
  • Service call relationship added search

For more details, refer to the Link Viewer documentation.

Profile Viewer Details Page Optimization

In the Profile viewer details page, added quick operations, including search, copy, and click select view method. For more details, refer to the Quick Operation Instructions documentation.

Optimized Monitor Event Notification Content Edit Mode

When creating a monitor, the event notification content sent when trigger conditions are met supports input and preview markdown format text information, supports using template variables.

Added Mute Management Supports Periodic Mute Configuration

Mute management added periodic mute function, in mute time, you can choose "Only Once," "Repeat." For more details, refer to Mute Management.

Other Functional Optimizations

  • Scene dashboard group display optimization, scene notes optimized text component Markdown format
  • Infrastructure viewer display optimization, added display column CPU usage rate, MEM usage rate, etc. prompt information; "Pods," "Deployments," "Services" viewer details page added view and copy corresponding YAML file
  • Metric viewer deleted list view mode, retained flat view mode and mixed view mode

  • Log multi-index supports jump view

  • Viewer quick filter value TOP 5 supports viewing proportion count, viewer time field format optimization, default display format is 2022/09/15 20:53:40
  • Link viewer time series chart added legend display, quick filter added HTTP related fields

DataKit Updates

  • Added automatic cloud synchronization function, no longer need to manually specify cloud vendor
  • Supports synchronizing k8s label as tag to pod metrics and logs
  • Supports collecting various yaml information in k8s to corresponding object data
  • Trace collection supports automatically extracting some key meta information
  • Supports specifying installation source address during installation, simplifying offline installation process
  • Pipeline new functions:
    • Added for loop/dictionary/array support
    • Added arithmetic expression support
    • Pipeline error information will be displayed on collected data
    • If time field cutting error, supports automatically correcting time field(time), to avoid time unable to display on console page
    • Added len() function

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates

  • Monitoring- Middleware (Middleware) - Insights MySQL.

For more best practices updates, refer to Best Practices Version History.

September 1, 2022

Guance Updates

Billing Updates

Guance billing item backup logs adjusted billing rules, adjusted backup logs to 0.007 yuan per 1 GB data/day. You can adjust corresponding data retention policies according to actual needs to save cost. For more details, refer to the Billing Methods documentation.

Help Documentation Directory Updates

  • Split changelog directory, supports viewing Guance updates by year
  • Added custom development directory, can view custom collector (Pythond), custom security inspection (Scheck), custom DDtrace, etc. documents
  • Added private deployment directory, can view Guance deployment related documents

Time Series Chart Added Event Correlation Analysis

Time series chart added event correlation analysis, supports matching abnormal events related to selected fields through "Add Filter Field," achieving time series data and event correlation display, helping users perceive whether related events occurred during data fluctuations while viewing trends, to locate issues.

  • After configuring event correlation in time series chart, on the time axis, if there are event records related to the selected correlation field (e.g., "host:DESKTOP-NEN89U3"), they will be marked with shaded blocks
  • After configuring event correlation in time series chart, in analysis mode, click highlighted shaded blocks to view abnormal events related to the selected field (e.g., "host:DESKTOP-NEN89U3")

For more details, refer to the Time Series Chart documentation.

Logs Added Multi-Index Mode

Guance supports setting log multi-index, saving logs meeting conditions in different log indexes, and selecting different data retention policies for log indexes, helping users save log data storage costs. For more details, refer to the Log Index documentation.

Optimized Backup Log Rules

Backup log new rule migrated to log index menu, backup cycle changed from backing up previous day's logs at 0:00 daily to executing rule verification and backup every 5 minutes, i.e., backup logs can be viewed at most 5 minutes after configuring backup rules. For more details, refer to the Backup Logs documentation.

Optimized Log Context

When viewing context in the log details page, opening a new log viewer will use "host," "source," "service," "filename" as filter conditions, viewing data before and after the current log time.

Optimized RUM

Added Custom RUM Application ID

RUM supports users to customize application ID as the unique identifier of the current workspace (original Guance application ID is globally unique, i.e., application IDs in different spaces cannot be repeated), different workspaces can use the same application ID as the unique identifier of the same application, used for SDK data upload matching. For more details, refer to:

  • Web Application Integration

  • Android Application Integration

  • iOS Application Integration

  • Mini Program Application Integration

RUM supports users to view network (network) error related links in the RUM viewer.

Intelligent Inspection Comprehensive Upgrade

  • Intelligent inspection list adjusted "Group" to "Alert Policy," supports selecting alert policies for intelligent inspection when editing
  • Intelligent inspection related event details page comprehensive adjustment, including details page related pages, such as basic attributes, event details, root cause analysis, alert notification, history records, related events, etc.; optimized abnormal chart analysis, added data correlation jump links, abnormal interval prompts, root cause analysis interval prompts, legend display operations, etc.

For more details, refer to Intelligent Inspection.

Optimized Monitoring

Adjusted Group to Alert Policy

In "Monitoring," adjusted "Group Management" page to "Alert Policy Management," creating alert policies to filter monitors and set alert notifications.

In Monitor, original "Group" filter adjusted to "Alert Policy" filter, supports selecting alert policies when configuring monitors, supports clicking monitor alert policies to modify alert settings.

Optimized Monitor Configuration
  • Adjusted monitor configuration process steps, including detection frequency, detection interval, alert policy, etc.

  • Optimized detection metrics, supports configuring outer functions (fx), including "Label Filter," "Conversion Function," "Data Gap Fill"; supports switching to DQL query mode

  • Optimized trigger condition text prompts

  • Optimized event notification, removed part of monitor custom data gap event titles and content; adjusted template variable prompt text; adjusted group to alert policy, and supports editing alert policy

  • Optimized log detection, APM metrics detection, RUM metrics detection "Detection Metrics" configuration

For more details, refer to Monitor Management.

Added "Infrastructure Survival Detection"

"Infrastructure Survival Detection" is used to monitor the running status of infrastructure. For more details, refer to Infrastructure Survival Detection.

Added "Process Abnormal Detection"

"Process Abnormal Detection" is used to monitor process data in the workspace, supports setting alerts for one or more field types of process data. For more details, refer to Process Abnormal Detection.

Note: Infrastructure object detection has been removed, existing related monitors can continue to use, but no longer supports creating new ones.

Optimized "APM Metrics Detection"

"APM Metrics Detection" added "Link Statistics" detection method, counting the number of links meeting conditions within a specified time, triggering abnormal events when exceeding custom thresholds. Can be used for service link abnormal error notifications. For more details, refer to APM Metrics Detection

Optimized Member Management

  • Read-only members no longer support viewing member management page
  • Supports filtering regular members and SSO members, SSO members only display members corresponding to the currently configured identity provider (IDP)

For more details, refer to Member Management.

Added DEMO Workspace

Guance provides workspace Demo to help you better use Guance various functional modules. You can click "Workspace" in the top left corner, click "Experience Demo Space" in the pop-up dialog box, to enter the Demo space for viewing.

Other Functional Optimizations

  • Chart metric aggregation function changed from default last to avg, log data aggregation function changed from default last to count
  • Optimized time series chart, pie chart legend copy experience
  • Optimized note edit mode interaction display
  • Snapshot supports saving current viewer display column information
  • Link details page formatted display for time fields, converting timestamps to date format display
  • Deployment version management backend supports modifying workspace data retention policy

DataKit Updates

Breaking changes

  • Gitlab and Jenkins collectors, CI/CD data related time fields adjusted, to unify front-end page data display effect

Collector Function Adjustment

  • Optimized IO module data processing, improving data throughput efficiency
  • Added disk cache function on various Trace
  • DataKit own metric set added goroutine usage related metric set (datakit_goroutine)
  • MySQL collector added mysql_dbm_activity metric set
  • Added netstat collector
  • TDengine added log collection
  • Optimized disk collector fstype filter, default only collects common file systems
  • Log collector, for each log, added field message_length representing current log length, facilitating filtering logs by length
  • CRD supports locating Pod range via DaemonSet
  • eBPF removed go-bindata dependency
  • Container collector default opens k8s and container related metrics, this will consume additional time series to some extent

Bug Fixes

  • Fixed DataKit own CPU usage calculation error
  • Fixed SkyWalking middleware recognition issue
  • Fixed Oracle exit issue
  • Fixed Sink DataWay failure issue
  • Fixed HTTP /v1/write/:category interface JSON write issue

Document Adjustment

  • Almost every chapter added jump labels, facilitating permanent references from other documents
  • pythond document moved to custom development directory
  • Collector documents migrated from original "Integration" to "DataKit" document library
  • DataKit document directory structure adjustment, reduced directory levels
  • Almost every collector added k8s configuration entry
  • Adjusted document header display, in addition to operating system identifier, added election identifier for collectors supporting election

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates

  • Cloud Native

    • Using CRD to Start Your Ingress Observability Journey
  • Monitoring

    • Application Performance Monitoring (APM) - DDtrace Custom Instrumentation
    • Application Performance Monitoring (APM) - DDtrace Guance Secondary Development Practice

For more best practices updates, refer to Best Practices Version History.

August 18, 2022

Guance Updates

Guance Billing Updates

Guance billing items APM, RUM, logs added data retention policies and corresponding unit prices, log data added 7-day data retention policy, APM and RUM added 3-day data retention policy, you can adjust corresponding data retention policies according to actual needs to save cost. For more details, refer to the Billing Methods documentation.

Optimized Viewer

Added Filter History

Guance added viewer filter history function, supports current user saving viewer key:value search condition history locally in the browser, in the current workspace, you can use history search conditions directly in different viewers, helping avoid repeated filter condition configuration.

  • Open filter history: Supports clicking the expand icon in the lower right corner of the viewer, or directly using shortcut keys ( Mac OS: shift+cmd+k / Windows: shift+ctrl+k ) to quickly open filter history
  • Close filter history: Click close button x or use esc key to close filter history

For more details, refer to the Filter History Instructions documentation.

Added Quick Filter Value Sorting

In viewer quick filter, added support for field value sorting by percentage, click the "Settings" button in the upper right corner of the quick filter item, select "Query Value TOP 5," to view the top five field attribute value statistics percentage. On the right side of the leaderboard, supports clicking "Positive Filter," "Reverse Filter" buttons, to filter query data in key:value form for current ranking field attribute values. More viewer quick filter details refer to Quick Filter Instructions documentation.

Added Time Widget Input Format Hint Page

In viewer time widget, added time widget input format hint page, optimized time widget text input box, supports and hints box real-time linkage, helping users quickly understand time widget supported input format types. More viewer time widget details refer to Time Widget Instructions documentation.

Added Display Column Field Separator Line and Text Prompt

In viewer adding display columns, added field separator line and its add text prompt. When inputting fields in display columns, preset fields are distinguished from existing fields by the separator line, and prompt text "Create and Add," supports selecting add display columns through keyboard up and down arrow keys (↑ ↓ ); more viewer display columns refer to Display Column Instructions documentation.

Added Scene Dashboard/Note/Viewer View Permissions.

In scene new Dashboard, Note, Viewer, supports creator custom view permissions, to prevent creator's own dashboard from being mistakenly moved, or prematurely publishing incomplete or inconvenient to publish dashboard / note / viewer. Permission settings include "Public" and "Only Visible to Self."

  • Public: Open to all members in the current workspace, other members' view and edit permissions are not affected
  • Only Visible to Self: Only the creator is visible, other members do not have view permissions

Note: When accessing non-public dashboard/note/viewer through links, non-creators are not visible, prompt user no permission to view.

Added Snapshot View Permissions

In scene or viewer saving snapshot, supports custom view permissions, permission settings include "Public" and "Only Visible to Self."

  • Public: Indicates users in the current workspace can view saved snapshots
  • Only Visible to Self: Indicates except the current user, other users cannot view saved snapshots

In viewer saving snapshot, supports viewing history snapshot time range, filter conditions, time range is divided into "Absolute Time," "Relative Time" and "Default" three types according to the selection when saving snapshot. More snapshot usage details refer to Snapshot documentation.

Optimized Monitors and Events

Added Monitor Test

Monitor added manually trigger monitor detection. If the current detection rule triggers, you can view related details in the event viewer.

Optimized Intelligent Inspection Information Display

Intelligent inspection list added "Data Range," "Detection Frequency," "Group," "Last Trigger Time," "Trigger Status." Operations added "Export JSON Configuration," export file name format: intelligent inspection name.json.

Intelligent inspection event details page added "Basic Attributes," "History Records," "Related Events" and other common pages.

Optimized Event Details Page

In event details page, optimized "Basic Attributes" page; "Copy Current Event Content" adjusted to "Export Event JSON" button, meanwhile added "View Monitor Configuration" button on the left, supports one-click jump to the current event's monitor configuration page, facilitating real-time adjustment of monitor rules.

If monitor configured alert, related event details page added "Alert Notification" page. If monitor set alert mute, during alert mute period, the same alert event will not be sent to notification targets, in event details page "Alert Notification" page, the alert notification is marked as "Notification Not Sent."

Other Functional Optimizations

  • Guance added support for email verification method authentication
  • Viewer details page associated network page optimized host, Pod, Deployment type display
  • Dashboard and built-in views and other places adding charts added switch icon, adjusted view variable edit button position
  • Time series chart legend value added sum summation statistics, meanwhile optimized legend display and interaction
  • Monitor, chart query log data filter conditions added wildcard and not wildcard

DataKit Updates

New Features

  • Pipeline added reftable function
  • DataKit 9529 HTTP supports binding to domain socket
    • Corresponding eBPF collection and Oracle collection, their configuration methods also need corresponding changes.
  • RUM sourcemap added Android R8 support
  • CRD added log configuration support
    • Complete example

Optimizations

  • Optimized container collector documentation
  • Added Common Tag documentation
  • Optimized election configuration and some related naming
  • Election collectors still support turning off election function on specific collectors when DataKit election is enabled
  • Supports specifying data type io block configuration
  • DDTrace collector sampling added meta information recognition
  • DataKit own metric set added 9529 HTTP request related metrics
  • Optimized Zipkin collection memory usage
  • DDTrace collector becomes blocking IO feed by default after enabling disk cache
  • eBPF added process name (process_name) field
  • DCA new version released
  • Log class HTTP data writing (logstreaming/Jaeger/OpenTelemetry/Zipkin) all added queue support
  • Log collection added automatic multi-line support

Bug Fixes

  • Fixed MySQL collector connection leak issue
  • Fixed Pipeline Json value issue
  • Fixed macOS ulimit setting invalid issue
  • Fixed sinker-Dataway invalid in Kubernetes issue
  • Fixed HTTP data writing class interface data verification issue
  • Fixed eBPF collector structure offset calculation failure issue after kernel change
  • Fixed DDTrace close-resource issue

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates

  • Monitoring

    • Using extract + TextMapAdapter to implement custom traceId
  • Insights

    • Scene - Intranet Scene Dubbo Microservice Integration with Guance

For more best practices updates, refer to Best Practices Version History.

August 4, 2022

Guance Updates

DCA Web Version Online

Guance added DataKit web version management tool DCA, aiming to facilitate management of installed and configured collectors, supports viewing collector running status, collector configuration management, Pipeline management, blacklist management and collector document help and other functions. For more details, refer to DCA documentation.

Optimized Viewer Search, Quick Filter, Time Widget, Display Columns

  • In viewer search bar, added "Exist," "Not Exist" filter logic, by judging whether the filter field exists to return search results
  • In viewer search bar, added number type operation methods, supports including equal, greater than or equal, less than or equal, greater than, less than, not equal and other operators
  • Added field data type prompt, matching mode description

More viewer search details refer to Search Instructions documentation.

Quick Filter
  • In quick filter items, added tag field search function, when quick filter items exceed 10 tag fields, supports fuzzy search by "Field Name" or "Display Name"
  • In quick filter items added "Settings" button, supports adding / removing display columns
  • In quick filter items added "Settings" button, custom added personal level filter item fields support editing display name and deleting fields

More viewer quick filter details refer to Quick Filter Instructions documentation.

Time Widget
  • Added interval display, supports clicking time widget display box manually input time range, including "Interval Range," "Timestamp Range" and "Standard Time Format"
  • Dropdown list added custom options, custom range supports hour:minute:second format input
  • Added last 20 history absolute time records view

More viewer time widget details refer to Time Widget Instructions documentation.

Display Columns

In viewer list, when mouse hovers on display columns, added "Settings" button, supports ascending, descending, move column left, move column right, add column left, add column right, replace column, add to quick filter, add to group, remove column and other operations for display columns. More viewer display columns refer to Display Column Instructions documentation.

Optimized Viewer Details Page

  • Adjusted extended field quick filter "Filter Field Value," "Reverse Filter Field Value," "Add to Display Columns" and "Copy" and other operation positions
  • Supports switching up and down log details through keyboard up and down arrow keys (↑ ↓)
  • Supports directly closing details page popup through keyboard esc button
  • Added "View Context" function: in log details page view context opening new log viewer, will use "host," "source," "service," "filename" as filter conditions, using current log time as start time, current log time + 30 minutes as end time to bring to time widget for context log filter. More details refer to View Context documentation.

Added Global Viewer Auto Refresh Configuration

In Guance workspace, click "Account," can enable / disable "Viewer Auto Refresh."

  • Enable: Viewer data according to time widget default data refresh time 30 seconds for auto refresh, such as selecting last 15 minutes, according to 30 seconds refresh once display last 15 minutes data
  • Disable: Viewer time widget enters closed 30 seconds auto refresh, such as selecting last 15 minutes, display the 15 minutes absolute time content data and no longer auto refresh, can click "Play" button refresh view last 15 minutes data

Note: Viewer auto refresh only takes effect locally in the browser. More viewer time widget details refer to Time Widget Instructions documentation.

Added Global Blacklist Function

Guance supports filtering data meeting conditions of different types by setting blacklist, i.e., after configuring blacklist, data meeting conditions will no longer be reported to Guance workspace, helping you save data storage costs. Global blacklist function currently supports filtering data types including logs, basic objects, resource catalog, network, APM, RUM, security inspection, events, metrics, Profile. For more details, refer to Blacklist documentation.

Added Custom Function Menu

Guance supports manually setting function menu, including hide/display and adjusting menu order, helping you customize current workspace menu display. In Guance workspace, click account in the lower left corner, select "Function Menu Management," to adjust the menu. For more details, refer to Function Menu Management documentation.

Added Chart Query Alias

In scene visualization charts, added chart query alias, after adding alias, chart legend name also changes accordingly, facilitating more intuitive differentiation of related metrics. Currently supported charts include time series chart, pie chart, bar chart, scatter chart, bubble chart, funnel chart.

Added Time Series Chart, Pie Chart Legend Style

In scene visualization charts, pie chart added support including bottom, right, surround, hide legend styles, time series chart supports including bottom, right and hide legend styles, in default state hide legend style.

Optimized Object History Data Retention Policy

Guance stores 48 hours history data for all objects (host, container, pod) reported to the workspace, facilitating users to trace back object data performance at a certain moment in the past two days. When viewing a log, link, security inspection data, you can view the corresponding object situation at that moment in the "Attribute View" of the associated host, container, Pod.

Adjusted Save Snapshot Position

Viewer top navigation bar removed "Save Snapshot" button, uniformly migrated to "History Snapshot," scene dashboard and note can create snapshots through shortcut keys. For more details, refer to Snapshot documentation.

Other Functional Optimizations

  • Time series chart time interval added to millisecond level
  • Management backend added workspace level index configuration adjustment entry
  • Log viewer distribution chart added support custom select time interval
  • RUM viewer page added current data extended field page display

DataKit Updates

  • Part of data type sending failure, supports caching to disk, sending later
  • Supports sending data meeting conditions to different workspaces through different dataway addresses
  • Sourcemap added Android and iOS support
  • Container collector related updates:
    • Fixed Kubernetes Node host operating system information collection error
    • Kubernetes Prom collection no longer automatically appends pod related information, avoiding time series explosion
    • Pod object appended corresponding yaml information
  • Pipeline related updates:
    • Optimized Pipeline execution steps
    • grok() and json() functions default execute trim-space operation
  • DDTrace related updates:
    • Fixed potential goroutine leak issue
    • Supports configuring disk cache to alleviate memory usage issue
  • Other Bug Fixes:
    • Optimized line protocol construction
    • Log collection, removed periodic clean tail data function, to alleviate possible log truncation issue

For more DataKit updates, refer to DataKit Version History.

July 21, 2022

Guance Updates

Added Intelligent Inspection Function

Intelligent inspection based on Guance intelligent detection algorithm, supports automatically detecting infrastructure and application problems, helping users discover IT system operation problems, through root cause analysis, quickly locate abnormal problem causes; through Guance intelligent prediction algorithm, helping users foresee infrastructure and application potential problems in advance, evaluate problem impact level on system operation, better determine troubleshooting work priority, reduce troubleshooting process uncertainty.

Intelligent inspection currently supports three inspection templates:

  • Memory Leak: Detect current workspace host memory leak problem
  • Disk Usage Rate: Detect current workspace host disk usage rate too high problem
  • Application Performance Detection: Detect current workspace service QPS, average response time, P90 response time and error rate fluctuation changes

Optimized Viewer Search and Filter Function

  1. Viewer search added "not wildcard reverse fuzzy matching," i.e., not matching fuzzy query results.

  1. Viewer quick filter added workspace level and personal level filter methods

  2. Workspace level filter items: Configured by administrator/owner, click "Settings" button next to quick filter, to configure workspace level filter items

  3. Personal level filter items: All members can configure quick filter items based on local browser, click "Edit" on the right side of quick filter, to configure personal level filter items

For more details, refer to Viewer Search and Filter documentation.

Added Modify URL Time Range for Data Query

Guance supports directly modifying the time parameter time range in the browser URL for current workspace viewer/dashboard data query, supports second, minute, hour, day 4 units, such as time=30s, time=20m, time=6h, time=2d, etc., as shown below modifying time=2h in the browser, viewer displays last 2 hours data. For more details, refer to URL Time Range documentation.

Added Dashboard View Variable Logs, APM, RUM, Security Inspection Data Source Configuration

Dashboard view variable added "Logs," "APM," "RUM," "Security Inspection" data source configuration, meanwhile optimized dashboard new and edit view variable interaction.

  • In dashboard without added view variables, top navigation bar added "Add View Variable" button, click to add view variable
  • If dashboard already added view variables, top navigation bar below directly displays view variable name, click "Edit" button on the right, to enter view variable edit page

For more details, refer to View Variable documentation.

Optimized Chart Query Interaction

  • Click "Separator Bar" between chart and query to drag up and down
  • Click "Drag" button on the left of query statement, drag up and down to adjust query order
  • Scroll bar only acts on query statement area, not affecting chart

Added RUM Metrics Detection Event Notification Template Variables

In "RUM Metrics Detection" monitor configuring notification events, besides general template variables, additionally supports the following template variables. For more details, refer to Event Title, Content Template documentation.

Template Variable Type Description
app_id String Application ID
app_name String Application Name
app_type String Application Type

Configuring monitor, adding link in event content, when event triggers, in event details page "Event Content," click link to open new page jump page.

DataKit Updates

  • prom collector built-in timeout duration is 3 seconds
  • Log related issue fixes:
    • Added log collection log_read_offset field
    • Fixed log file rotate not correctly readAll bug
  • Container collection related issue fixes:
    • Fixed environment variable NODE_NAME incompatibility issue
    • k8s auto discovered prom collector changed to serial, node scattered collection
    • Added log source and multi-line mapping configuration
    • Fixed container log replace source still using previous multiline and pipeline bug
    • Corrected container log, set file active duration is 12 hours
    • Optimized docker container log image field
    • Optimized k8s pod object host field
    • Fixed container metrics and object collection not adding host tag issue
  • eBPF related:
    • Fixed uprobe event name naming conflict issue
    • Added more environment variable configuration, facilitating cloud k8s environment deployment
  • Optimized APM data receiving interface data processing, alleviating client stuck and memory usage issue
  • SQLServer collector fixes:
    • Restored TLS1.0 support
    • Supports instance collection filtering, to reduce time series consumption
  • Pipeline function adjust_timezone() adjusted
  • IO module optimization, improving overall data processing capability, maintaining relatively controllable memory consumption
  • Monitor updates:
    • Fixed Monitor possible long time stuck when busy
    • Optimized Monitor display, added IO module information display, facilitating user adjust IO module parameters
  • Fixed Redis crash issue
  • Removed part of redundant redundant logs
  • Fixed election collector not appending host tag issue in non-election mode

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates

  • Cloud Platform Integration
    • Rancher Deployment DataKit Best Practices
    • Tencent Cloud Product Observability Best Practices (Function)

For more best practices updates, refer to Best Practices Version History.

July 7, 2022

Guance Updates

Optimized Viewer Positive Selection, Reverse Selection, Fuzzy Matching Three Filter Modes

Guance viewer supports exact filter, fuzzy filter (wildcard) and reverse selection according to "field:value" method, supports editing and modifying the filtered "field:value". For more details, refer to Viewer Search and Filter documentation.

Optimized Viewer Quick Filter

In Guance viewer quick filter, default select all, supports "positive selection," "reverse selection," "reset," "All" and "only" multiple filters, if search box includes both positive selection and reverse selection, corresponding quick filter tags gray out cannot select. For more details, refer to Quick Filter documentation.

Added Viewer Display Columns Multiple Quick Operations

In Guance viewer, through "Display Columns," you can add, remove display columns to viewer list.

  • When mouse hovers on added display columns, supports ascending, descending, move column left, move column right, remove column and other operations for added display columns.
  • If display column content display incomplete, supports double clicking display column right separator line "Double Click Separator Line," to expand the column content.

Optimized Viewer Details Page Attribute/Field Quick Filter

In viewer details page, when mouse clicks attribute fields such as "host," "source," supports "positive filter," "reverse filter," "add to display columns" and "copy" for quick filter view; in log viewer details page, when mouse selects extended fields, displays "copy," "positive filter," "reverse filter" and "add to display columns" icons for quick filter view.

  • "Copy," i.e., copy the field to clipboard
  • "Positive Filter," i.e., add the field to viewer, view all data related to the field
  • "Reverse Filter," i.e., add the field to viewer, view other data except the field
  • "Add to Display Columns," i.e., add the field to viewer list for view

Optimized History Snapshot Function, Supports Three Time Save Policies

In metrics, logs, events, APM, RUM, cloud dial testing, security inspection, CI visualization and other viewers, you can click "Save Snapshot" to save current viewer displayed data content, supports selecting enabling/disabling "Time Filter."

  • Snapshot enabling time filter, save according to current page selected time, shared link does not support switching time widget
  • Snapshot enabling time filter, and enabling lock absolute time, convert current page selected time range to "absolute time" for save
  • Snapshot disabling time filter, follow system default time, shared snapshot can switch time widget

Snapshot saved, can view in viewer history snapshot list, select and open history snapshot, click "Return Viewer" in the upper right corner to return to default viewer.

Added Pipeline One-Click Get Sample Test Data

In new or edit Pipeline, added "One-Click Get" button on the right of sample parsing test, facilitating you get data for cutting debugging.

  • Log data: Returns message data
  • Other data types: Returns line protocol format data

For more details, refer to Text Processing Pipeline documentation.

Added Scene Custom Viewer Text Analysis Mode

In scene custom viewer, edit viewer, in custom configuration display columns, supports selecting "Approximate Text Analysis" viewer field, default uses message field corresponding content for approximate text analysis. For more details, refer to Scene Custom Viewer documentation.

Added Log Viewer Details Page Associated Network Pod and Deployment View

Guance supports in log viewer details page "Network," selecting view host, Pod and Deployment view data connection situation.

Note: In log details view related network, need to match corresponding fields.

Added Viewer Details Page Associated Network 48 Hours Data Replay Function

In log, process, link, host, Pod viewer details page associated network, supports clicking time widget selecting replay 48 hours network data.

  • Time range: Default view before and after 30 minutes data, if currently happening, default view last 1 hour data
  • Supports arbitrary drag time range view corresponding network traffic
  • After dragging, click "Play" button or refresh page, return to view "Last 1 Hour" network data.

Adjusted Unresolved Event Save Policy, Supports Manually Resolve Event

In unresolved event list, mouse moves to event, on the right of event can view "Resolved" function. Click "Resolved" to resolve event, meanwhile generates a resolved event, in the event can view corresponding operator.

Other Functional Optimizations

  • Chart lock time added [Last 5 Minutes] time range, time interval added [5s][10s][30s] three second level time selection
  • Scene viewer display columns, view variable basic object field attributes/tags supports custom input
  • Adjusted event details associated dashboard position
  • In metric management added time series count statistics
  • Optimized log details page associated link, according to log trace_id and span_id display flame chart and select corresponding span all data
  • Optimized RUM service display and interaction
  • RUM, network, synthetic testing, CI viewer dropdown options adjusted to flat display
  • Monitor event notification content supports configuring template variable field mapping, supports configuring template variable corresponding values through DQL query statement.
  • Help center homepage added key function quick jump entry

DataKit Updates

  • Adjusted global tag behavior, avoiding election collector tag split
  • SQLServer collector added election support
  • Line protocol filter supports all data types
  • 9529 HTTP service added timeout mechanism
  • MySQL
    • dbm metric set name adjustment
    • service field conflict issue
  • Container object added field container_runtime_name to distinguish different level container names
  • Redis adjusted slowlog collection, changed its data to log storage
  • Optimized TDEngine collection
  • Improved Containerd log collection
  • Pipeline added Profile class data support
  • Container/Pod log collection supports additional tag appending on Label/Annotation
  • Fixed Jenkins CI data collection time accuracy issue
  • Fixed Tracing resource-type value inconsistency issue
  • eBPF added HTTPS support
  • Fixed log collector possible crash issue
  • Fixed prom collector leak issue
  • Supports configuring io disk cache through environment variables
  • Added Kubernetes CRD support

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates

  • APM
    • GraalVM and Spring Native Project Link Observability
  • Integration
    • Host Observability Best Practices (Linux)

For more best practices updates, refer to Best Practices Version History.

Integration Template Updates

Added Documents

  • Alibaba Cloud
    • Alibaba Cloud NAT
    • Alibaba Cloud CDN

Added Views

  • Alibaba Cloud
    • Alibaba Cloud NAT
    • Alibaba Cloud CDN

June 6, 2022

Guance Billing Updates

Guance billing optimized time series billing logic, and metric data data retention policy. Original every 300 lines 3 yuan reduced to every 1000 lines 3 yuan. Meanwhile metric data added 3 days, 7 days, 14 days data retention policy, metric set supports custom data retention policy.

Time series statistics is the current workspace, reported metric data based on tags can combine all combination numbers. Data retention policy is data storage duration, is data reported to current workspace save time, data beyond storage duration will be automatically deleted.

Time series is full statistics, i.e., daily generated time series during data retention policy period will accumulate, the longer the data retention policy, the higher the time series cost.

This optimization through reducing time series cost and shortening metric data retention policy, you can more flexibly adjust metric data retention policy, helping you save cost.

Guance Updates

Added Jenkins CI Observability

Guance added Jenkins CI observability, you can directly view CI results in Jenkins through Guance CI visualization function. CI process is continuous integration, developers when push code, if encounter problems, can view all CI pipeline and its success rate, failure reason, specific failure link in Guance, helping you provide code update guarantee. For more details, refer to CI Visualization documentation.

Custom viewer added chart synchronized search switch, used to determine whether search conditions affect chart query, default enabled. When search box has content, close switch, i.e., chart query returns to default state; enable switch, i.e., chart query affected by filter content.

Added Network Topology and Service Topology Drill-down Analysis

In infrastructure network topology map, click host/Pod icon, click "View Upstream and Downstream," to view current node upstream and downstream node association. In upstream and downstream nodes, click "Return Overview" in the upper left corner to return to original network topology map, in search box search or filter can filter associated upstream and downstream nodes, according to search or filter results display matched associated upstream and downstream nodes. For more details, refer to Network View Upstream and Downstream documentation.

In service topology map, click service icon, click "View Upstream and Downstream," to view current service upstream and downstream service association. In upstream and downstream services, click "Return Overview" in the upper left corner to return to original service topology map, in search box search or filter can filter associated upstream and downstream services, according to search or filter results display matched associated upstream and downstream services. For more details, refer to Service View Upstream and Downstream documentation.

Added Delete Resource Catalog Data and Index

Guance supports owner and administrator delete specified resource catalog classification and all resource catalog, enter "Management" - "Basic Settings," click "Delete Resource Catalog," select delete resource catalog method, to delete corresponding object data.

  • Specified resource catalog classification: Only delete selected object classification data, does not delete index
  • All resource catalog: Delete all resource catalog data and index

Note: All resource catalog once deleted, reported to infrastructure custom all data and index all will be deleted and cannot be recovered, all set resource catalog classification data need to be reported again, daily limit 5 times delete all resource catalog operation.

More resource catalog introduction refer to Custom documentation.

Added Viewer Snapshot View Entry

In Guance metrics, logs, events, APM, RUM, cloud dial testing, security inspection, CI visualization and other viewers, save snapshot, can directly click view snapshot icon in the upper right corner slide to view already saved snapshots.

  • Supports snapshot name keyword search, through keyword fuzzy match related snapshot names
  • First is default view, does not support share, copy link and delete function
  • Except first default view, other snapshots support share, copy link and delete function, click "Snapshot Name," to open corresponding data copy in current viewer

Added Viewer Filter Condition Edit Function

In Guance viewer search bar through "field:value" method filter, supports clicking "field:value" edit "field:value," and filter with modified results.

In Guance RUM View Viewer details page, switch to "Fetch/XHR," supports viewing each network request RUM view viewer sends to backend application, including occurrence time, requested link and duration.

If network request has corresponding trace_id, before request has prompt icon, click request, can jump to corresponding link details page.

Added Chart Data Load High Performance Mode

Guance supports chart data load high performance mode, default disabled, can click account in the lower left corner, select "High Performance Mode" to enable. High performance mode enabled, all charts do not dynamic load, when click enter page directly load simultaneously, i.e., beyond current page use scroll down view charts already all loaded, can directly view display results.

Note: High performance mode enabled only for current user view charts.

Added Alert Configuration Event Notification Level

Alert configuration supports custom select event notification level, including emergency, important, warning, recovery, data gap, data gap recovery, data gap considered recovery 7 choices, supports multi-select, supports one-click clear options, after clear options clear, need manually select corresponding values. More alert configuration refer to Alert Settings documentation.

Other Functional Optimizations

  • Scene dashboard combination chart supports hide/display big title
  • Optimized event details page event type text display
  • Infrastructure list view added sort by field function
  • Log viewer added hide distribution chart button
  • Viewer supports keyword search display columns, supports custom display columns as preset fields, later through Pipeline cutting fields and report data directly display reported data.
  • In built-in template library and built-in views added one-click view corresponding integration documents, helping you youquickly configure corresponding collectors
  • Built-in views, besides supporting binding link services, applications, log sources, projects, tags and other related views in the viewer, added support for custom key and value binding related views, meanwhile supports service side slide details page binding built-in views
  • Optimized notification object Lark robot, supports custom whether need key security verification
  • Configuring monitor, if configured data range less than detection frequency, triggers prompt configuration may exist data gap issue

DataKit Updates (2022/05/26)

  • Pipeline adjusted, all data types, can be additionally processed through configuring Pipeline
  • grok() supports directly extracting fields as specified types, no longer need additional type conversion through cast() function
  • Pipeline added multi-line string support, for very long strings (such as regular cutting in grok), can improve readability by writing them in multiple lines
  • Each Pipeline running status, can directly view through datakit monitor -V
  • Added Kubernetes Pod object CPU/memory metrics
  • Helm added more Kubernetes version installation adaptation
  • Optimized OpenTelemetry, HTTP protocol added JSON support
  • DataKit automatically corrects line protocol, added log records for correction behavior, facilitating debugging data issues
  • Removed all string metrics in time series data
  • In DaemonSet installation, if election namespace configured, for collectors participating in election, their data will add specific tag (election_namespace)
  • CI observability, added Jenkins support

Breaking changes

For Docker container log collection, need to mount host (Node) /varl/lib path to DataKit (because Docker logs default fall under host /var/lib/ ), in datakit.yaml, volumeMounts and volumes added the following configuration:

volumeMounts:
- mountPath: /var/lib
  name: lib

# Omit other parts...

volumes:
- hostPath:
    path: /var/lib
  name: lib

Best Practices Updates

  • APM
    • GraalVM and Spring Native Project Link Observability
  • Integration
    • Host Observability Best Practices (Linux)

For more best practices updates, refer to Best Practices Version History.

Integration Template Updates

Added Documents

  • Alibaba Cloud
    • Alibaba Cloud NAT
    • Alibaba Cloud CDN

Added Views

  • Alibaba Cloud
    • Alibaba Cloud NAT
    • Alibaba Cloud CDN

June 6, 2022

Guance Billing Updates

Guance billing optimized time series billing logic, and metric data data retention policy. Original every 300 lines 3 yuan reduced to every 1000 lines 3 yuan. Meanwhile metric data added 3 days, 7 days, 14 days data retention policy, metric set supports custom data retention policy.

Time series statistics is the current workspace, reported metric data based on tags can combine all combination numbers. Data retention policy is data storage duration, is data reported to current workspace save time, data beyond storage duration will be automatically deleted.

Time series is full statistics, i.e., daily generated time series during data retention policy period will accumulate, the longer the data retention policy, the higher the time series cost.

This optimization through reducing time series cost and shortening metric data retention policy, you can more flexibly adjust metric data retention policy, helping you save cost.

Guance Updates

Added Jenkins CI Observability

Guance added Jenkins CI observability, you can directly view CI results in Jenkins through Guance CI visualization function. CI process is continuous integration, developers when push code, if encounter problems, can view all CI pipeline and its success rate, failure reason, specific failure link in Guance, helping you provide code update guarantee. For more details, refer to CI Visualization documentation.

Added Custom Viewer Chart Synchronized Search

Custom viewer added chart synchronized search switch, used to determine whether search conditions affect chart query, default enabled. When search box has content, close switch, i.e., chart query returns to default state; enable switch, i.e., chart query affected by filter content.

Added Network Topology and Service Topology Drill-down Analysis

In infrastructure network topology map, click host/Pod icon, click "View Upstream and Downstream," to view current node upstream and downstream node association. In upstream and downstream nodes, click "Return Overview" in the upper left corner to return to original network topology map, in search box search or filter can filter associated upstream and downstream nodes, according to search or filter results display matched associated upstream and downstream nodes. For more details, refer to Network View Upstream and Downstream documentation.

In service topology map, click service icon, click "View Upstream and Downstream," to view current service upstream and downstream service association. In upstream and downstream services, click "Return Overview" in the upper left corner to return to original service topology map, in search box search or filter can filter associated upstream and downstream services, according to search or filter results display matched associated upstream and downstream services. For more details, refer to Service View Upstream and Downstream documentation.

Added Delete Resource Catalog Data and Index

Guance supports owner and administrator delete specified resource catalog classification and all resource catalog, enter "Management" - "Basic Settings," click "Delete Resource Catalog," select delete resource catalog method, to delete corresponding object data.

  • Specified resource catalog classification: Only delete selected object classification data, does not delete index
  • All resource catalog: Delete all resource catalog data and index

Note: All resource catalog once deleted, reported to infrastructure custom all data and index all will be deleted and cannot be recovered, all set resource catalog classification data need to be reported again, daily limit 5 times delete all resource catalog operation.

More resource catalog introduction refer to Custom documentation.

Added Viewer Snapshot View Entry

In Guance metrics, logs, events, APM, RUM, cloud dial testing, security inspection, CI visualization and other viewers, save snapshot, can directly click view snapshot icon in the upper right corner slide to view already saved snapshots.

  • Supports snapshot name keyword search, through keyword fuzzy match related snapshot names
  • First is default view, does not support share, copy link and delete function
  • Except first default view, other snapshots support share, copy link and delete function, click "Snapshot Name," to open corresponding data copy in current viewer

Added Viewer Filter Condition Edit Function

In Guance viewer search bar through "field:value" method filter, supports clicking "field:value" edit "field:value," and filter with modified results.

In Guance RUM View Viewer details page, switch to "Fetch/XHR," supports viewing each network request RUM view viewer sends to backend application, including occurrence time, requested link and duration.

If network request has corresponding trace_id, before request has prompt icon, click request, can jump to corresponding link details page.

Added Chart Data Load High Performance Mode

Guance supports chart data load high performance mode, default disabled, can click account in the lower left corner, select "High Performance Mode" to enable. High performance mode enabled, all charts do not dynamic load, when click enter page directly load simultaneously, i.e., beyond current page use scroll down view charts already all loaded, can directly view display results.

Note: High performance mode enabled only for current user view charts.

Added Alert Configuration Event Notification Level

Alert configuration supports custom select event notification level, including emergency, important, warning, recovery, data gap, data gap recovery, data gap considered recovery 7 choices, supports multi-select, supports one-click clear options, after clear options clear, need manually select corresponding values. More alert configuration refer to Alert Settings documentation.

Other Functional Optimizations

  • Scene dashboard combination chart supports hide/display big title
  • Optimized event details page event type text display
  • Infrastructure list view added sort by field function
  • Log viewer added hide distribution chart button
  • Viewer supports keyword search display columns, supports custom display columns as preset fields, later through Pipeline cutting fields and report data directly display reported data.
  • In built-in template library and built-in views added one-click view corresponding integration documents, helping you quickly configure corresponding collectors
  • Built-in views, besides supporting binding link services, applications, log sources, projects, tags and other related views in the viewer, added support for custom key and value binding related views, meanwhile supports service side slide details page binding built-in views
  • Optimized notification object Lark robot, supports custom whether need key security verification
  • Configuring monitor, if configured data range less than detection frequency, triggers prompt configuration may exist data gap issue

DataKit Updates (2022/05/26)

  • Pipeline adjusted, all data types, can be additionally processed through configuring Pipeline
  • grok() supports directly extracting fields as specified types, no longer need additional type conversion through cast() function
  • Pipeline added multi-line string support, for very long strings (such as regular cutting in grok), can improve readability by writing them in multiple lines
  • Each Pipeline running status, can directly view through datakit monitor -V
  • Added Kubernetes Pod object CPU/memory metrics
  • Helm added more Kubernetes version installation adaptation
  • Optimized OpenTelemetry, HTTP protocol added JSON support
  • DataKit automatically corrects line protocol, added log records for correction behavior, facilitating debugging data issues
  • Removed all string metrics in time series data
  • In DaemonSet installation, if election namespace configured, for collectors participating in election, their data will add specific tag (election_namespace)
  • CI observability, added Jenkins support

Breaking changes

For Docker container log collection, need to mount host (Node) /varl/lib path to DataKit (because Docker logs default fall under host /var/lib/ ), in datakit.yaml, volumeMounts and volumes added the following configuration:

volumeMounts:
- mountPath: /var/lib
  name: lib

# Omit other parts...

volumes:
- hostPath:
    path: /var/lib
  name: lib

Best Practices Updates

  • APM
    • GraalVM and Spring Native Project Link Observability
  • Integration
    • Host Observability Best Practices (Linux)

For more best practices updates, refer to Best Practices Version History.

Integration Template Updates

Added Documents

  • Alibaba Cloud
    • Alibaba Cloud NAT
    • Alibaba Cloud CDN

Added Views

  • Alibaba Cloud
    • Alibaba Cloud NAT
    • Alibaba Cloud CDN

Feedback

Is this page helpful? ×