Update Log (2022)¶

This document records the update content of Guance for each online release, including DataKit, Guance best practices, Guance integration documentation, and Guance.

December 29, 2022¶

Guance Updates¶

Added MFA Authentication Management¶

Guance provides MFA authentication management, which helps add an extra layer of security protection beyond account usernames and passwords. After enabling MFA authentication, you will need to perform a second verification during login, helping improve account security. For more details, refer to the documentation MFA Management.

Added Workspace IP Access Login Whitelist¶

Guance supports configuring an IP whitelist for workspaces to restrict visitor users. After enabling the IP whitelist, only IP sources from the whitelist can log in normally, and all other requests will be denied access. For more details, refer to the documentation IP Whitelist.

Note: The IP whitelist is only supported by administrators and owners for setting up, and at the same time, "owners" are not restricted by the IP whitelist access restrictions.

Added Service Network Topology¶

In K8S environments, you can use the Service network topology diagram to view request relationships, response times, error rates, etc., between different Services in the K8S environment. When discovering that a Service has connection issues, you can check the corresponding logs of that Service to locate its problems. For more details, refer to the documentation Service Network.

Other Functional Optimizations¶

• Pipeline usage optimization
• Log cluster analysis supports custom fields
• Ultra-large log segmentation allows viewing associated logs
• Backup log display optimization
• Sensitive data fields in data authorization support all types of data except metrics

DataKit Updates¶

• Prometheus collector supports data collection via Unix Socket

• Allows non-root user execution of DataKit

• Optimized eBPF's httpflow protocol judgment

• Optimized Windows Datakit installation and upgrade commands
• Optimized Pythond encapsulation usage
• Pipeline provides more detailed operation error information
• Pipeline reftable provides a localized storage implementation based on SQLite

For more DataKit updates, refer to DataKit Version History.

Intelligent Inspection Updates¶

Official Intelligent Inspection Discontinued¶

The official intelligent inspection items "Memory Leak", "Application Performance Monitoring", and "Disk Usage Rate" are discontinued starting today. Users can configure these through self-built inspections script libraries.

Added Cloud Account Instance Dimension Billing Inspection¶

Cloud account instance dimension billing inspection helps users manage abnormal cost warnings for cloud service instances, predict cost situations, and provide users with high growth and high consumption instance tips and bill visualization capabilities, supporting multi-dimensional visualization of cloud service resource consumption.

Added Aliyun Preemptible Instance Survival Inspection¶

Due to fluctuations in the market price of preemptible instances depending on supply and demand, it is necessary to specify a bidding mode when creating preemptible instances. Preemptible instances can only be successfully created if the real-time market price of the specified instance specification is lower than the bid and there is sufficient inventory. Therefore, inspecting preemptible instances becomes particularly important for cloud assets. Through inspection, when it is discovered that a preemptible instance is about to be released, it will prompt the latest prices of all available zones for the current specification of the preemptible instance as well as the historical prices of the preemptible instance and provide appropriate handling suggestions.

For more intelligent inspection updates, refer to Intelligent Inspection Update Log.

December 15, 2022¶

Guance Updates¶

Added Profile and Network Billing¶

Guance added Profile and Network billing items. Profile counts the number of application performance Profiles reported in the workspace on the day, and Network counts the number of hosts (hosts) reporting network data in the workspace on the day. For more details, refer to the documentation Billing Method.

Guance Registration Process Optimization¶

Guance simplified the registration process to help you quickly complete registration and start using Guance. For more details, refer to the documentation Register Guance Commercial Plan.

Added Warroom Functionality¶

Guance provides a "Warroom" dashboard where you can get an overview of key metric trends across all workspaces, helping you quickly understand the key data situation of each workspace and promptly discover and solve abnormal problems. For more details, refer to the documentation Key Metric Management.

Added Dashboard Carousel Functionality¶

Guance provides carousel functionality for multiple related business dashboards. After setting it up, you can display it on large screens. For more details, refer to the documentation Carousel Dashboard.

Workspace Binding to External SLS Index¶

Guance adds support for binding SLS indexes, helping you quickly view and analyze your log data uniformly. At the same time, Guance adds support for field mapping functions, helping you map SLS index fields for cluster analysis. For more details, refer to the documentation Log Index.

Trace Viewer Chart Display Optimization¶

In the trace viewer, new trend charts for "Span Quantity" and "Error Span Quantity" have been added. You can quickly view the trend indicators of Span quantity, Error Span quantity, request count, Error request count, and response time through the viewer chart.

Other Functional Optimizations¶

• View variable interaction optimization
• Binding built-in view configuration interaction optimization
• Workspace overdue payment lock process optimization
• Workspace invitation user experience optimization
• Help documentation added an evaluation system, including good and poor reviews
• Monitor batch function optimization
• SLO added enable/disable functionality
• Fuzzy matching Wildcard left * match query limit optimization

DataKit Updates¶

• Prometheus collector supports data collection via Unix Socket
• logfwd supports injecting the image field via LOGFWD_TARGET_CONTAINER_IMAGE
• trace collector:
  • Optimized error-stack/error-message format issues
  • Adjusted SkyWalking compatibility to support the full 8.X series
• eBPF httpflow added pid/process_name fields, optimized kernel version support
• datakit.yaml adjustments recommended, suggest updating yaml
• GPU card collection supports remote mode

For more DataKit updates, refer to DataKit Version History.

Intelligent Inspection Updates¶

Added Intelligent Inspection Guidance Page¶

Guance default supports three intelligent inspection templates: memory leak, disk usage rate, and application performance monitoring. After this update, existing workspaces support manually deleting default intelligent inspection templates, while also prompting the system-wide offline time; newly created workspaces no longer default provide these three intelligent inspections, increasing a new user guidance tip.

Intelligent Inspection Component Supports Configuring Custom Jump Links¶

When configuring self-built inspections, you can configure custom jump links. For how to configure self-built inspections, refer to the documentation Self-Built Inspections.

For more intelligent inspection updates, refer to Intelligent Inspection Update Log.

Best Practices Updates¶

• Insights
  • Scenario (Scene) - SpringBoot Project External Tomcat Scene Link Observability.

For more best practice updates, refer to Best Practice Version History.

December 1, 2022¶

Guance Updates¶

Added Service List Functionality to Application Performance Monitoring¶

The service list feature in application performance monitoring supports real-time viewing of ownership, dependencies, performance, associated dashboards, and related analyses for different services, helping teams efficiently build and manage large-scale end-to-end distributed applications. For more details, refer to the documentation Service List.

Dashboard Chart Experience Optimization¶

• Added manual input for chart units, colors, and aliases. You can customize preset units, colors, and aliases according to the current standards, such as unit input format: aggregation function(metrics), like last(usage_idle)
• Added Y-axis configuration to time-series charts, allowing manual configuration of the maximum and minimum values of the Y-axis
• Added grouping display to time-series charts and pie charts, showing only label values after enabling
• Added gradient intervals to hexagonal charts, Chinese maps, and world maps, including automatic and custom options
• Column chart and histogram display optimization

For more details, refer to the documentation Visualization Charts.

View Variable Experience Optimization¶

• View variables added support for multi-selection
• When configuring view variables, added whether to set multiple default values

For more details, refer to the documentation View Variables.

User Access Monitoring Session Viewer Adjustment¶

In the user access monitoring Session viewer, added "Session" and "All Records" viewing lists:

• Session: Counts deduplicated Session (session) data within the current time range, displaying the latest Session (session) data by default;
• All Records: Displays all reported Session (session) data, with a single Session (session) potentially corresponding to multiple data entries.

Note: In the Session session list, adding display columns is supported. If the user adds a display column that does not exist in the current Session data, there may be empty data in the session list. For more details, refer to the documentation Session (Session).

Events Added Mobile Jump Options¶

After receiving alert event notifications, users can click "Go to Guance View" to go to the Guance mobile app to view detailed information about abnormal events.

Other Functional Optimizations¶

• Newcomer guidance page optimization, supports minimization
• User access monitoring application list optimization, added custom interval switching query for time controls
• Host Label interaction optimization when adding labels

DataKit Updates¶

• Added Golang Profiling integration
• logfwd supports injecting the image field via LOGFWD_TARGET_CONTAINER_IMAGE
• trace collector:
  • Optimized error-stack/error-message format issues
  • Adjusted SkyWalking compatibility to support the entire 8.X series
• eBPF httpflow added pid/process_name fields, optimized kernel version support
• datakit.yaml has been adjusted, it is recommended to update yaml
• GPU card collection supports remote mode

For more DataKit updates, refer to DataKit Version History.

Intelligent Inspection Updates¶

• Kubernetes Pod Abnormal Restart Inspection
• MySQL Performance Inspection
• Server-side Application Error Inspection
• Memory Leak Inspection
• Disk Usage Rate Inspection
• Application Performance Inspection
• Frontend Application Log Error Inspection

For more intelligent inspection updates, refer to Intelligent Inspection Update Log.

Best Practices Updates¶

• Monitoring Monitoring
  • Application Performance Monitoring (APM) - Performance Optimization - Use async-profiler to Optimize Application Performance

For more best practice updates, refer to Best Practice Version History.

November 17, 2022¶

Guance Updates¶

Pipeline Usage Experience Optimization¶

• Pipeline supports multi-select for filtering condition configurations

• Supports setting any one Pipeline script as the "Default Pipeline Script". If the current data type does not match other Pipeline scripts during Pipeline processing, the data will be processed according to the rules of the default Pipeline script.

• Categorized script functions

Event Optimization¶

• Supports writing custom events for users, for more details, refer to the documentation Write Event Data via OpenAPI.

• Added quick filters on the left side of the unresolved event viewer

Custom Viewer Supports Selecting More Types of Data¶

When creating a new viewer in a scenario, you can choose from five data types: logs, application performance, user access, security inspection, and Profile. Once saved, changes cannot be made.

Member Management Added Member Grouping Functionality¶

Added member grouping functionality in member management. You can edit member groups, allowing a member to belong to multiple groups; simultaneously, when configuring notification objects for alert strategies, member group tags can be configured.

Optimized Built-in View Binding Functionality¶

In the scenario "Built-in Views" - "User Views", when binding fields, fuzzy matching support was added. After binding fields, you can associate and view corresponding built-in views in the viewer.

Added One-Click Import/Export of Dashboards, Custom Viewers, and Monitors Within Workspaces¶

Under "Management" - "Basic Settings", added one-click import/export of dashboards, custom viewers, and monitors within workspaces in JSON configuration format. You can import dashboards, custom viewers, and monitors from other workspaces into the current workspace.

Application Performance Monitoring Log Page Added Custom Associated Fields¶

In the detail page of the application performance monitoring, in the associated log page, if you are an administrator or above, you can customize associated fields. You can click the settings button to the right of the associated fields, and in the pop-up dialog box, select the fields you want to associate. You can manually input, drag to adjust order, and confirm to complete the configuration.

Other Functional Optimizations¶

• Supports left * matching when using fuzzy match and non-fuzzy match
• Infrastructure analysis dimension optimization, host details page last report time
• Supports quick login to the previous single sign-on
• Blacklist application performance monitoring added support for filtering "all services"
• Process for upgrading users registered on the "China Zone 4 (Guangzhou)" site to the commercial plan has been optimized
• Field descriptions support being viewed in quick filters, display columns, etc.

DataKit Updates¶

• Added SNMP Collector
• Added IPMI Collector
• Added bulk injection DDTrace-Java tool
• Latest DDTrace-Java SDK enhanced SQL desensitization functionality
• Remote Pipeline optimization
  • Pipeline supports source mapping configuration, facilitating batch configuration of Pipelines and data sources
  • Pipeline provides function classification information, facilitating remote Pipeline writing
• Optimized Kafka message subscription, no longer limited to obtaining SkyWalking-related data, and supports throttling, multi-version coverage, sampling, and load balancing settings
• Alleviated short lifecycle Pod log collection issues by providing additional configuration parameters (ENV_INPUT_CONTAINER_LOGGING_SEARCH_INTERVAL)
• Pure container environment supports label-based configuration for log collection within containers
• Added Pipeline functions
  • sample(): Sampling function
  • b64enc(): Base64 encoding function
  • b64dec(): Base64 decoding function
  • append(): List append function

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

• Insights

  • Guance Tips (Skills) - DataKit HTTPS Configuration

• Monitoring Monitoring

  • Application Performance Monitoring (APM) - Common ddtrace Parameter Usage
  • Application Performance Monitoring (APM) - ddtrace-api Usage Guide
  • Application Performance Monitoring (APM) - ddtrace Sampling
  • Application Performance Monitoring (APM) - ddtrace Log Correlation

For more best practice updates, refer to Best Practice Version History.

November 11, 2022¶

Guance Added "China Zone 4 (Guangzhou)" Site¶

Guance supports multi-site registration and login, adding a "China Zone 4 (Guangzhou)" site. Combined with the existing "China Zone 1 (Hangzhou)", "China Zone 2 (Ningxia)", and "Overseas Zone 1 (Oregon)", it fully covers different regions domestically and internationally, providing users with comprehensive data observability.

It is important to note that accounts and data between different Guance sites are independent and cannot be shared or migrated. You can choose the appropriate site based on your resource usage. Currently Guance supports the following four sites.

November 3, 2022¶

Guance Updates¶

Added Guance and SLS Joint Solution¶

Guance added an SLS storage solution, supporting Alibaba Cloud SLS users to quickly use Guance for data viewing and analysis. During Guance commercial registration/upgrade, after selecting "Alibaba Cloud Account Settlement", you can choose the SLS storage solution to store data under your own Alibaba Cloud account, achieving data exclusivity. For more details, refer to the documentation SLS Storage.

The joint solution of Guance and SLS supports you to synchronize data from your Alibaba Cloud account to the Guance workspace by binding log indexes. You can click "Bind Index" in the Guance workspace "Logs" - "Index" to synchronize log data from the index. For more details, refer to the documentation Log Index.

Optimized Newcomer Guidance Page¶

Guance added newcomer guidance pages for major functional modules such as scenarios, events, infrastructure, metrics, logs, application performance monitoring, user access monitoring, availability monitoring, security inspection, CI visualization, and monitoring, and optimized the welcome homepage of the workspace to make it easier for you to understand Guance and use Guance through the newcomer guidance.

Added 3 Intelligent Inspection Configuration Documents¶

• Cloud Account Bill Inspection: Helps users manage budget alerts, anomaly cost alerts, and forecast cost situations, providing visual capabilities, supporting multi-dimensional visualization of cloud service resource consumption;
• Frontend Application Log Error Inspection: Helps identify new error messages (clustered Error Messages) appearing in frontend applications within the past hour, assisting developers and operations personnel in fixing code promptly to avoid continuous harm to customer experience over time;
• Aliyun Asset Inspection: Helps users gain more understanding of the performance status of products from cloud vendors.

Added Trace Error Tracking Viewer¶

In application performance monitoring, added an error tracking viewer to help you quickly view similar errors and their distribution in traces, quickly locating performance issues. For more details, refer to the documentation Trace Tracking.

Optimized Time-Series Graph and Overview Graph Comparison Feature¶

The comparison feature is no longer linked with locked time. By default, the button is displayed but turned off. After enabling the comparison feature, the comparison dimensions support four options: hours (compared to one hour ago), days (compared to one day ago), weeks (compared to one week ago), months (compared to one month ago). For more details, refer to the documentation Comparison.

Other Functional Optimizations¶

• Added a "Save Snapshot" button in the "Settings" section for dashboards/notebooks/viewers;

• Added more options to the time control;

• Pipeline and blacklist features added import, bulk export, and bulk delete functionalities;

• Intelligent inspection added dashboard and bar chart components;
• Optimized Func page under the integration menu.

DataKit Updates¶

• Improved Prometheus ecosystem compatibility, added ServiceMonitor and PodMonitor collection recognition

• Added Java Profiling via async-profiler integration

• eBPF collection added interval parameter, facilitating adjustment of collected data volume

• All remote collectors default to using their collection address as the value for the host field, avoiding possible misinterpretation of the host field during remote collection
• APM data collected by DDTrace can automatically extract error-related fields for better APM error tracking at the center
• MySQL collector added additional fields Com_commit/Com_rollback collection

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

• Monitoring Monitoring

  • Application Performance Monitoring (APM) - Kafka Observability Best Practices

• Cloud Platform Integration

  • Alibaba Cloud - Alibaba Cloud ACK Integration with Guance

For more best practice updates, refer to Best Practice Version History.

October 20, 2022¶

Guance Updates¶

Monitoring Optimization¶

Added Outlier Detection¶

Outlier detection uses algorithms to detect whether there are significant deviations in the metrics/statistical data of the detected object within specific groups. If there are inconsistencies exceeding a certain degree, an outlier detection anomaly event is generated for subsequent alert tracking. For more details, refer to the documentation Outlier Detection.

Mutation Detection Logic Optimization¶

The new mutation detection compares the absolute or relative (%) change values of the same metric in two different time periods to determine if an anomaly occurs. It is widely used to track peaks or data changes in a particular metric, producing more precise events when anomalies occur. For more details, refer to the documentation Mutation Detection.

Range Detection Logic Optimization¶

The new range detection performs anomaly detection on the selected detection range time period's metric data. When the proportion of mutation anomaly data points exceeds the set percentage, a range detection anomaly event is generated. It is widely used to monitor trend-stable data/metrics. For more details, refer to the documentation Range Detection.

Other Optimizations¶

• Adjusted read-only member permissions to allow viewing configurations for monitors, intelligent inspections, SLOs, mute management, and alert policies
• Changed data gap configuration selection from "Trigger Data Gap Event" and "Trigger Recovery Event" to time range configuration, supporting manual input

• Supported configuring monitors based on "Event" data

• Alert configuration added "Information" event notification level selection

Scene Chart Optimization¶

Added Histogram Chart Component¶

Histograms, also known as quality distribution charts, are used to represent the distribution of data, a common statistical chart. Generally, the x-axis represents the data range, and the y-axis represents the distribution. For more details, refer to the documentation Histogram.

Chart Function Optimization¶

• Overview chart, treemap, funnel chart added time slicing functionality
• Time-series chart "View Similar Trend Metrics" changed from supporting only metric queries to supporting all data types, including logs, application performance, user access, etc.
• Leaderboard supports viewing all content exceeding the chart width
• Hexagonal chart display optimization

Viewer Optimization¶

Viewer Supports Analysis Mode¶

In log, application performance monitoring, user access monitoring, availability testing, security inspection, and CI viewers, added "Analysis" functionality. Infrastructure adjusted "Grouping" to "Analysis", supporting multidimensional analysis statistics based on 1-3 labels to reflect the distribution characteristics and trends of data under different dimensions at different times. In analysis mode, multiple data chart analyses are supported, including time-series charts, leaderboards, pie charts, and treemaps. For more details, refer to the documentation Viewer Analysis Mode.

Optimized Related Log Viewing Experience¶

In infrastructure, application performance monitoring, user access monitoring, and CI visualization viewer detail pages, optimized the related log viewing experience. Logs are displayed by default according to the "Maximum Display Lines" and "Display Columns" set in the log viewer settings, supporting custom adjustments via "Display Columns".

Log Index Optimization¶

After setting indexes in "Logs" - "Index", log-related queries added index options, defaulting to index default. You can query and analyze log data according to the indexes you set, involving functions including log viewers, custom scene viewers, chart log queries, log monitors, etc. For more details, refer to the documentation Log Index.

Optimized Metric Analysis Chart Queries¶

Added time intervals and legend options in metric analysis, adjusting the display order of aggregation functions in legends. For more details, refer to Metric Analysis.

Other Functional Optimizations¶

• Added dropdown menu options in user access monitoring application lists to help users quickly switch and view different application data
• Added Pipelines quick access shortcuts in directories for metrics, user access monitoring, application performance monitoring, infrastructure, and security inspections

DataKit Updates¶

• DataKit collector configurations and Pipelines support synchronization via etcd/Consul and other configuration centers
• Prometheus Remote Write Optimization
  • Collection supports filtering tags via regular expressions
  • Supports filtering metric set names via regular expressions
• Pipeline Optimization
  • Optimized grok() and json() functions so they execute trim-space operations by default
  • Added match() function
  • Added cidr() function
• Process collector added detailed fields for open file lists
• Enhanced external data接入(T/R/L) disk caching and queue processing
• Added overage usage prompts on the Monitor: In the bottom part of the monitor, if the current space usage exceeds limits, a red text Beyond Usage prompt will appear
• Optimized log collection position functionality, mounting the file externally on the host machine in container environments to avoid losing original position records upon DataKit restart
• Optimized sparse log collection delay issues

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

• Monitoring Monitoring

  • Infrastructure Monitoring (ITIM) - Ansible Batch Processing Practical Combat.

• Cloud Native

  • Logs - Guance Collecting Amazon ECS Logs.

For more best practice updates, refer to Best Practice Version History.

September 29, 2022¶

Guance Updates¶

Added Field Management¶

Guance supports unified management of field data for the current workspace, including system fields and custom fields. You can view field descriptions in scene chart queries, monitor detection metrics, DQL simple query modes, etc., helping you quickly understand field meanings and apply them. The figure below shows viewing the host field description in a scene chart query; for more details, refer to the documentation Field Management.

Optimized Metric Functionality¶

Metric Viewer Transformation¶

The original "Metric Viewer" has been changed to "Metric Analysis", supporting users to visualize queried data in time-series chart formats (line charts, area charts, bar charts). For more details, see Metric Analysis.

Optimized Metric Management¶

• Supports searching for "Metric Sets" and "Metrics" in "Metric Management";

• Supports modifying the "Unit" and "Description" of metrics in "Metric Management";

• Supports viewing tag description information in "Metric Management".

For more details, see Metric Management.

Added Exporting Event Content in PDF Format¶

On the event details page, the Jump to Monitor button has added explanatory text, clicking button allows exporting JSON File and PDF File to obtain all key data corresponding to the current event.

Monitor Adjustments¶

• Monitor name does not support customization; the event title input generates the monitor name synchronously;
• Monitors support "info" event generation logic. Trigger conditions can choose to enable or disable information: normal detection results also generate events;
• Monitor configuration steps adjusted to: Detection Configuration - Event Notification - Association.

Note: In the latest version, the "Monitor Name" will be generated synchronously by the "Event Title" input. There may be inconsistencies between "Monitor Name" and "Event Title" in old monitors; for a better user experience, please synchronize to the latest version, supporting one-click replacement of event titles.

Mute Rules Support Dynamic Configuration¶

In Mute Management, optimized mute scope, supporting various options such as monitors, intelligent inspections, self-built inspections, SLOs, alert strategies, and added tag options.

Note: Mute scope is mandatory, tags are optional. Only when both "mute scope" and "tags" conditions are met simultaneously will the mute take effect. For example, if the mute scope selects Application Performance Monitoring and Disk Usage, and the tag selects: host:izbp152ke14timzud0du15z, then alerts for either Application Performance Monitoring and host:izbp152ke14timzud0du15z or Disk Usage and host:izbp152ke14timzud0du15z will not send notifications to alert targets.

Optimized Pipeline Configuration Page¶

In Text Processing (Pipeline), added multiple sample parsing tests, fixed the issue with incorrect one-click sample acquisition for metric data. For more details, see Text Processing (Pipeline).

Other Functional Optimizations¶

• Notes added global lock time configuration; after setting the global lock time, all charts on the note page will display data according to the locked time.
• Unresolved event queries modified to show the most recent 48-hour data, supporting manual refresh
• User access monitoring supports overwrite logic for views with the same name
• User access monitoring Web, WeChat Mini Programs, and uniapp framework-based mini programs initialization parameters added isIntakeUrl configuration, used to determine whether to collect corresponding resource data based on the request resource URL, defaulting to collecting everything
• Intelligent inspections added support for self-built inspections
• Operation column adjustments on the generate metrics page added "Open in Metric Analysis" and "Open in Metric Management" operation icons
• Management navigation menu position adjustments, SSO management moved to Member Management, Notification Target Management moved to Monitoring, Built-in Views moved to Scenarios

Best Practices Updates¶

• Cloud Native: Multiple Kubernetes Cluster Metrics Collection Best Practices.

More best practice updates can be found in Best Practice Version History.

September 15, 2022¶

Guance Updates¶

Added Log Viewer DQL Search Mode¶

In the log viewer, you can toggle to the DQL manual input query mode by clicking the small icon next to the search bar , supporting custom input filter and search conditions.

• Filter Conditions: Supports arbitrary combinations of and / or, supports using () parentheses to indicate search priority, supports = , != operators;
• Search Conditions: Supports searching logs using the DQL function query_string().

For more details, refer to the documentation DQL Search.

Optimized Application Performance Monitoring¶

Trace Viewer Details Page Optimization¶

• Optimized layout display on the details page, added duration, http method, http url, http status code, TraceId, etc.;
• Flame graph added thumbnails, double-click Span enlargement display, click service name to highlight the corresponding Span display;
• Span list added search, click to select Span switching to synchronous flame graph display;
• Service call relationship added search

For more details, refer to the documentation Trace Viewer.

Profile Viewer Details Page Optimization¶

Added quick operations on the Profile Viewer details page, including search, copy, and click to view methods. For more details, refer to the documentation Quick Operation Instructions.

Optimized Monitor Event Notification Content Editing Mode¶

When creating a monitor, the event notification content triggered by satisfying conditions supports inputting and previewing markdown formatted text information, supporting the use of template variables.

Added Periodic Mute Management¶

Mute Management added periodic mute functionality, allowing selection of "Only Once" or "Repeat" in the mute time. For more details, refer to Mute Management.

Other Functional Optimizations¶

• Scenario dashboard grouped display optimization, scenario notes optimized Markdown format text component
• Infrastructure viewer display optimization, added CPU usage rate, MEM usage rate, etc., hint information for display columns; "Pods", "Deployments", "Services" viewer detail pages added viewing and copying corresponding YAML files

• Metric Viewer removed list view mode, retained tiled view mode and mixed view mode

• Log multi-index supports jumping to view

• Top 5 quick filter values in the viewer support viewing the proportion numbers, viewer time field format optimized, default display format is 2022/09/15 20:53:40
• Trace Viewer timeline chart added legend display, quick filter added HTTP-related fields

DataKit Updates¶

• Added automatic cloud sync functionality, no longer requiring manual specification of cloud providers
• Supports syncing k8s labels as tags to pod metrics and logs
• Supports collecting various yaml information from k8s objects onto corresponding object data
• Trace collection automatically extracts some key meta information
• Installation process supports specifying installation source addresses, simplifying offline installation procedures
• Pipeline added functionality:
  • Added for loop/dictionary/array support
  • Added arithmetic expression support
  • Pipeline error information will be displayed on the collected data
  • If the time field cutting fails, it supports automatically correcting the time field(time) to avoid console page time not displaying
  • Added len() function

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

• Monitoring Monitoring- Middleware (MIDDLEWARE) - Insight MySQL.

For more best practice updates, refer to Best Practice Version History.

September 1, 2022¶

Guance Updates¶

Added Log Viewer DQL Search Mode¶

In the log viewer, you can switch to DQL manual input query mode by clicking the toggle small icon in the search bar, supporting custom input filtering and search conditions.

• Filtering Conditions: Supports arbitrary combination of and / or, supports using () parentheses to indicate search priority, supports = , != operators;
• Search Conditions: Supports searching logs using the DQL function query_string().

For more details, refer to the documentation DQL Search.

Optimized Application Performance Monitoring¶

Trace Viewer Details Page Optimization¶

• Optimized layout display on the details page, added duration, http method, http url, http status code, TraceId, etc.;
• Flame graph added thumbnails, double-click Span enlargement display, click service name to highlight the corresponding Span display;
• Span list added search, click to select Span to switch to synchronous flame graph display;
• Service call relationship added search

For more details, refer to the documentation Trace Viewer.

Profile Viewer Details Page Optimization¶

Added quick operations on the Profile Viewer details page, including search, copy, and click to view methods. For more details, refer to the documentation Quick Operation Instructions.

Optimized Monitor Event Notification Content Editing Mode¶

When creating a monitor, the event notification content triggered by satisfying conditions supports inputting and previewing markdown formatted text information, supporting the use of template variables.

Added Periodic Mute Management¶

Mute Management added periodic mute functionality, allowing selection of "Only Once" or "Repeat" in the mute time. For more details, refer to Mute Management.

Other Functional Optimizations¶

• Scenario dashboard grouped display optimization, scenario notes optimized Markdown format text component
• Infrastructure viewer display optimization, added CPU usage rate, MEM usage rate, etc., hint information for display columns; "Pods", "Deployments", "Services" viewer detail pages added viewing and copying corresponding YAML files

• Metric Viewer removed list view mode, retained tiled view mode and mixed view mode

• Log multi-index supports jumping to view

• Viewer quick filter top 5 values support viewing proportions, viewer time field format optimized, default display format is 2022/09/15 20:53:40
• Trace Viewer timeline chart added legend display, quick filter added HTTP-related fields

DataKit Updates¶

• Added automatic cloud sync functionality, no longer requiring manual specification of cloud providers
• Supports syncing k8s labels as tags to pod metrics and logs
• Supports collecting various yaml information from k8s objects onto corresponding object data
• Trace collection automatically extracts some key meta information
• Installation process supports specifying installation source addresses, simplifying offline installation procedures
• Pipeline added functionality:
  • Added for loop/dictionary/array support
  • Added arithmetic expression support
  • Pipeline error information will be displayed on the collected data
  • If the time field cutting fails, it supports automatically correcting the time field(time) to avoid console page time not displaying
  • Added len() function

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

• Monitoring Monitoring- Middleware (MIDDLEWARE) - Insight MySQL.

For more best practice updates, refer to Best Practice Version History.

August 18, 2022¶

Guance Updates¶

Guance Billing Update¶

Guance billing items added data retention strategies and corresponding unit prices for application performance, user access, and logs. Log data added a 7-day retention strategy, application performance and user access added a 3-day retention strategy. You can adjust the corresponding data retention strategies according to actual needs to save costs. For more details, refer to the documentation Billing Method.

Optimized Viewer¶

Added Historical Filtering¶

Guance added a viewer historical filtering feature, supporting the local browser saving of key:value search condition histories for the current user. In the current workspace, you can directly use historical search conditions across different viewers, aidingin avoiding repetitive configuration of filtering conditions.

• Open historical filtering: Supported by clicking the expand small icon at the bottom right corner of the viewer or directly using shortcut keys (Mac OS: shift+cmd+k / Windows: shift+ctrl+k) to quickly open historical filtering;
• Collapse historical filtering: Click the close button x or use the esc key to collapse the historical filtering.

For more details, refer to the documentation Historical Filtering Instructions.

Added Quick Filter Value Sorting¶

In quick filters, added support for sorting field values by percentage. Click the "Settings" button in the upper right corner of the quick filter item, choose "Top 5 Query Values", and view the statistical percentage of the top five field attribute values for the current filter item. On the right side of the leaderboard, you can click the "Positive Filter" and "Negative Filter" buttons to filter data in the form of key:value. For more details on quick filtering in the viewer, refer to the documentation Quick Filtering Instructions.

Added Time Control Input Format Prompt Page¶

In the time control of the viewer, added a time control input format prompt page, optimizing the text input box of the time control to interact with the prompt box in real-time, helping users quickly understand the supported input formats of the time control. For more details on the viewer's time control, refer to the documentation Time Control Instructions.

Added Display Column Field Separator and Caption Prompts¶

When adding display columns in the viewer, added field separators and caption prompts. When entering fields for display columns, preset fields are separated by separators from existing fields and prompt captions "Create and Add", supporting keyboard up/down switching keys (↑ ↓) to select added display columns; for more details on the viewer's display columns, refer to the documentation Display Column Instructions.

Added View Permissions for Scenario Dashboards/Notes/Viewers¶

When creating Dashboards, Notes, or Viewers in a scenario, supports the creator customizing view permissions to prevent accidental changes to the creator's dashboard or premature publication of dashboards/notes/viewers that are not yet ready or inconvenient to publish. Permission settings include "Public" and "Visible Only to Me".

• Public: Open to all members within the current workspace, other members' viewing and editing permissions are unaffected;
• Visible Only to Me: Visible only to the creator, other members do not have viewing permissions.

Note: When accessing non-public dashboards/notes/viewers via links, etc., non-creators cannot see them and will be prompted that they do not have permission to view.

Added Snapshot Viewing Permissions¶

When saving snapshots in scenarios or viewers, supports customizing viewing permissions, with permission settings including "Public" and "Visible Only to Me".

• Public: Indicates that all users in the current workspace can view saved snapshots;
• Visible Only to Me: Indicates that other users except the current user cannot view saved snapshots.

After saving a snapshot in the viewer, you can directly click the view snapshot icon in the upper right corner to slide out and view already saved snapshots.

• Supports keyword searching of snapshot names, matching related snapshots through fuzzy search;
• The first one is the default view, does not support sharing, copying links, or deleting functions;
• Other snapshots support sharing, copying links, and deleting functions; clicking the "Snapshot Name" opens the corresponding data copy in the current viewer.

Optimized Monitors and Events¶

Added Monitor Testing¶

Monitors added manual trigger monitor detection. If the current detection rule triggers, you can view related details in the event viewer.

Optimized Intelligent Inspection Information Display¶

The intelligent inspection list added "Data Range", "Detection Frequency", "Grouping", "Last Trigger Time", "Trigger Status". Operations added "Export JSON Configuration", with file name format: Intelligent Inspection Name.json.

The intelligent inspection event detail page added "Basic Attributes", "History Records", "Associated Events" general pages.

Optimized Event Detail Page¶

On the event detail page, optimized the "Basic Attributes" page; changed "Copy Current Event Content" to "Export Event JSON" button, while adding a "View Monitor Configuration" button on the left side, supporting one-click jump to the current event's monitor configuration page for convenient real-time adjustment of monitor rules.

If the monitor is configured with an alert, the associated event detail page adds an "Alert Notification" page. If the monitor sets alert muting, no identical alert events will be sent to notification targets during the alert muting period. In the "Alert Notification" page of the event detail, such alert notifications will be marked as "Notification Not Sent".

Other Functional Optimizations¶

• Guance added email verification method authentication
• Optimized host and Pod type display in the associated network page of the viewer detail page;
• Added toggle icons when adding charts to dashboards and built-in views, adjusting the position of the view variable edit button;
• Time-series chart legend added sum aggregation statistics, while also optimizing legend display and interaction;
• Monitors and chart queries of log data added wildcard and not wildcard conditions in screening conditions.

DataKit Updates¶

New Features¶

• Added reftable functionality in Pipeline
• DataKit 9529 HTTP supports binding to domain socket
  • Corresponding eBPF collection and Oracle collection configurations need to be adjusted accordingly.
• RUM sourcemap added Android R8 support
• CRD added log configuration support
  • Complete example

Optimization¶

• Optimized container collector documentation
• Added common Tag documentation
• Optimized election configuration and some related naming
• Election-type collectors still support disabling election functions on specific collectors even when elections are enabled in DataKit
• Supports specifying io block configuration for specific data types
• DDTrace collector sampling added meta information recognition
• DataKit's own metric set added HTTP request-related metrics for port 9529
• Optimized Zipkin collection memory usage
• DDTrace collector defaults to blocking IO feed after enabling disk cache
• eBPF added process name (process_name) field
• DCA new version released
• Log class HTTP data writing (logstreaming/Jaeger/OpenTelemetry/Zipkin) all added queue support
• Log collection added automatic multiline support

Bug Fixes¶

• Fixed MySQL collector connection leak issue
• Fixed Pipeline Json value issue
• Fixed macOS ulimit setting ineffective issue
• Fixed sinker-Dataway being ineffective in Kubernetes
• Fixed HTTP data writing interface data validation issue
• Fixed eBPF collection failure due to kernel change structure offset calculation issue
• Fixed DDTrace close-resource issue

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

• Monitoring Monitoring

  • Using extract + TextMapAdapter to implement custom traceId

• Insights Insight

  • Scenario - Integrating Dubbo Microservices into Guance in an Intranet Environment

For more best practice updates, refer to Best Practice Version History.

August 4, 2022¶

Guance Updates¶

DCA Web End Launch¶

Guance added the Web management tool DCA for DataKit, aimed at conveniently managing already installed and configured collectors, supporting viewing collector runtime status, collector configuration management, Pipeline management, blacklist management, and collector documentation help functions. For more details, refer to the documentation DCA.

Optimized Viewer Search, Quick Filters, Time Controls, Display Columns¶

Viewer Search¶

• In the viewer search bar, added "Exist" and "Not Exist" filtering logic, returning search results by determining if the filtered field exists;
• In the viewer search bar, added arithmetic operations for numeric types, supporting operators including equal to, greater than or equal to, less than or equal to, greater than, less than, not equal to;
• Added field data type prompts and matching mode explanations

For more details on the viewer search, refer to the documentation Search Instructions.

Quick Filters¶

• In quick filter items, added tag field search functionality. When there are more than 10 tag fields in quick filters, supports fuzzy searching by "Field Name" or "Display Name";
• Added a "Settings" button in quick filters, supporting adding/removing display columns;
• Added a "Settings" button in quick filters, allowing editing display names and deleting fields for self-added personal-level filter items.

For more details on the viewer's quick filters, refer to the documentation Quick Filter Instructions.

Time Controls¶

• Added interval display, supporting manually entering time ranges by clicking the display box of the time control, including "Interval Range", "Timestamp Range", and "Standard Time Format";
• Dropdown list added custom options, supporting hour:minute:second format input within the custom range;
• Added viewing of the last 20 historical absolute time records.

For more details on the viewer's time controls, refer to the documentation Time Control Instructions.

Display Columns¶

In the viewer list, when hovering over display columns, added a "Settings" button, supporting ascending/descending order, moving columns left/right, adding/removing columns, adding to quick filters, adding to groups, and removing columns. For more details on the viewer's display columns, refer to the documentation Display Column Instructions.

Optimized Viewer Details Page¶

• Adjusted the positions of operations for quick filtering "Filter Field Values", "Reverse Filter Field Values", "Add to Display Columns", and "Copy";
• Supported navigating between log details using keyboard up/down arrow keys (↑ ↓ );
• Supported directly closing the detail page popup using the keyboard esc key.
• Added "View Context" function: When opening a new log viewer to view context in log details, it uses "host", "source", "service", "filename" as filter conditions, with the current log time as the start time and the current log time + 30 minutes as the end time set in the time control for context log filtering. For more details, refer to the documentation View Context.

Added Global Automatic Refresh Configuration for Viewers¶

In Guance workspaces, click "Account" and enable/disable "Automatic Viewer Refresh".

• Enabled: Viewer data refreshes according to the default time control refresh time of 30 seconds. For example, selecting the last 15 minutes refreshes every 30 seconds to show the most recent 15 minutes of data.
• Disabled: The time control enters without 30-second auto-refresh. For example, selecting the last 15 minutes shows the content of that 15-minute absolute time and does not automatically refresh anymore. You can click the "Play" button to refresh and view the most recent 15 minutes of data.

Note: Viewer auto-refresh only affects the local browser. For more details on time controls, refer to the documentation Time Control Instructions.

Added Global Blacklist Functionality¶

Guance supports filtering out different types of data that meet conditions via a blacklist configuration, meaning data meeting these conditions will no longer be reported to Guance workspaces, helping you save data storage costs. Currently, the global blacklist function supports filtering data types including logs, basic objects, resource catalogs, networks, application performance monitoring, user access monitoring, security inspections, events, metrics, Profile. For more details, refer to the documentation Blacklist.

Added Customizable Function Menu¶

Guance supports manually setting the function menu, including hiding/displaying and adjusting the menu order, helping you customize the menu display of the current workspace. In Guance workspaces, click the account in the lower-left corner, choose "Function Menu Management", and adjust the menu accordingly. For more details, refer to the documentation Function Menu Management.

Added Chart Query Alias¶

In scene visualization charts, added chart query aliases. After adding an alias, the legend name also changes, making it easier to distinguish related metrics. Currently supported chart types include time-series charts, pie charts, bar charts, scatter plots, bubble charts, funnel charts.

Added Legend Styles for Time-Series Charts and Pie Charts¶

In scene visualization charts, pie charts added support for bottom, right-side, surrounding, and hidden legend styles. Time-series charts support bottom, right-side, and hidden legend styles, with hidden legends as the default state.

Optimized Object Historical Data Retention Strategy¶

Guance retains historical data for 48 hours for all objects (hosts, containers, pods) reported to the workspace, allowing users to review the data performance of any moment within the past two days. When viewing logs, traces, or security inspection data, you can check the object situation at the corresponding moment in the "Attribute View" of the associated host, container, or pod.

Adjusted Saved Snapshot Position¶

Removed the "Save Snapshot" button from the top navigation bar of the viewer, unified migration to "Historical Snapshots". Scene dashboards and notes can create snapshots via shortcuts. More details can be found in the documentation Snapshots.

Added Global Blacklist Functionality¶

Guance supports filtering out different types of data that meet conditions via a blacklist, meaning that data meeting the conditions will no longer be reported to Guance workspaces, helping you save on data storage costs. The global blacklist currently supports filtering data types including logs, basic objects, resource catalogs, networks, application performance monitoring, user access monitoring, security inspections, events, metrics, Profile. For more details, refer to the documentation Blacklist.

Added Customizable Function Menu¶

Guance supports manually setting the function menu, including hiding/displaying and adjusting menu order, helping you customize the current workspace's menu display. In Guance workspaces, click the account in the lower-left corner, choose "Function Menu Management", and adjust the menu accordingly. For more details, refer to the documentation Function Menu Management.

Added Chart Query Alias¶

In scene visualization charts, added chart query alias, where adding an alias causes the legend name to change accordingly, making it easier to intuitively distinguish related metrics. Currently supported chart types include time-series charts, pie charts, bar charts, scatter plots, bubble charts, funnel charts.

Added Legend Style Options for Time-Series and Pie Charts¶

In scene visualization charts, pie charts now support bottom, right-side, surrounding, and hidden legend styles. Time-series charts support bottom, right-side, and hidden legend styles, with hidden legend style as the default.

Optimized Object Historical Data Retention Policy¶

Guance retains 48 hours of historical data for all objects (hosts, containers, pods) reported to the workspace, allowing users to review the data performance of objects at any given moment within the past two days. When viewing a log, trace, or security inspection data, you can check the object situation at the corresponding moment in the "Property View" of the associated host, container, or pod.

Adjusted Saved Snapshot Location¶

Removed the "Save Snapshot" button from the top navigation bar of the viewer, unified migration to "Historical Snapshots". Scene dashboards and notes can create snapshots via shortcuts. For more details, refer to the documentation Snapshots.

Other Functional Optimizations¶

• Time-series charts added millisecond-level time intervals
• Management backend added workspace-level index configuration adjustment entry
• Log viewer distribution chart added support for custom time interval selection
• RUM viewer page added current data extension field page display

DataKit Updates¶

• Partial data types failing to send support caching to disk, resending later
• Support sending data satisfying conditions to different workspaces via different dataway addresses
• Sourcemap added Android and iOS support
• Container collector related updates:
  • Fixed Kubernetes Node host operating system information collection error
  • Kubernetes Prom collection no longer automatically appends pod-related information to avoid excessive timeline growth
  • Added corresponding yaml information to Pod objects
• Pipeline related updates:
  • Optimized Pipeline execution steps
  • grok() and json() functions now perform trim-space operations by default
• DDTrace related updates:
  • Fixed potential goroutine leakage issues
  • Added disk cache configuration support to mitigate memory consumption problems
• Other bug fixes:
  • Optimized line protocol construction
  • Removed periodic cleaning of tail data in log collection to alleviate possible log truncation issues

More DataKit updates can be found in DataKit Version History.

July 21, 2022¶

Guance Updates¶

Added Intelligent Inspection Functionality¶

Intelligent inspection based on Guance intelligent detection algorithms supports automatic detection of infrastructure and application issues, helping users discover IT system operational issues. Through root cause analysis, it quickly locates abnormal problem causes; through Guance intelligent prediction algorithms, it helps users foresee potential infrastructure and application problems in advance, assesses the impact level of problems on system operation, better determines the priority of troubleshooting work, reducing uncertainty in the troubleshooting process.

Currently, intelligent inspection supports three inspection templates:

• Memory Leak: Detects if there are memory leak issues in the current workspace hosts
• Disk Usage Rate: Detects if there are high disk usage issues in the current workspace hosts
• Application Performance Detection: Detects fluctuations in QPS, average response time, P90 response time, and error rates for services in the current workspace

Optimized Viewer Search and Filtering Functions¶

1. Viewer search added "not wildcard reverse fuzzy match", i.e., not matching fuzzy query results.

1. Viewer quick filters added space-level and personal-level filtering methods

2. Space-level filter items: Configured by administrators/owners, click the "Settings" button next to the quick filter to configure space-level filter items

3. Personal-level filter items: All members can configure quick filters based on their local browsers, click the "Edit" button on the right side of the quick filter to configure personal-level filter items

For more details, refer to the documentation Viewer Search and Filtering.

Added Modification of URL Time Range for Data Queries¶

Guance supports modifying the time parameter's time range in the browser URL for direct data queries in the current workspace viewer/dashboard, supporting four units: seconds, minutes, hours, days, such as time=30s, time=20m, time=6h, time=2d, etc. As shown in the figure below, modifying time=2h in the browser displays data from the last 2 hours. For more details, refer to the documentation URL Time Range.

Added Dashboard View Variable Logs, Application Performance, User Access, Security Inspection Data Source Configuration¶

Dashboard view variables added "Logs", "Application Performance", "User Access", "Security Inspection" data source configurations, while optimizing the interaction for adding and editing view variables in dashboards.

• In dashboards without added view variables, the top navigation bar adds an "Add View Variables" button, clicking which adds view variables.
• If the dashboard has added view variables, the top navigation bar below directly displays the view variable names, clicking the "Edit" button on the right allows entering the view variable editing page.

For more details, see the documentation View Variables.

Optimized Chart Query Interaction¶

• Click the "Separator Bar" between the chart and query to drag up and down
• Click the "Drag" button to the left of the query statement, dragging up and down adjusts the query order
• Scrollbar only acts on the query statement area, does not affect the chart

Added User Access Metric Detection Event Notification Template Variables¶

In the "User Access Metric Detection (RUM)" monitor, configuring notification events supports additional template variables besides the generic ones. For more details, refer to the documentation Event Title/Content Templates.

Optimized Event Content One-Click Open Link¶

When configuring monitors, add links in the event content. Upon triggering an event, clicking the link in the "Event Content" section of the event details page opens a new tab to jump to the page.

DataKit Updates¶

• Prometheus collector default timeout is 3 seconds
• Log-related issue fixes:
  • Added log_read_offset field to log collection
  • Fixed the bug where logs were not correctly readAll after rotation
• Container collection-related issue fixes:
  • Fixed compatibility issues with environment variable NODE_NAME
  • Changed Kubernetes auto-discovery prometheus collection to serial, node-distributed collection
  • Added mappings for log sources and multiline configurations
  • Fixed the issue where container logs replaced source but still used previous multiline and pipeline settings
  • Corrected container logs, setting active file duration to 12 hours
  • Optimized docker container log image fields
  • Optimized k8s pod object host fields
  • Fixed the issue where container metrics and objects did not add host tags

More DataKit updates can be found in DataKit Version History.

Best Practices Updates¶

• Cloud Platform Integration
  • Rancher Deployment DataKit Best Practices
  • Tencent Cloud Product Observability Best Practices (Function)

For more best practice updates, refer to Best Practice Version History.

July 7, 2022¶

Guance Updates¶

Optimized Viewer Selection, Reverse Selection, Fuzzy Matching Three Screening Modes¶

Guance viewers support precise screening, fuzzy screening (wildcard), and reverse selection using the method of "field:value". Editing and modifying "field:value" for screening are also supported. For more details, refer to the documentation Viewer Search and Filtering.

Optimized Viewer Quick Filters¶

In Guance viewers' quick filters, default full selection is supported, including "positive selection", "reverse selection", "reset", "All", and "only" multiple filtering options. If both positive and reverse selections exist simultaneously in the search box, the corresponding quick filter labels turn gray and become unselectable. For more details, refer to the documentation Quick Filters.

Added Multiple Shortcut Operations for Viewer Display Columns¶

In Guance viewers, through "display columns", you can add or delete display columns to the viewer list.

• When hovering over added display columns, you can perform operations like ascending/descending order, moving columns left/right, removing columns, etc.
• If the content of the display column is not fully displayed, place the mouse on the right divider of the display column and "double-click the divider" to expand the content of that column.

Optimized Attribute/Field Quick Filters on Viewer Details Pages¶

On the viewer details page, when clicking on attribute fields such as "Host" or "Source", you can perform "positive filtering", "negative filtering", "add to display columns", and "copy" for quick filtering and viewing. In the log viewer details page, when selecting extended fields, icons for "copy", "positive filtering", "negative filtering", and "add to display columns" appear for quick filtering and viewing.

• "Copy": Copies the field to the clipboard
• "Positive Filtering": Adds the field to the viewer to view all data related to the field
• "Negative Filtering": Adds the field to the viewer to view data excluding the field
• "Add to Display Columns": Adds the field to the viewer list for viewing

Optimized Historical Snapshot Functionality, Supporting Three Time Retention Strategies¶

In viewers for metrics, logs, events, application performance monitoring, user access monitoring, cloud testing, security inspections, etc., you can click "Save Snapshot" to save the data content currently displayed by the viewer, supporting enabling/disabling "time filtering".

• Snapshots with time filtering enabled are saved based on the currently selected time on the page. Links shared externally do not support switching time controls.
• Snapshots with time filtering enabled and absolute time locking convert the selected time range on the page to "absolute time" for saving.
• Snapshots with time filtering disabled follow the system default time. Shared snapshots can switch time controls.

After saving snapshots, you can view them in the historical snapshot list of the viewer. Select and open historical snapshots, click the "Return to Viewer" button in the upper right corner to return to the default viewer.

Added Pipeline One-Click Acquisition of Sample Test Data¶

When creating or editing a Pipeline, a "One-Click Acquisition" button was added to the right of the sample parsing test, facilitating data acquisition for cutting and debugging.

• Log data: Returns message data
• Other data types: Returns line protocol formatted data

For more details, refer to the documentation Text Processing Pipeline.

Added Approximate Text Analysis Mode in Custom Viewers for Scenarios¶

In custom viewers for scenarios, when editing the viewer, in the custom configuration display columns, you can select the "Approximate Text Analysis" viewer field, which by default uses the content of the message field for approximate text analysis. For more details, refer to Custom Viewers for Scenarios.

Added Associated Network Pod and Deployment Views in Log Viewer Details Page¶

Guance supports selecting to view host, Pod, and Deployment data connection situations in the "Network" section of the log viewer details page.

Note: To view related networks in log details, matching corresponding fields is required.

Added Associated Network 48-Hour Data Replay Functionality in Viewer Details Page¶

In log, process, trace, host, Pod viewer details pages, associated network supports selecting the time control to replay 48-hour network data.

• Time Range: Default views data for 30 minutes before and after the current time. If it’s a current event, it defaults to viewing data from the last hour.
• Supports arbitrary dragging of the time range to view corresponding network traffic.
• After dragging, pausing the refresh, the time displayed is [Start Time - End Time]. The queried time range is 5 minutes. Clicking the "Play" button or refreshing the page returns to viewing the "last 10 minutes" processes.

Adjusted Unresolved Event Retention Policies, Supporting Manual Event Recovery¶

In the unresolved event list, hover over the event, and you can see the "Recovered" function on the right side of the event. Clicking "Recovered" recovers the event, and a recovery event is generated, showing the corresponding operator in that event.

Other Functional Optimizations¶

• Chart lock time added ["Latest 5 Minutes"] time range, time intervals added ["5s"]["10s"]["30s"] three second-level time selection options
• Scenario viewer display columns, view variable base object field properties/tags support custom input
• Adjusted associated dashboard position for event details
• Added time series count statistics in metric management
• Optimized log detail association with traces, displaying flame graphs and selecting all data corresponding to the span based on the trace_id and span_id in the log
• Optimized user access monitoring service display and interaction
• RUM, network, availability monitoring, CI viewers dropdown options adjusted to flat display
• Monitor event notification content supports template variable field mapping configuration, supports configuring template variable corresponding values through DQL query statements.
• Help center homepage added quick jump entries for key features

DataKit Updates¶

• Adjusted global tag behavior to avoid tag splitting in election collectors
• SQLServer collector added election support
• Line protocol filter supports all data types
• 9529 HTTP service added timeout mechanism
• MySQL
  • dbm metric set name adjustment
  • service field conflict issue
• Container objects added container_runtime_name field to differentiate container names at different levels
• Redis adjusted slowlog collection, storing its data as logs
• Optimized TDEngine collection
• Enhanced Containerd log collection
• Pipeline added Profile data support
• Container/Pod log collection supports appending tags via Label/Annotation
• Fixed Jenkins CI data collection time precision issue
• Fixed Tracing resource-type value inconsistency issue
• eBPF added HTTPS support
• Fixed possible crash issue in log collector
• Fixed prometheus collector leak issue
• Supports configuring io disk cache via environment variables
• Added Kubernetes CRD support

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

• Integration
  • Skywalking JVM observability best practices
  • Minio observability best practices

For more best practice updates, refer to Best Practice Version History.

June 21, 2022¶

Guance Updates¶

Guance Help Documentation Fully Launched¶

To enhance the reading experience of Guance help documentation, Guance help documentation has been migrated under the Guance domain, allowing you to simply and quickly view Guance help documentation. The new Guance help documentation address is: https://docs.guance.com/en.

Added Profile Observability¶

Profile supports collecting dynamic performance data of applications running in different language environments such as Java/Python, helping users view CPU, memory, and IO performance issues. To collect profile data, you need to install DataKit first and configure the Profile collector. After configuration, DataKit uploads collected profile data to your Guance workspace, where you can understand your program code performance through the real-time data viewer of Profile. For more details, refer to the documentation Profile.

Pipeline Covers Full Data Text Analysis Processing¶

Text processing (Pipeline) is used for data parsing. By defining parsing rules, various data types are cut into structured data that meets our requirements. In Guance workspace "Management" - "Text Processing (Pipeline)", click "Create Pipeline" to create a new pipeline file. For more details, refer to the documentation Text Processing (Pipeline).

Added Deployment Network Details and Network Distribution¶

Deployment network supports viewing network traffic between Deployments. It supports viewing source IP to destination IP network traffic and data connections based on IP/port, providing real-time visualization to help businesses understand the operational state of their business systems' networks, quickly analyze, track, and locate fault issues, preventing or avoiding business problems caused by network performance degradation or interruption.

After successful collection of Deployment network data, it reports to the Guance console. You can view Deployment network performance monitoring data information in the "Infrastructure" - "Containers" - "Deployment" details page under "Network"; in "Infrastructure" - "Network" - "Deployment", you can view the network distribution and data connections of all Deployments within the workspace. For more details, refer to Deployment Network.

Optimized Event Detection Dimension Jump to Other Viewers¶

In the unresolved event viewer, supports clicking detection dimensions to view related containers, processes, logs, traces, RUM, availability testing, security inspections, CI, etc. If the related viewer has no relevant data, the corresponding jump link appears grayed out and unclickable.

Added Log Viewer JSON-formatted Message Information Search¶

Log Viewer added searching JSON-formatted log content (message), with search format: @key.key:value.

Note: JSON search only supports this feature for workspaces created after the launch of this function.

Added User Access Monitoring Support for Custom Input app_id Information When Creating New Applications¶

Added custom application ID functionality. Supports custom input of app_id when creating new applications in user access monitoring, generating a unique application ID identifier for the current space, which can be used for distinguishing application types, data upload matching, etc.

• Application Name (mandatory): Used to identify the current user access monitoring application name.
• Application ID Identifier (optional): A unique application ID identifier within the current space, supports customization and can be used for data upload matching; the application ID identifier is limited to 20 characters and only supports inputting uppercase and lowercase letters.
• Application ID: If the application ID identifier is filled when creating the application, clicking "Create Application" will prepend the entered application ID identifier information to the front of the application ID, facilitating querying and filtering by distinguishing applications.

Optimized Process Detection to Infrastructure Object Detection¶

Process detection was optimized to infrastructure object monitoring, adding host, container, process, Pod, Deployment, Replicaset, Job, resource catalog, and other basic object selections for monitoring infrastructure object data in the workspace. For more details, refer to the documentation Infrastructure Object Detection.

Other Functional Optimizations¶

• Added CPU usage rate and memory usage amount fill indicators in cell mode for infrastructure POD viewers
• Optimized log blacklist configuration. Supports manually entering log sources as log blacklist sources
• Optimized query time component for service lists in application performance monitoring
• Optimized K8S installation guidance text, automatically adding the current workspace token in the DataWay data gateway address configuration
• Optimized UI style for monitor configuration

DataKit Updates¶

2022/06/21¶

• gitrepo supports passwordless mode
• prom collector
  • Supports log mode collection
  • Supports configuring HTTP request headers
• Supports collecting container logs exceeding 16KB length
• Supports TDEngine collector
• Pipeline
  • Supports XML parsing
  • Remote debugging supports multiple data types
  • Supports calling external Pipeline scripts via the use() function in Pipeline
• Added IP library (MaxMindIP) support
• Added DDTrace Profile integration
• Containerd log collection supports filtering rules via image and K8s Annotation configuration
• Document library overall switch

2022/06/16¶

• Log collection supports recording collection positions to avoid data loss due to DataKit restarts
• Adjusted Pipeline settings for handling different data types
• Supports receiving SkyWalking metric data
• Optimized log blacklist debugging function:
  • Displays filtered points in Monitor
  • Increases a .filter file in the datakit/data directory to record fetched filters
• Monitor increases DataKit opened file count display
• DataKit compiler upgraded to golang 1.18.3

2022/06/07¶

• Added TCP/UDP port detection collector
• DataKit and DataWay add DNS detection, supporting dynamic switching of DataWay DNS
• eBPF L4/L7 traffic data adds k8s deployment name field
• Optimized OpenTelemetry metric data
• ElasticSearch adds AWS OpenSearch support
• Line Protocol Restrictions string length limit relaxed to 32MB
• prom collector adds extra configuration, supporting ignoring specified tag=value matches to reduce unnecessary time-series timelines
• Sink adds Jaeger support
• Kubernetes-related metric collection defaults to all off to avoid excessive time-series timelines
• DataKit Monitor adds dynamic discovery (such as prom) collector list refresh

More DataKit updates can be found in DataKit Version History.

Best Practices Updates¶

• APM
  • GraalVM and Spring Native Project Achieve Trace Observability
• Integration
  • Host Observability Best Practices (Linux)

For more best practice updates, refer to Best Practice Version History.

Integration Template Updates¶

Added Documentation¶

• Alibaba Cloud
  • Alibaba Cloud NAT
  • Alibaba Cloud CDN

Added Views¶

• Alibaba Cloud
  • Alibaba Cloud NAT
  • Alibaba Cloud CDN

June 6, 2022¶

Guance Billing Update¶

Guance billing optimizes the Time Series billing logic and the data retention strategy for metric data. The original cost of 3 yuan per 300 items has been reduced to 3 yuan per 1000 items. At the same time, metric data has added 3-day, 7-day, and 14-day data retention strategies, and metric sets support custom data retention strategies.

The time series counts all combinations based on tags in the reported metric data of the current workspace. The data retention strategy refers to the data storage duration, which is the time the data is retained in the current workspace; data exceeding the storage duration will be automatically deleted.

The time series is fully counted, i.e., the daily generated time series accumulates sequentially during the data retention period, and the longer the data retention period, the higher the time series cost.

This optimization reduces the cost of time series and shortens the data retention strategy for metrics, allowing you to flexibly adjust thedata retention strategy for metrics, helping you save costs.

Guance Updates¶

Added Jenkins CI Observability¶

Guance added Jenkins CI observability. You can directly view the results of Jenkins CI through Guance's CI visualization function. The CI process is continuous integration; when developers push code and encounter issues, they can view all CI pipelines, success rates, failure reasons, and specific failure stages in Guance to ensure code updates. For more details, refer to CI Visualization.

Added Custom Viewer Chart Synchronization Search¶

Custom viewers added a chart synchronization search switch, which decides whether the search conditions affect chart queries. It is enabled by default. When there is content in the search box, turning off the switch returns the chart query to its default state; turning it on makes the chart query affected by the filtered content.

Added Network Topology and Service Topology Drill-Down Analysis¶

In the infrastructure network topology diagram, click the host/Pod icon and then click "View Upstream and Downstream" to view the upstream and downstream node associations of the current node. In the upstream and downstream nodes, clicking the "Return to Overview" icon in the upper-left corner returns you to the original network topology diagram. Filtering or searching in the search box filters associated upstream and downstream nodes, displaying matching upstream and downstream node associations based on the search or filter results. For more details, refer to the documentation Network View Upstream and Downstream.

In the service topology diagram, click the service icon and then click "View Upstream and Downstream" to view the upstream and downstream service associations of the current service. In the upstream and downstream services, clicking the "Return to Overview" icon in the upper-left corner returns you to the original service topology diagram. Filtering or searching in the search box filters associated upstream and downstream services, displaying matching upstream and downstream service associations based on the search or filter results. For more details, refer to the documentation Service View Upstream and Downstream.

Added Deletion of Resource Catalog Data and Indexes¶

Guance supports owners and administrators deleting specified resource catalog classifications and all resource catalogs. Navigate to "Management" - "Basic Settings", click "Delete Resource Catalog", choose the deletion method, and delete the corresponding object data.

• Specified Resource Catalog Classification: Only deletes data under the selected object classification without deleting indexes
• All Resource Catalogs: Deletes all resource catalog data and indexes

Note: Once all resource catalogs are deleted, all uploaded data and indexes for infrastructure customization will be permanently deleted and cannot be recovered. All set resource catalog classification data needs to be re-uploaded, with a daily limit of five deletions for all resource catalogs.

For more information on resource catalogs, refer to the documentation Customization.

Added Snapshot Viewing Entry for Viewers¶

In Guance metrics, logs, events, application performance monitoring, user access monitoring, cloud testing, security inspection, CI visualization, etc., viewers can directly click the snapshot view icon in the upper-right corner to slide out and view already saved snapshots.

• Supports keyword searching of snapshot names via fuzzy matching of related snapshot names
• The first one is the default view and does not support sharing, copying links, or deletion functions
• Except for the first default view, other snapshots support sharing, copying links, and deletion functions; clicking the "Snapshot Name" opens the corresponding data copy in the current viewer

Added Viewer Filter Condition Editing Functionality¶

In Guance viewers, when filtering using the "field:value" method in the search bar, you can click "field:value" to edit and modify "field:value" and filter based on the modified results.

Optimized User Access VIEW Viewer Associated Traces as Fetch/XHR¶

In Guance's user access monitoring VIEW viewer detail page, switching to "Fetch/XHR" allows you to view every network request made by the user to the backend application, including occurrence time, request trace, and duration.

If the network request has a corresponding trace_id, there will be a prompt icon before the request. Clicking the request allows you to jump to the corresponding trace detail page.

Added High-Performance Mode for Chart Data Loading¶

Guance supports high-performance mode for chart data loading, which is disabled by default. You can enable it under "High-Performance Mode" in the lower-left corner account settings. After enabling high-performance mode, all charts do not dynamically load data. Instead, they load all at once upon entering the page. This means that when scrolling down to view data beyond the current page, all charts have already been fully loaded, allowing direct viewing of the display results.

Note: Enabling high-performance mode applies only to the current user viewing charts.

Added Alert Configuration Event Notification Levels¶

Alert configuration supports custom selection of event notification levels, including critical, important, warning, recovery, data gap, data gap recovery, and data gap treated as recovery (7 options). Multiple selections are supported, along with one-click clearing of options. After clearing, manual selection of corresponding values is required. For more alert configurations, refer to the documentation Alert Settings.

Other Functional Optimizations¶

• Combined chart support for hiding/showing large titles in scenario dashboards
• Optimized event detail page event type text display
• Infrastructure list views added field sorting functionality
• Log viewer added hide distribution chart button
• Viewer supports searching display columns via keywords, supporting custom display columns as preset fields. After cutting fields and reporting data through Pipeline, the reported data can be displayed directly.
• Added one-click viewing of corresponding integration documents in built-in template libraries and built-in views to help you quickly configure collectors
• Built-in views support binding link services, applications, log sources, projects, labels, and related views. Additionally, they now support custom key and value binding for related views and side-sliding service details page binding to built-in views.
• Optimized Lark robot notification objects, supporting custom security checks for keys
• If the configured data range is less than the detection frequency when configuring monitors, a prompt indicates potential data gaps.

DataKit Updates (2022/05/26)¶

• Pipeline adjustments allow all data types to be processed via Pipeline configuration
• grok() supports extracting fields directly into specified types, eliminating the need for additional cast() function conversions
• Pipeline added multiline string support, improving readability by writing long strings (such as grok regular expression cuts) over multiple lines
• Each Pipeline's execution status can be directly viewed via datakit monitor -V
• Added Kubernetes Pod CPU/memory metrics
• Helm added more Kubernetes version installation compatibility
• Optimized OpenTelemetry, adding JSON support for HTTP protocols
• DataKit automatically records correction behaviors during automatic line protocol corrections, facilitating debugging of data issues
• Removed all string metrics from time-series data
• If election namespaces are configured in DaemonSet installations, participating collectors will have specific tags (election_namespace) added to their data
• CI observability added Jenkins support

Breaking Changes¶

For Docker container log collection, the host (Node) path /var/lib must be mounted into DataKit (since Docker logs default to /var/lib/ on the host), and the following configurations should be added to datakit.yaml:

volumeMounts:
- mountPath: /var/lib
  name: lib

# Omitted other parts...

volumes:
- hostPath:
    path: /var/lib
  name: lib

More DataKit updates can be found in DataKit Version History.

Best Practices Updates¶

• APM
  • Using SkyWalking with Guance to achieve RUM, APM, and log联动analysis
• Monitoring Best Practices
  • Building Observability with OpenTelemetry
  • OpenTelemetry to Jaeger, Grafana, ELK
  • OpenTelemetry to Grafana
  • OpenTelemetry to Guance
• Guance Tips
  • OpenTelemetry Sampling Best Practices

Integration Template Updates¶

Added Documentation and Views¶

• Data Collection
  • Opentelemetry Collector
• Container Orchestration
  • Kubernetes Scheduler
  • Kubernetes Controller Manager
  • Kubernetes API Server
  • Kubernetes Kubelet

Added Views¶

• Container Orchestration
  • Kubernetes Nodes Overview
• Middleware
  • JVM Kubernetes

May 19, 2022¶

Guance Updates¶

Optimized Guance Commercial Edition Registration Process¶

Guance registration provides Free Plan and Commercial Plan registration options, allowing you to register an Guance account according to your actual needs. Guance supports pay-as-you-go billing, providing you with an out-of-the-box cloud platform to achieve comprehensive observability.

Added Scenario Dashboard User View Template Library¶

Guance includes over 60 built-in system view templates. Without configuration, these templates are ready-to-use and meet various monitoring scenarios. You can customize views as user view templates to create dashboards with one click.

Added Scenario Custom Viewer Log Sources and Filtering Linkage¶

The data scope of the custom viewer in scenarios added filtering functionality. Based on log sources, you can filter fields under the log source, supporting matching multiple field data, combined with searches and groupings for further log data filtering.

Added Option to Copy Event Detail Page Content as JSON Format¶

On the event detail page, you can click the "Copy Complete Event Content" button to obtain all key data corresponding to the current event. If a dashboard is associated in the monitor configuration, you can click the "Associated Dashboard" button to jump to the corresponding dashboard.

In the "Associated Information" section of the event detail page, if "Log Detection" configures multiple expression queries (of the same object type), the associated information supports tab switching for multiple expression queries. If there are two expression queries A and B, the relationship information contains tabs A and B for switching views.

Added Log Data Desensitization Processing¶

Guance added log data desensitization processing. After data is collected and reported to the Guance workspace, some sensitive information may exist, such as IP addresses and user information. You can configure sensitive fields for desensitization processing targeting this information.
Note:

• Desensitized data is only viewable by workspace administrators and above; standard and read-only members cannot view desensitized information.
• Configuring sensitive fields is only operable by workspace administrators and above; standard and read-only members can only view configured sensitive fields.

Optimized Log Viewer and Detail Pages¶

Guance Log Viewer defaults to showing "time" and "message" fields. This optimization supports hiding the "message" field display.

In the log detail page, log content automatically displays Json and text viewing modes based on the message type. If the log does not have a message field, the log content part is not displayed. The log content supports expanding/collapsing, defaulting to expanded status, and collapsing shows only one row height.

Extended fields display all relevant fields of the log, supporting "copy" and "add to filter" for quick filtering and viewing.

Added Network Data Monitoring Monitor¶

Network Data Monitoring is used to monitor metric data of network performance within the workspace. By setting threshold ranges, alerts are triggered when the metrics reach the threshold. "Guance" supports setting alerts and custom alert levels for single metrics. In Monitors, click «+ Create Monitor», select «Network Data Monitoring», and enter the detection rule configuration page.

Optimized Built-in View Binding Functionality¶

Guance built-in views include system views and user views. This optimization cancels custom binding of system views as viewer views, supporting only binding user views as viewer views. To bind system views, clone the system view as a user view first. If system and user views have the same name, the user view takes precedence in the viewer. For how to bind user views as viewer views, refer to the documentation Bind Built-in Views.

Other Functional Optimizations¶

• Paid Plans and Billing added prepaid card balance
• Infrastructure detail style optimization
• Trace detail page attribute wrap display optimization
• Monitor configuration template variable display optimization
• Added quick entry, DQL query and snapshot menu moved to quick entry
• Guance management backend added template management category information

DataKit Updates (2022/5/12)¶

• eBPF added arm64 support
• Line protocol construction supports automatic error correction
• DataKit main configuration added example configuration
• Prometheus Remote Write supports tag renaming
• Merged community edition DataKit features, mainly including Sinker functionality and filebeat collector
• Adjusted container log collection; DataKit now directly supports collecting stdout/stderr logs from containers under containerd
• Adjusted hostname acquisition strategy in DaemonSet mode
• Trace collector supports wildcard service name (service) filtering for resources (resource)

For more DataKit updates, refer to DataKit Version History.

Best Practices Updates¶

• Cloud Native
  • Use Guance to start Rancher observability journey with one click
• Microservices Observability Best Practices
  • Kubernetes cluster applications using SkyWalking to collect trace data
  • Best practices for logging reports to the same node’s DataKit in Kubernetes clusters
• Gitlab-CI Observability Best Practices
  • Gitlab-CI Observability Best Practices

For more best practice updates, refer to Best Practice Version History.

Integration Template Updates¶

Added Documentation and Views¶

• Middleware
  • Resin
  • Beats
• Host System
  • Procstat

Added Views¶

• Container Orchestration
  • Istio Service
• Alibaba Cloud
  • ASM Service

May 6, 2022¶

Guance Updates¶

Optimized Guance Commercial Edition Upgrade Process¶

Upgrading Guance to the commercial edition defaults to opening Guance Billing Center Account Settlement, supporting changing the settlement method to cloud account settlement, including Alibaba Cloud Account and AWS Cloud Account settlement methods.

Added Process, Log, and Trace Details Page Associated Network¶

Guance Process, Log, Trace details pages added associated network data analysis, supporting viewing source host/source process service to target network traffic and data connection situations based on IP/port, providing real-time visualization to help businesses understand the operational status of their business systems' networks, quickly analyzing, tracking, and locating fault problems, preventing or avoiding business problems caused by network performance degradation or interruption.

Scene Module Optimization¶

Optimized Dashboards, Removed Edit Mode¶

In the scene Dashboard top navigation bar, removed the "Edit" button and added "Add Chart" to add new charts to the dashboard. After adding the chart, click the "Finish Adding" button in the upper right corner.

In Charts, click the "Settings" button and choose "Modify" to edit the chart.

Added Chart Link Display Switch¶

Guance supports internal and custom links for charts, helping you jump from the current chart to the target page. Internal links are provided by Guance by default, mainly based on the current query time range and grouping tags, helping you view corresponding logs, processes, containers, traces. The display switch for internal links is disabled by default and can be enabled during chart editing; custom links created have their display switch enabled by default. For more details, refer to the documentation Chart Links.

Optimized Conversion Between DQL Query and Simple Query¶

Click the toggle button next to DQL Query to switch DQL Query to simple query.
Note: When switching DQL Query to Simple Query, if parsing fails or is incomplete:

• In Simple Query, if no changes are made, switching back to DQL Query will show the previous DQL query statement;
• In Simple Query, after adjusting the query statement, switching back to DQL Query will parse according to the latest Simple Query.

For more applications of DQL Query and Simple Query, refer to the documentation Chart Queries.

Monitors and Events Module Optimization¶

Added Event Associated Information¶

Guance supports viewing related information triggering the current event, such as viewing logs related to the triggered event. This associated information only supports events generated by four types of monitors: log detection, security inspection anomaly detection, process anomaly detection, and availability data detection.

Added Data Gap Event Title and Content Configuration¶

Guance monitors "Threshold Detection", "Water Level Detection", "Range Detection", "Mutation Detection", "Process Anomaly Detection", "Application Performance Metric Detection", "User Access Metric Detection" added data gap event title and content configuration, defaulting to non-editable. When choosing to trigger a data gap event, you can fill in the data gap event name, supporting the use of predefined template variables. For more details, refer to Event Title/Content Templates.

Optimized Availability Data Detection¶

Guance monitor Availability Data Detection, optimized to support selecting HTTP, TCP, ICMP, WEBSOCKET probe types.

Optimized Alert Notification Templates, Added Associated Jump Links¶

Emails, DingTalk, WeChat, Lark received alert notifications include "Guance jump link". Clicking it jumps directly to the Guance event details, with the time range being the last 15 minutes prior to the current time. For instance, for an event at 18:45:00, clicking the link jumps to the event details page with a fixed time range of 4.20 18:30:00 ~ 4.20 18:45:00. For more alert notifications, refer to the documentation Alert Settings.

Other Functional Optimizations¶

• Optimized service servicemap metric query performance
• Added numerical field support > | >= | < | <= | [] 5 writing methods in the viewer
• Added label cascading filtering support in the metric viewer
• Optimized DQL query return error prompts

DataKit Updates¶

• Filtering functionality of the process collector only affects metric collection, object collection remains unaffected
• Optimized DataKit sending DataWay timeout issues
• Optimized Gitlab collector
• Fixed log collection truncation issue
• Fixed various trace collectors reload partial configuration ineffectiveness issues

More DataKit updates can be found in DataKit Version History.

Integration Template Updates¶

Added Redis Sentinel Data Storage Integration Documentation and Views¶

Redis-sentinel observation scenarios mainly display Redis cluster, slaves, and node distribution information.

April 26, 2022¶

Guance Updates¶

Optimized SSO Single Sign-On¶

Guance supports users initiating SSO single sign-on based on workspaces. Users can log in by entering their company email, obtaining corresponding SSO login, and achieving verification login. In Guance workspace "Management" - "SSO Management" - "Enable", you can set up SSO single sign-on for employees. This optimization mainly includes the following points:

• A workspace changed from supporting creating multiple identity providers to only supporting configuring one SSO single sign-on. By default, the last updated SAML2.0 configuration is considered the final single sign-on entry point.
• If multiple workspaces configure the same identity provider (IdP) data, after SSO single sign-on, you can switch to view corresponding workspace data.
• When configuring SSO single sign-on, the "user whitelist" configuration was replaced with "email domain", requiring only the email suffix domain to match the user email suffix configured by the identity provider (IdP) for single sign-on.
• SSO single sign-on enabling, configuration updates, and deletions support email notifications and generate audit events.
• SSO single sign-on users support deletion and editing, where editing can upgrade permissions to "Administrator".

For more SSO single sign-on details, refer to the documentation SSO Management.

April 21, 2022¶

Guance Community Edition Launch¶

Guance Community Edition provides teachers, students, cloud computing enthusiasts, and other community users with a simple, easy-to-obtain, and feature-complete productized local deployment platform. Welcome to freely apply and download for trial use, building your own Guance platform and experiencing complete product functionalities.

Guance Updates¶

Added Gitlab CI Observability¶

Guance supports visualizing the process and results of built-in CI in Gitlab. You can directly view the CI results in Gitlab through Guance's CI visualization function. The CI process involves continuous integration, where developers push code. If issues arise, you can view all CI pipelines, success rates, failure causes, and specific failure stages in Guance, ensuring code update guarantees. For more detailed introductions, refer to CI Viewer.

Added Online Help Orbis Assistant¶

Guance Orbis Assistant supports quickly viewing basic introductions, advanced guides, best practices, DataKit, Func, etc., in the workspace. You can search by clicking provided keywords or directly inputting keywords in the search bar, helping you quickly obtain relevant document explanations. For more detailed introductions, refer to the documentation Help.

Added Dashboard Setting Refresh Frequency¶

Guance supports setting refresh frequencies for scenario dashboards. The initial refresh frequency defaults to 30 seconds, supporting 10 seconds, 30 seconds, and 60 seconds options. If the time control is "Paused," it will no longer refresh.

Added 48-Hour Playback for Processes¶

Guance infrastructure processes support viewing process data collected in the past ten minutes, and clicking the time range allows you to view 48-hour playback of processes. After dragging, pausing refresh, the time displayed is [Start Time - End Time], with the query time range being 5 minutes. Clicking the "Play" button or refreshing the page returns you to viewing processes from the "last ten minutes."

Added Integration DataKit Kubernetes(Helm) Installation Guide Page¶

In the Guance integration DataKit installation guide page, added a Kubernetes(Helm) installation guide, introducing how to use Helm to install DataKit in K8S.

Added Global Performance Overview, Service Category Filtering, Service Topology Map Distinguishing Environment and Version for Application Performance Monitoring¶

Application performance monitoring added a global performance overview view. You can view online service counts, P90 service response time, service maximum impact time, service error counts, service error rate statistics, as well as P90 service, resource, operation response time Top10 rankings, and service error rate, resource 5xx error rate, resource 4xx error rate Top10 rankings.

In the application performance service list, you can classify and filter by clicking the service type icon, restoring to full view with another click.

In the service list, switching to "Topology Map" mode allows you to view the calling relationships between different services. It supports drawing trace topology maps based on service (service) and service environment version (service+env+version) dimensions. After enabling "distinguish environment and version," the service topology map is drawn according to different environments and versions. For instance, with canary releases, by enabling environment and version, you can view service calling situations under different environment versions.

Optimized SSO Single Sign-On Configuration¶

SSO single sign-on configuration changed the user whitelist to email domains, used to verify if the email suffix entered at the single sign-on matches, allowing matched emails to obtain the SSO login link online. For more SSO configuration details, refer to the documentation SSO Management.

Other Functional Optimizations¶

• Added "All Sources" option for associated logs in trace detail pages
• Added reverse selection support for metric filtering, adjusted aggregation function position
• Optimized generation of metrics for logs, application performance, user access, and security inspections, where the "frequency" selected time also serves as the aggregation period
• Canceled the transfer of ownership functionality for Guance deployment edition workspaces, supporting backend management settings
• Optimized alert notification SMS templates
• Optimized creation of availability monitoring probes, supporting direct selection of HTTP, TCP, ICMP, WEBSOCKET probes

DataKit Updates¶

• Fixed Grok dynamic multi-line pattern issues in the Pipeline module
• Optimized Helm installation for DaemonSet, added pprof environmental variable configuration support, all default enabled collectors in DaemonSet support environmental variable configuration
• Preliminary support for Pipeline data processing in the Tracing collector.
• Added failure task exit mechanism in the test collection collector
• Added unknown level (status) to logs, where logs without specified levels are marked as unknown
• Fixed:
  • Cluster field naming issue
  • Namespace field naming issue
  • If Pod Annotation does not specify log source, DataKit will infer the log source based on this priority
  • Object reporting is no longer limited by 32KB character length (due to Annotation content exceeding 32KB), all Kubernetes objects have removed annotation

More DataKit updates can be found in DataKit Version History.

Best Practices Updates¶

• Microservices Observability Best Practices
  • Full lifecycle best practices from development to canary release for service mesh microservice architecture (Part 1)
  • Full lifecycle best practices from development to canary release for service mesh microservice architecture (Part 2)
  • Full lifecycle best practices from development to canary release for service mesh microservice architecture (Part 3)
• Monitoring Best Practices
  • JAVA OOM Exception Observability Best Practices

More best practice updates can be found in Best Practice Version History.

Integration Template Updates¶

Added Documentation and Views¶

• Application Performance Monitoring (APM)
  • Node.JS
  • Ruby
• Middleware
  • RocketMQ
• Container Orchestration
  • Istio
  • Kube State Metrics
• Data Storage
  • Aerospike

Added Views¶

• Container Orchestration
  • Kubernetes Overview by Pods
  • Istio Mesh
  • Istio Control Plane
• Alibaba Cloud
  • Alibaba Cloud ASM Mesh
  • Alibaba Cloud ASM Control Plane
  • Alibaba Cloud ASM Workload
• Middleware
  • RocketMQ

April 8, 2022¶

Guance Billing Update¶

Added Alibaba Cloud Account Settlement Method¶

In Guance Billing Center "Manage Workspace", you can view all bound workspaces under the account, and modify the settlement method of already bound workspaces. Through "Change Settlement Method," you can switch between Guance Billing Center Account, Amazon Cloud Account, and Alibaba Cloud Account settlements arbitrarily.

Guance Updates¶

Added DQL Query Viewer¶

DQL is a language specifically developed for Guance. It has simple syntax and is convenient to use, allowing data queries in Guance workspaces or terminal devices using DQL language.

In Guance workspace, click the "DQL Query" in the menu bar to open the DQL Query Viewer, or use the shortcut key Alt+Q to directly open DQL Query. The DQL Query Viewer supports table and JSON return results, saving 7-day historical query records.

Added TCP/ICMP/Websocket Probe Protocol to Availability Monitoring¶

Guance supports custom probe tasks. By creating probe tasks based on different protocols like HTTP, TCP, ICMP, WEBSOCKET, it comprehensively monitors network performance, network quality, and network data transmission stability for various services across different regions and carriers.

Added Infrastructure Network Module¶

In infrastructure, the original host network Map and Pod network Map were moved from the host and container modules to the newly added "Network" module, supporting viewing the network Map for hosts and Pods. The filled indicators for Pod network Map added seven-layer network indicators: requests per second, error rate, and average response time. More details can be found in the documentation Network.

Added HTTP Seven-Layer Network Data Display for Infrastructure Container Pods¶

Infrastructure container Pods added HTTP seven-layer network data collection and display. After successful Pod network data collection, it reports to the Guance workspace. In "Infrastructure" - "Container" - "Pod" detail page under "Network," you can view the entire Pod network performance monitoring data information in the workspace. For more details, refer to the documentation Pod Network.

Added Quick Filter "Reverse Selection" and "Reset" Functions in Viewers¶

In any viewer's "Quick Filter," you can perform "Reverse Selection" or "Reset" when selecting field filter content. "Reverse Selection" hides the selected field filter content (clicking "Reverse Selection" again restores the selected state), and "Reset" clears the filter conditions. For more details, refer to Log Viewer Quick Filters.

Optimized Log Blacklist¶

Guance supports filtering out logs that meet conditions through a log blacklist configuration, meaning that logs meeting the blacklist conditions will no longer be reported to the Guance workspace, helping users save on log data storage costs.

Log blacklist optimization supports matching all log sources and provides two blacklist configuration methods:

• Trigger blacklist filtering if any one of the filter conditions is met
• Trigger blacklist filtering if all filter conditions are met

For more blacklist configurations, refer to the documentation Log Blacklist.

Other Functional Optimizations¶

• Added span quantity statistics in trace detail pages
• Optimized timeline drawing method for trace-associated hosts
• Optimized overview chart time slicing, canceled options. If the previous overview chart had time slicing enabled, it will default to disabling time slicing after optimization
• Optimized combination chart editing inability to switch different chart queries while in browser zoom mode
• Optimized manual pause of page refresh in log viewers, where rolling to the top does not trigger auto-refresh

DataKit Updates¶

• Increased memory limits for runtime on host machines, supporting memory limit configuration during installation,
• CPU collector added load5s metric
• Supported Guance optimized log blacklist functionality, adjusting monitor layout and increasing blacklist filtering situation display
• DaemonSet installation added Helm support, added best practices for DaemonSet installation
• eBPF added HTTP protocol collection, eBPF collection no longer installs by default on host installations (if needed, use specific installation commands), DaemonSet installation is unaffected

For more DataKit updates, refer to DataKit Version History.

Guance Mobile App Updates¶

Added site login capabilities, optimized scenario and event viewers, maintaining the same access experience as the web version.

• Supports users selecting accounts corresponding to sites, logging in via account password or verification code.
• Supports users viewing all or any source log data
• Supports users viewing all dashboards in the current space and switching via dropdown menus to "All Dashboards," "My Favorites," "Imported Projects," "My Creations," and "Frequently Browsed" for quick filtering and finding corresponding dashboards.
• In the Events viewer, users can view, search, and filter all unresolved event contents triggered by the anomaly detection library through "All"; through "My Events," view unresolved events currently notified to users via email, DingTalk bots, Enterprise WeChat bots, Webhook, etc.

Best Practices Updates¶

• Guance Tips
  • Multi-Microservice Project Performance Observability Practice
  • Advanced Usage of ddtrace
  • Mapping DataKit Services Using ExternalName in Kubernetes Clusters
• Integration Best Practices
  • Best Practices for Integrating OpenTelemetry Trace Data
• Microservice Observability Best Practices
  • Best Practices for Achieving Microservice Observability with Alibaba Cloud ASM

For more best practice updates, refer to Best Practice Version History.

Integration Template Updates¶

Added Alibaba Cloud PolarDB Oracle Integration Documents, Views, and Monitors¶

Alibaba Cloud PolarDB Oracle indicator display includes CPU usage rate, memory usage rate, network traffic, connection count, IOPS, TPS, data disk size, etc.

Added Alibaba Cloud PolarDB PostgreSQL Integration Documents, Views, and Monitors¶

Alibaba Cloud PolarDB PostgreSQL indicator display includes CPU usage rate, memory usage rate, network traffic, connection count, IOPS, TPS, data disk size, etc.

Added Alibaba Cloud RDS SQLServer Integration Documents, Views, and Detection Libraries¶

Alibaba Cloud RDS SQLServer indicator display includes CPU usage rate, disk usage rate, IOPS, network bandwidth, TPS, QPS, etc.

Added DataKit Integration Documents, Views, and Monitors¶

DataKit performance indicator display includes CPU usage rate, memory information, runtime, log records, etc.

Added Nacos Integration Documents and Views¶

Nacos performance indicator display: Nacos online duration, Nacos config long connections, Nacos config count, Service Count, http request counts, etc.

March 24, 2022¶

Guance Site Updates¶

Guance supports multi-site login and registration, adding an "Overseas Zone 1 (Oregon)" site. The original "China Zone 1 (Alibaba Cloud)" was renamed to "China Zone 1 (Hangzhou)", and the original "China Zone 2 (AWS)" was renamed to "China Zone 2 (Ningxia)".

Different sites' accounts and data are mutually independent and cannot be shared or migrated. You can choose the appropriate site based on your resource usage. Currently, Guance supports the following three sites. For how to choose sites, refer to the documentation Guance Site Description.

Guance Updates¶

Added Workspace Data Authorization¶

Guance supports authorizing data from multiple workspaces to the current workspace through data authorization, querying and displaying through chart components in scenario dashboards and notes. If you have multiple workspaces, after configuring data authorization, you can view data from all workspaces in one workspace. For more configuration details, refer to the documentation Data Authorization.

1. Configure the workspace whose data needs to be authorized for viewing under "Management" - "Data Authorization".

2. After the workspace obtains data authorization, open "Scenarios" - "Dashboards or Notes," select the chart component, and in "Settings," choose the authorized workspace under "Workspace." Then, you can view and analyze data from the authorized workspace through chart queries.

Added Saving Online Pipeline Sample Test Data¶

Guance Pipelines support self-defined and official libraries in two forms:

• After writing custom Pipeline script rules, you can input log sample data for testing to verify if your configured parsing rules are correct. After saving the custom Pipeline, the log sample test data is saved synchronously.
• Official Pipeline libraries come with multiple log sample test data. Before "Cloning," you can choose the log sample test data that suits your needs. After modifying and saving the cloned Pipeline, the log sample test data is saved synchronously.

For more details about online Pipeline functionality, refer to the documentation Pipelines.

Optimized Resource Catalog Viewer¶

In Guance workspace, through "Infrastructure" - "Custom" - "Add Object Classification," you can create new object classifications and resource catalog classification names and object fields.

After adding resource catalog classifications, you can report custom data through the Func Function Processing Platform. For how to report data to the Guance workspace through Func, refer to the documentation Resource Catalog Data Reporting.

Optimized Snapshot Sharing Supporting Permanent Valid Links¶

Snapshot sharing supports setting validity periods, allowing you to choose "48 hours" or "Permanent Validity." In the snapshot list, click the share button to perform advanced settings like "Hide Top Bar" in the pop-up dialog box. For more snapshot sharing details, refer to the documentation Snapshots.

Note: Permanent validity sharing can easily pose data security risks, so please use it cautiously.

Optimized Chart Time Intervals¶

In the chart settings of scenario dashboards, choose "Automatic Alignment" for time interval selection. When previewing charts, a time interval option appears in the top-right corner of thechart, allowing you to select time intervals based on your actual situation to view your data.

Optimized Data Gap Trigger Strategies for Process, Application Performance, and User Access Detection¶

In Guance's monitoring functional modules, when configuring process anomaly detection, application performance metric detection, and user access metric detection monitors, the data gap state supports three configurations: "Trigger Data Gap Event," "Trigger Recovery Event," and "Do Not Trigger Event." Manual configuration of data gap handling strategies is required.

Other Functional Optimizations¶

• Optimized integration guidance pages for DataKit and Func
• Optimized full display of single log in the log viewer
• Added associated search NOT combinations in viewers
• Optimized member permission display editing

DataKit Updates¶

• Added DataKit command-line completion functionality to help with command prompts and parameter completions during terminal operations
• Allowed DataKit upgrades to non-stable versions to experience the latest experimental features; use caution if upgrading in a production environment
• Preliminarily supported data collection under Kubernetes/Containerd architecture
• Network testing added TCP/UDP/ICMP/Websocket protocol support
• Adjusted Remote Pipeline storage in DataKit locally to avoid file name case issues caused by different file systems
• Pipeline added decode() function, avoiding the need to configure encoding in the log collector and enabling encoding conversion within the Pipeline; add_pattern() added scope management

More DataKit updates can be found in DataKit Version History.

Best Practices Updates¶

• Scenario Best Practices
  • RUM Data Reporting DataKit Cluster Best Practices
• Log Best Practices
  • Pod Log Collection Best Practices

For more best practice updates, refer to Best Practice Version History.

Integration Template Updates¶

Added Alibaba Cloud PolarDB Mysql Integration Documents, Views, and Detection Libraries¶

Alibaba Cloud PolarDB Mysql indicator display includes CPU usage rate, memory hit rate, network traffic, connection count, QPS, TPS, and read-only node delay, among others.

March 10, 2022¶

Guance Billing Update¶

Added Guance Billing Prepaid Cards¶

Guance prepaid cards support purchases through account cash balance, applicable to all Guance consumption modes, including pay-as-you-go and annual subscription packages. Log in to Guance Billing Center, click "Manage Prepaid Cards," and enter the prepaid card management page to purchase. After purchasing and paying for the prepaid card, invoices are issued according to the actual payment amount. For more details, refer to Prepaid Card Management.

Guance Updates¶

Added User Access Monitoring Resource (Resource), Action (Action), Long Task (Long Task), Error (Error) Viewers¶

User access monitoring viewers help you view and analyze detailed information about user visits to applications. In Guance workspace, open "User Access Monitoring," click any application, and use the "Viewer" to understand each user session, page performance, resources, long tasks, errors affecting users, and help comprehensively understand and improve the operational status and usage of the application through searches, filters, and associated analyses, enhancing user experience.

Guance user access monitoring viewers include session (Session), view (View), resource (Resource), action (Action), long task (Long Task), error (Error).

Added Pod Network Details and Network Distribution¶

Pod networks support viewing network traffic between Pods. It supports viewing source IP to destination IP network traffic and data connections based on IP/port, providing real-time visualization to help businesses understand the operational status of their business system networks, quickly analyzing, tracking, and locating fault issues, preventing or avoiding business problems caused by network performance degradation or interruption.

After successful collection of Pod network data, it reports to the Guance console. In "Infrastructure" - "Containers" - "Pod" detail page under "Network," you can view network performance monitoring data information for all Pods in the workspace. For more details, refer to Pod Network.

In "Infrastructure" - "Containers" - "Pod," clicking the small icon in the upper-left corner of the network distribution map switches to viewing Pod network distribution. In the "Network Distribution Map," you can visually query network traffic between current workspace Pods, quickly analyzing TCP latency, TCP fluctuations, TCP retransmission counts, TCP connection counts, and TCP closure counts between different Pods. For more details, refer to Pod Network Distribution Map.

DataKit Updates¶

• DataKit collector added support for SkyWalking, Jaeger, Zipkin data sampling strategy configurations.
• DataKit collector added support for OpenTelemetry data ingestion.
• DataKit documentation library added an introduction to overall log collection, including obtaining logs from disk files, through calling environment APIs, remote pushing logs to DataKit, and Sidecar-style log collection.

Breaking Changes¶

2022/03/22

• Major adjustments were made to Tracing data collection involving several incompatible aspects:
  • The ignore_resources field in the DDtrace original conf needs to be changed to close_resource, and the field type changes from array ([...]) form to dictionary array (map[string][...]) form.
  • The tag type field in the original DDTrace data changes to source_type.

2022/03/04

• If the old version of DataKit had RUM enabled, after upgrading, the IP library must be reinstalled as the old IP library will no longer work.

2021/12/30

• Using datakit --version in the old version of DataKit has been unable to push new upgrade commands. Use the following commands directly:

• Linux/Mac:

DK_UPGRADE=1 bash -c "$(curl -L https://static.guance.com/datakit/install.sh)"

• Windows

$env:DK_UPGRADE="1"; Set-ExecutionPolicy Bypass -scope Process -Force; Import-Module bitstransfer; start-bitstransfer -source https://static.guance.com/datakit/install.ps1 -destination .install.ps1; powershell .install.ps1;

More DataKit updates can be found in DataKit Version History.

SDK Updates¶

User access monitoring compatible with Opentracing protocol link tracking tools, Web, mini programs, Android, iOS SDKs support OTEL, SkyWalking, Jaeger, etc., link tracking tool data linkage.

Best Practices Updates¶

• Custom Access Best Practices
  • Quick Start Guide for pythond Collector Best Practices
  • Alibaba Cloud "Cloud Monitoring Data" Integration Best Practices
• Log Best Practices
  • Logback Socket Log Collection Best Practices

For more best practice updates, refer to Best Practice Version History.

Scene Template Updates¶

Added MySQL Database Viewer Template for Custom Scene Viewer¶

The custom scene viewer in Guance added a MySQL database viewer template, helping you quickly set up a MySQL log viewer. In Guance workspace "Scenarios" - "Viewers" - "Built-in Viewer Templates," click "MySQL Viewer Template" to directly create a MySQL log viewer. If related logs have already been collected, you can immediately view and analyze data through this log viewer.

Integration Template Updates¶

Added Host System EthTool Integration Documentation and Views¶

EthTool indicators include network interface inbound/outbound traffic, inbound/outbound packets, dropped packets, etc.

Added Host System Conntrack Integration Documentation and Views¶

Conntrack performance indicators include successful search entry counts, inserted packet counts, connection counts, etc.

February 22, 2022¶

Added Log Configuration Pipeline Script¶

Pipeline is used for log data parsing, defining parsing rules to cut format-diverse logs into structured data meeting our requirements. Guance provides three log Pipeline text processing methods:

• DataKit: After installing DataKit on the server, configure DataKit's log collector and corresponding pipeline file in the terminal tool to process text data;
• DCA: DataKit Control APP, a desktop client application for DataKit, requires installation first. After installation, you can view and edit default log pipeline files brought by DataKit and manually add custom pipeline files;
• Pipelines: Supports manual configuration and viewing of log pipeline files in Guance workspaces without needing to log into the DataKit server for operations.

Added IFrame Chart Component¶

Guance added the IFrame chart component, supporting you to configure https or http link addresses. You can directly input external network addresses in the IFrame URL, or use template variables in the IFrame URL to view, for more configuration details refer to the documentation IFrame.

Added Event Detail Historical Records, Associated SLO¶

Observation event detail pages optimized basic attributes, status & trends, and associated events layout, and added historical records and associated SLO. Clicking on the event name in the abnormal event list allows you to view these.

Added historical records for events, supporting viewing detection object hosts, abnormal/recovery times, and duration.

If SLO is configured in the monitor, then you can view associated SLO, including SLO name, compliance rate, remaining quota, target, etc.

Added Default Absolute Time When Saving Snapshots¶

Guance added default absolute time when saving snapshots.

• If absolute time is selected when saving snapshots, sharing shows the absolute time when the snapshot was saved. For example, if you choose the last 15 minutes and open the snapshot link at 14:00, it displays the absolute time data from before;
• If absolute time is not selected when saving snapshots, sharing shows the absolute time when the snapshot was saved. For example, if you choose the last 15 minutes and open the snapshot link at 14:00, it displays data from 13:45 to 14:00.

For more snapshot sharing details, refer to the documentation Snapshots.

Optimized Monitor Data Gap Trigger Event Configuration and Trigger Condition Unit Prompts¶

Guance added three data gap status configurations: "Trigger Data Gap Event," "Trigger Recovery Event," "Do Not Trigger Event."

• When configuring metric data monitors, manual configuration of data gap handling strategies is required;
• When configuring log data monitors, the "Trigger Recovery Event" strategy is selected by default, requiring no data gap configuration. Obtain the cycle from the "Normal" condition as the data gap recovery event cycle;

Optimized Chart Query Expression Calculation Units¶

Guance optimized the logic of chart query expression calculation units. If query A carries units, the result of query A and numbers also carry units. For example, if A's unit is KB, then the unit of A+100 is also KB. For more details, refer to the documentation Chart Queries.

Added "Timeline" Pay-As-You-Go Mode¶

Guance added "Timeline" pay-as-you-go mode and optimized "DataKit + Timeline" pay-as-you-go mode. Specific billing modes can be referenced in the documentation Pay-As-You-Go.

Other Optimization Functions¶

• Chart query data sources for logs, application performance, security inspections, and networks support full selection (*);
• Chart query caption, button styles, and text prompts optimized;
• Workspace operation buttons iconified, such as edit, delete, etc.;
• Other UI display optimizations.

January 20, 2022¶

Added Open API and API Key Management¶

"Guance" supports obtaining and updating Guance workspace data via Open API interfaces. Before calling API interfaces, you need to create an API Key as an authentication method. For more details, refer to the documentation API Key Management.

Added Metric Dictionary and Metric Unit Management¶

After collecting metric data, you can view all collected metric sets and their metrics and tags in the Guance workspace under "Metric Dictionary," supporting manual setting of units for custom metric data. For more details, refer to the documentation Metric Dictionary.

• Metrics help you understand the overall availability of the system, such as server CPU usage, website load times, etc. Combined with Guance provided logs and traces, they help you quickly locate and resolve faults.
• Tags help you associate data; Guance supports reporting all metrics, logs, and traces uniformly to the workspace, associating queries by tagging collected data with the same tags. This helps perform associated analysis, discovering and resolving potential risks.

Added Funnel Chart for Scene Charts¶

Funnel charts are generally suitable for normative, long-term, multi-stage process analysis. Comparing data across stages allows intuitive contrasts. Additionally, funnel charts are suitable for website business process analysis, displaying the final conversion rate of users from entering the website to making a purchase, along with the conversion rate at each stage. For more details, refer to the documentation Funnel Chart.

Added Saving Dashboards to Built-in Views and Binding Label Data¶

After creating a dashboard view, you can click the "Settings" button and choose "Save to Built-in View" to save the dashboard view to the built-in view's "User View."

When saving a dashboard view to the built-in view, you can choose to bind relationships, selecting the binding relationship "label." After saving to the built-in view, you can view the saved dashboard view in Guance workspace "Management" - "Built-in View" under "User View." Since the binding relationship label:* is set, infrastructure settings with "Label Attributes" on hosts and containers detail pages can view bound built-in views. For more details, refer to the documentation Save Dashboard as Built-in View.

Added Container Details Page Related Pod¶

In the container details page, you can view related Pod (associated fields: pod_name) basic information and performance indicator status within the selected time component range. More container-related queries can be found in the documentation Container.
Note: To view related Pods in container details, you need to match the "pod_name" field; otherwise, you cannot view related Pod pages in container details.

Added Monitor Group Management¶

Guance added group functionality, allowing you to customize meaningful monitor combinations during setup, supporting filtering monitors via "Groups," facilitating group management of various monitors.

Note: - Each monitor must select a group during creation; by default, "Default Group" is selected; - When a group is deleted, monitors under that group automatically revert to the "Default Group."

Added Log Viewer, Table Chart, Log Stream Chart Formatting Configuration¶

Guance added formatting configuration, allowing you to hide sensitive log content or highlight necessary log content, and quickly filter by replacing original log content. Supports formatting configuration in log viewers, table charts, and log stream charts.

Optimized Mute Management, Added Disable/Enable Rules¶

Guance added mute rule disable/enable functionality, helping you quickly disable/enable mute tasks. For more details, refer to the documentation Mute Management.

• Enabled: Mute rules follow normal procedures
• Disabled: Mute rules do not take effect; if mute notifications are set and the notification operation has not yet executed (e.g., "xx minutes" before start), the notification will not execute

Note: Enabling/disabling rules generates operational audit events, which can be viewed in Guance workspace "Management" - "Basic Settings" under operational audits.

Added Log Pipeline User Manual¶

Guance added a log pipeline user manual, helping you understand how to use DataKit's built-in debugging tools to assist in writing Pipeline scripts.

Debugging Script Example¶

datakit --pl datakit.p --txt '2022-01-12T18:40:51.962+0800 WARN diskio diskio/input.go:320 Error gathering disk info: open /run/udev/data/b252:1: no such file or directory'

Successful Extraction Example¶

Extracted data(drop: false, cost: 3.108038ms): { "code": "diskio/input.go:320", "level": "WARN", "message": "2022-01-12T18:40:51.962+0800 WARN diskio diskio/input.go:320 Error gathering disk info: open /run/udev/data/b252:1: no such file or directory", "module": "diskio", "msg": "Error gathering disk info: open /run/udev/data/b252:1: no such file or directory", "time": 1641984051962000000 }

Added Outer Functions to DQL¶

Guance added two outer functions rate() and irate().

• rate(): Calculates the average rate of change for a specific metric over a certain time range. Suitable for alerts and slowly moving counters.
• irate(): Calculates the instantaneous rate of change for a specific metric over a certain time range, suitable for drawing volatile, fast-changing counters.

For more details, refer to the documentation DQL Outer Functions.