Release Notes (2023)¶

This document records the release notes for each Guance上线活动, including DataKit, best practices for Guance, integration documentation for Guance, and more.

December 28, 2023¶

Guance Updates¶

• Monitoring:
  • Added Smart Detection for User Access: supports performance anomalies and error analysis for websites/apps, with related metrics such as LCP, FID, and CLS.
  • Infrastructure Uptime Detection V2: introduced version 2 of infrastructure uptime detection, optimized detection logic to resolve several triggering issues between V1 and process detection.
• Real User Monitoring (RUM):
  • Added a new method to receive RUM data through Public DataWay, eliminating the need to install collectors; web-type applications support direct upload of SourceMap in the console, allowing uploads of multiple files based on different versions and environments.
  • Error Explorer > Error Details: added a Formatted error message page that displays error messages parsed from the Sourcemap file, supports switching between formatted and raw formats. If no Sourcemap file is configured or does not match after upload, only raw format error messages will be displayed.
• Application Performance Monitoring (APM):
  • Optimized Service Map: adjusted display styles for viewing upstream/downstream, nodes, and service names.
  • Optimized Service Details: binds performance view dashboards to display current service performance metrics, similarly supports custom user views with the same name for updates, and supports drill-down analysis.
  • Optimized flame graph and waterfall chart display in Trace Details: added execution time and percentage display to the flame graph; waterfall charts now support switching between relative and absolute time displays.
• Chart Optimization:
  • Added Display Column configuration to Time Series Tables: allows users to set query data display columns and supports manually entering column names; supports manual adjustment of column widths in edit mode, which are saved for future displays; supports drag-and-drop reordering of display columns.
  • Added Value Variables to chart links for navigation purposes.
• Dashboard:
  • Added Home Dashboard to Dashboards: supports configuring home dashboards for workspaces.
• Infrastructure:
  • Added an Online Hosts Only switch filter to Host Explorer: optimizes logic for retrieving online host lists, supporting selection of whether to list hosts that reported data in the last 10 minutes only.

Guance Deployment Edition Updates¶

• Supports embedding Guance pages within external platforms, enabling hiding of left and header menus and floating operations using parameters in the URL.
• Supports embedding Guance dashboards or explorers via iframe from external platforms.

New Integrations¶

• Added Kubecost integration.

December 14, 2023¶

Guance Updates¶

• Monitoring:
  • Added Smart Monitoring:
    • Host Smart Detection: supports sudden CPU spikes/drops/increases over intervals, memory spikes/drops/increases over intervals.
    • Log Smart Detection: supports log volume spikes/drops and spike detection for error logs.
    • Application Smart Detection: supports request volume spikes/drops, error request spikes, and request latency spikes/drops/increases over intervals.
  • Change Point Detection: added prerequisite conditions for trigger rules, performing change point detection rules when the detected value meets these conditions, improving monitoring accuracy.
• Billing & Plans:
  • Added a Data Forwarding Usage Analysis list: displays the forwarding volumes for all data forwarding rules in the current workspace. If the forwarding rule is for Guance backup logs module, it shows the corresponding retention policy. It also supports filtering by time widget to easily view historical log backup situations.
• Incidents:
  • Added a Smart Monitoring incident explorer: enables viewing all incident information generated by smart monitoring.
• Logs:
  • Added [Show Only Rules Related to Me] configuration under Data Access: displays only access rules affecting the current account's data queries when enabled.
  • Logs > Explorer: added a data access rule restriction prompt.
• Infrastructure > Containers > Kubernetes:
  • Added a Kubernetes analysis dashboard: container object analysis dashboard to help understand various infrastructures in Kubernetes from different dimensions.
  • Container > Explorer: UI optimization.
• Metrics:
  • Metrics > Explorer:
    • Added [Query Tool] mode to table charts: results are consistent with Quick Access > Query Tool; if multiple queries are added, returns results from the first query by default; supports exporting up to 1000 query records in this mode.
    • Added [Copy] function for query conditions to improve page experience.
    • Query component optimization: simple query [by group] supports drag-and-drop reordering.
• Explorer:
  • Adjusted all explorers to hide trend graphs in analysis mode.
• SSO:
  • Optimized SSO user workspace listing logic and fixed auto logout issue due to lack of access permissions.

Guance Deployment Edition Updates¶

• Added Independent Alert Notification Sending configuration: when this configuration is enabled, each event sends a separate alert notification when "Alert No Aggregation" option is selected in alert strategies, helping you efficiently manage alert notifications.
• Added 免登 Event Link Viewing configuration: when this configuration is enabled, all event-related links sent in alerts from the workspace can be accessed without login. If disabled, previously sent免登 links become invalid, ensuring data security.
• Optimized Scheduled Reports: supports customizing query ranges, extending the maximum range from 30 days to 360 days, meeting extended needs for scheduled reports.

New/Updated Integrations¶

• Added APISIX
• Updated Alibaba Cloud KafKa
• Updated DM

November 30, 2023¶

Guance Updates¶

• Monitoring:
  • New Monitor > Event Content > Insert Link: supports automatically generating jump links based on detected metrics, allowing adjustment of filtering conditions and time ranges after inserting the link; supports custom jump links.
  • Alert Strategy Management: added [Smart Aggregation] mode, allowing clustering and grouping events occurring within cycles based on "title" or "content", with each group generating one alert notification.
• Management:
  • Overall style optimization for the module menu page.
  • Added [Attribute Claims]: helps quickly identify and perform associated queries globally through fixed fields organization and business.
  • Added [Regular Expressions]: allows switching between [Custom] and [Template Library] lists; supports users creating custom regular expression templates applicable to [Snapshot Sharing] and [Data Access Rules].
  • Ticket Management:
    • Changed ticket management from "account-level" to "workspace-level", allowing all members to view all tickets within the workspace.
    • Added [All Tickets] list, [Submitter], and [My Tickets] list.
  • Workspace Management: added risk confirmation prompt for disbanding a space.
  • Workspace Description functionality has been decommissioned.
  • Data forwarding: query and statistics adjustments optimization
    • Query side: adjusted content display data range, defaulting to show all data except time;
    • Some robustness optimizations were made to the data forwarding feature.
• Logs:
  • Data Access:
    • Added data masking rules, supporting configuration of multiple fields and application of multiple regular expressions;
    • Supports configuring all [Indexes] and [Roles];
    • Added mask preview to judge whether the rule meets requirements.
• Snapshots > Share Snapshot:
  • Added effective times of 1, 3, and 7 days for sharing links, defaulting to 1 day;
  • Data Masking: supports configuring multiple fields and applying multiple regular expressions;
  • Supports snapshot preview, allowing advance viewing of all configured page effects.
• RUM: layout adjustment on the [New App] page to optimize usage experience.
• Pattern Analysis:
  • RUM > Error Explorer & APM > Error Tracking: changed aggregation logic in pattern analysis mode to drain() algorithm; added input box to modify cluster fields, defaulting to error_message, allowing up to 3 fields, or customizing cluster fields as needed.

Guance Deployment Edition Updates¶

• Added support for customizing email headers/footer and logo text display;
• Guance will no longer support Banner information settings and related maintenance support.

New Integrations¶

• Added logstash

New Best Practices¶

• Best Practice for Bidirectional Integration Between Incident Tracking and JIRA

November 21, 2023¶

Guance Updates¶

• Management: added MFA Security Authentication switch on the [Settings] page. Once administrators/owners enable this feature, all users (regular members / SSO members) must complete MFA authentication before entering the space.

Guance Deployment Edition Updates¶

• Added MFA Security Authentication switch, supporting identity verification through system default or custom methods.

November 16, 2023¶

Guance Updates¶

• Monitors:
  • The ["Alert Mute"] feature has returned, still allowing configuration of the interval for repeated alert notifications through alert mute settings.
  • Removed the requirement to configure either "Urgent," "Important," or "Warning" trigger conditions; now supports configuring any one of Urgent, Important, Warning, Data Gap, or Information triggers.
  • Infrastructure Uptime Monitoring: supports configuring infrastructure uptime detection via metric configuration, enabling definition of higher frequency uptime detection configurations through this mode.
• Scenarios:
  • Charts:
    • Advanced Settings: parameter configuration for [Original Interval] has been retired, default configuration adjusted to [Auto Alignment], supporting custom selection of default time intervals for chart data.
    • Time Series Chart: changed [Display Density] to [Maximum Returned Points], defaulting to 720, supporting defining any integer between 2 and 1000.
    • Fixed the issue where alias functionality became ineffective after PromQL linked view variables.
  • Service Management:
    • Added built-in drop-down switch, allowing direct selection and switching of services without returning to the list.
    • POD page on the details page has been retired.
    • Resource Invocation performance chart changed to composite chart display, optimizing page presentation experience.
• Management:
  • SSO Management:
    • During SSO login, workspaces support listing all authorized workspaces under the current [Identity Provider ID]; supports directly locating the target workspace through the [Search] function.
    • User SSO added [Import/Export] functionality, enabling quick configuration of single sign-on settings across multiple workspaces.
  • Workspace Language:
    • Default console display language logic adjusted, defaulting to follow browser language settings.
    • When modifying the workspace language version, event, alert, SMS, and other notification templates will also use the modified language template.
• Event correlation incident tracking added linkage identifiers:
  • In the unresolved event list, icons can be used to understand whether the current event is linked to any incident tracking.
  • Incident Tracking: if there are events created and linked by monitors, icons can quickly show the number of linked events.
• Infrastructure > Host: optimized inaccurate sorting of host explorer metric data.
• Pipeline usage experience several optimizations:
  • Added prompts indicating already configured Pipeline script in the data source selection column;
  • Added "Index" selection for testing sample data retrieval in logs to solve the problem of failing to retrieve sample data when not using the default index.

Guance Deployment Edition Updates¶

• Single Sign-On: supports dynamically appending phone number information based on user information returned during OIDC login.

New Integrations¶

• Added argocd, fluentd, redis-sentinel

November 9, 2023¶

Guance Updates¶

• Monitors > Alert Strategy Management:
  • Notification Configuration: logic changed to configure single or multiple notification targets per anomaly level.
  • Recovery notification logic changes: after historical sent abnormal alarm events recover, Guance will send recovery notifications to the corresponding notification targets.
  • Added [Alert Aggregation]: supports aggregating alert notifications based on rules, two aggregation methods are available:
    • No Aggregation: in this mode, every 20 seconds, a summary of events is combined into one alert notification sent to the corresponding notification target;
    • Rule Aggregation: four aggregation rules can be selected and notifications sent based on the aggregation cycle.
  • Added [Aggregation Cycle]: in rule aggregation mode, events added within 1-30 minutes will be aggregated into one notification, while events added beyond the aggregation cycle will be aggregated into new alert notifications.
• Management > Data Forwarding: supports custom time range queries, allowing selection of multiple dates and defining start and end times.

November 2, 2023¶

Guance Updates¶

• Management:
  • SSO Management: supports Single Sign-On Configuration with OIDC / OAuth2.0 protocols;
  • Data Permission Management: added [Role] when granting authorization, after configuring roles, data viewing in authorized workspaces will be restricted based on selected role scopes, determining query access limitations and masking restrictions for data.
• Data Forwarding:
  • Navigation location moved to the [Management] module, still accessible through secondary menus under [Logs], [User Access Monitoring], and [Application Performance Monitoring].
  • AWS S3 and Alibaba Cloud OSS support "Cross-Account Authorization" configuration, enabling mutual data permission grants between two accounts, simplifying configuration processes.
• Billing & Plans:
  • Supports data forwarding to Guance internal storage, recording the daily capacity size of data stored in Guance storage objects during billing.
• Events > Unresolved Events:
  • Currently, the unresolved events list retains event data within the past 24 hours;
  • Added display preferences: defaults to [Standard] mode, supports selecting [Extended] mode to open historical trends of event detection values;
  • Supports exporting the current event list to CSV;
  • Added Extended Fields tab in event details page; basic attributes tab page optimized.
• Infrastructure > Network:
  • Optimized [Overview] template, added quick filters, allowing users to filter network paths. Added 5 statistical charts, supporting analysis of sent/received bytes, TCP retransmissions, and other network metrics;
  • Added [Network Flow] explorer, allowing viewing of all L4(netflow), L7(httpflow) network flow data on timelines;
  • Other explorer detail pages added [Topology] mode display, allowing direct viewing of current object's upstream and downstream network relationships and key network metrics.
• Scenarios:
  • View Variables: supports adding PromQL query;
  • Charts:
    • Added Data Sampling for Doris data storage workspaces;
    • Time auto-alignment function optimized: for all metric data and Doris data chart queries, when time auto-alignment is enabled, return data timestamps will align to "whole seconds/whole minutes/whole hours";
    • Top List, Overview Chart, Table Chart: added [Rule Mapping], allowing configuration of font color/background color for data within mapped value ranges.
  • Explorer: analysis mode optimized, supporting free aggregation queries based on data and displaying analysis in chart form;
  • Service Management > Resource Invocation: resource ranking list added [Requests Per Second] option.
• Availability Monitoring > Tasks: supports import/export.
• Doris log data engine temporarily does not support with_labels joint queries.

Guance Deployment Edition Updates¶

• Supports custom session expiration duration configuration, uniformly setting Login Session Persistence Time for front-end users.

October 19, 2023¶

Guance Updates¶

• Billing & Plans: billing item [Data Forwarding] statistic logic changed to count forwarded data volume based on data forwarding rules.
• Management:
  • SSO Management: supports creating multiple SSO IDP configurations, and supports enabling/disabling individual IDP configurations, enabling SAML mapping.
  • Data Permission Management > Sensitive Data Masking: supports configuring sensitive data masking rules at the role level, adopting regular expression masking during configuration, supporting masking rule configuration for fields under certain data types, and adding masking rule preview testing.
• Monitors: added External Event Detection, generating Guance event data by sending abnormal events or records from third-party systems to an HTTP server via POST requests using a specified URL address.
• Scenarios:
  • Service Management > Resource Invocation: added quantity sorting for corresponding lists, defaulting from largest to smallest;
  • Chart Links: added start and end time parameters based on currently selected data points, variables being #{timestamp.start} and #{timestamp.end};
  • Chart Aliases: configured based on legend series;
  • Table Chart: added [Time Series Table Chart].
• Metrics > Metric Analysis: table chart added [Time Series Mode].

Guance Deployment Edition Updates¶

• Added Custom Mapping Rule Configuration: enabling this configuration allows corresponding workspaces to customize mapping rules. Workspace custom mapping rules have higher priority than backend management system mapping rules;
• Added Maximum Query Count: customized query limits for different users' workspaces to avoid cluster query performance degradation due to excessive data querying, impacting product usability;
• Local accounts added password change capability.

Integration Updates¶

• Integration of Abnormal Events with PagerDuty: when our applications or systems encounter abnormalities, they often require timely handling to ensure normal system operation. To better manage and track abnormal events, we can create events in PagerDuty by sending these events to it, allowing us to track, analyze, and resolve these issues within PagerDuty. By quickly creating events in PagerDuty for abnormal events, we gain better capabilities for managing and tracking abnormal events, thus better ensuring normal system operation. At the same time, this method also helps us analyze and resolve issues more effectively, enhancing system stability and reliability.

September 26, 2023¶

Guance Updates¶

• Scenarios > Service Management: added [Upstream/Downstream Topology] component to resource invocation, allowing users to view current resource invocation relationships upstream and downstream.
• Logs > Data Forwarding: data forwarding rule queries support RUM and APM data.

September 21, 2023¶

Guance Updates¶

• Logs:
  • Data Forwarding: added external storage forwarding rule data query; supports enabling/disabling forwarding rules;
  • Binding Index: added label binding for LogEase, achieving finer-grained data scope query authorization capabilities.
• Infrastructure > Custom:
  • The concept of [Default Attributes] was changed to [Required Attributes]: uploaded data must include this attribute field, otherwise uploading will fail;
  • Supports adding resource catalogs to secondary menus for easier viewing.
  • Custom Explorer added quick filtering.
• Scenarios:
  • Scheduled Reports: added three notification methods: [DingTalk][WeCom][Lark];
  • Charts: added data formats for [Time Series Chart, Pie Chart, Bar Chart, Histogram, Scatter Chart, Bubble Chart, Table Chart, TreeMap, Funnel Chart, Top List, Map, Honeycomb Chart], allowing definition of [Decimal Places] and [Thousands Separator].
• Monitoring > Notification Target Management: Email Group type deprecated, existing ones unaffected.
• Snapshots: Sharing Snapshots: added IP Whitelist access restrictions.
• Incident Tracking: [Severity Level] supports custom creation; supports enabling/disabling default severity levels.
• Integrations > Extensions: DataFlux Func Managed Version and RUM Headless now support overseas sites: Oregon, Frankfurt, Singapore.

Integration Updates¶

Huawei Cloud:

• Huawei CCE: Guance supports monitoring various resources' running status and service capabilities in CCE, including Containers, Pods, Services, Deployments, Clusters, Nodes, Replica Sets, Jobs, Cron Jobs, etc. You can install DataKit in Kubernetes through DaemonSet method to complete data collection for Kubernetes resources. Ultimately, monitor the running status of various resources in Kubernetes in real-time within Guance.

• Huawei CSS(Elasticsearch): Core performance metrics for Huawei Cloud search service CSS for Elasticsearch include query latency, indexing speed, search speed, disk utilization, and CPU utilization, which are key indicators for evaluating and optimizing Elasticsearch performance.

• Huawei SYS.AS: Core performance metrics for Huawei SYS.AS include CPU utilization, memory utilization, disk I/O, network throughput, and system load, which are key indicators for evaluating and optimizing auto-scaling system performance.

• Huawei ASM: Huawei Cloud ASM's trace data is output to Guance for viewing and analysis.

AWS:

• AWS CloudFront: Core performance metrics for AWS CloudFront include total number of requests, data transfer volume, HTTP error rate, cache hit rate, and latency, which help users evaluate and optimize content delivery network performance.

• AWS MediaConvert: AWS MediaConvert includes data transmission, video errors, job counts, padding, etc.

• AWS Aurora Serverless V2: AWS Aurora Serverless V2 includes connection count, IOPS, queue, read/write latency, and network throughput.

• AWS Redshift: Core performance metrics for AWS Redshift include query performance, disk space utilization, CPU utilization, database connections, and disk I/O operations, which are key indicators for evaluating and optimizing data warehouse performance.

• AWS Simple Queue Service: Display metrics for AWS Simple Queue Service include approximate existence time of the oldest undeleted message in the queue, number of delayed messages that cannot be read immediately, number of messages in flight, and number of messages retrievable from the queue.

• AWS Timestream: Display metrics for AWS Timestream include system error count (internal service error count), sum of invalid requests in the current AWS region and account, time taken for successful requests along with sample count, amount of data stored in memory, and amount stored in magnetic storage.

• AWS Neptune Cluster: Display metrics for AWS Neptune Cluster include cold start time, execution time, concurrent executions count, and memory usage, which reflect Neptune Cluster functions' response speed, scalability, and resource utilization.

September 7, 2023¶

Guance Updates¶

• Scenarios > Dashboards/Explorers: added global cross-workspace query configuration.
• Scenarios > Chart Queries: automatic alignment interval added "1 second" display when time widget range is less than or equal to [Last 15 Minutes].
• Scenarios > Service Management:
  • Added binding of multiple built-in views to analysis dashboards in the service list; added associations and team information;
  • Added resource invocation analysis dashboard;
  • Supports saving snapshots.
• Logs > Backup Logs:
  • Officially renamed to Data Forwarding;
  • Added link and user access data sources;
  • Original backup logs billing item name renamed to data forwarding billing item.
• Logs > Explorer: added entry to create monitor; supports saving snapshots from explorer detail pages.
• Management:
  • Global Tags: added global tag functionality for unified tag management;
  • Field Management: added aliases, set display columns;
  • Workspace Management: functional consolidation and page optimization;
  • Member Management: original member groups officially renamed to teams;
  • Sensitive Data Scanning: added scan rule count statistics; added jump links.
• Monitoring:
  • Availability Data Detection: added test metrics, can detect based on [metric] dimension;
  • Change, outlier, interval detection: supports selecting all data sources.
• Added data limit prompt: when logs, traces, etc., reach today's limit, data reception will stop; contact your account manager for adjustments.

Integration Updates¶

Alibaba Cloud:

• aliyun_analyticdb_postgresql: Alibaba Cloud AnalyticDB PostgreSQL metrics display, including CPU, memory, disk, coordination node, instance query, etc.
• aliyun_clickhouse_community: Alibaba Cloud ClickHouse metrics display, including service status, log traffic, operation count, overall QPS, etc.
• aliyun_kafka: Alibaba Cloud KafKa includes message throughput, latency, concurrent connections, and reliability, reflecting Kafka's performance and reliability in handling large-scale message delivery and real-time data streams.
• aliyun_lindorm: Includes high throughput, low latency data read/write capabilities, supports high concurrency transaction processing, as well as strong consistency and highly reliable data storage and query services.
• aliyun_polardb_1.0: Alibaba Cloud PolarDB distributed 1.0 display metrics include CPU utilization, memory utilization, network bandwidth, and disk IOPS.
• aliyun_polardb_2.0: Alibaba Cloud PolarDB distributed 2.0 displays metrics for compute layer and storage nodes, including CPU utilization, connection utilization, disk usage, disk utilization, memory utilization, network bandwidth, etc.
• aliyun_rds_postgresql: Alibaba Cloud RDS PostgreSQL metrics display, including CPU utilization and memory utilization.
• aliyun_rocketmq5: Alibaba Cloud RocketMQ 5.0 display metrics include message throughput, latency, reliability, and horizontal scaling capabilities.

AWS:

• aws_dynamodb_DAX: AWS DynamoDB DAX display metrics include CPU utilization of nodes or clusters, bytes received or sent on all network interfaces, number of data packets, etc., reflecting DynamoDB DAX's operational status.
• aws_memorydb: AWS MemoryDB core performance metrics include low-latency in-memory read/write capabilities, high-concurrency transaction processing capabilities, and linearly scalable storage capacity and throughput.

Huawei Cloud:

• huawei_functiongraph: HUAWEI FunctionGraph display metrics include number of invocations, number of errors, number of rejections, concurrency, number of reserved instances, runtime (including maximum runtime, minimum runtime, average runtime), etc., reflecting FunctionGraph function runtime.
• huawei_kafka: Includes message throughput, latency, concurrent connections, and reliability, reflecting Kafka's performance and reliability in handling large-scale message delivery and real-time data streams.
• huaweiyun_SYS_DDMS: 'Huawei Cloud SYS.DDMS monitoring view display metrics include message throughput, latency, concurrent connections, and reliability, reflecting DDMS's performance and reliability in handling large-scale message delivery and real-time data streams.'

Tencent Cloud:

• tencent_keewidb: Tencent Cloud KeeWiDB metrics display, including connection count, requests, caching, keys, slow queries, etc.
• tencent_mariadb: Includes high-performance read/write capabilities, low-latency query response time, and support for high-concurrency transaction processing and scalability.
• tencent_memcached: Includes high-speed in-memory read/write capabilities, low-latency data access time, and high-concurrency access processing capabilities.
• tencent_tdsql_c_mysql: Includes high-throughput read/write capabilities, low-latency query response time, and support for high-concurrency transaction processing and scalability.

Others:

• openai: OpenAI's display metrics include total number of requests, response time, request count, request error count, and token consumption.
• monitor_jira: When our applications or systems encounter abnormalities, they usually require timely handling to ensure normal system operation. To better manage and track abnormal events, we can send these events to Jira to create events, allowing us to track, analyze, and resolve these issues within Jira. By quickly creating events in Jira for abnormal events, we gain better capabilities for managing and tracking abnormal events, thus better ensuring normal system operation. At the same time, this method also helps us analyze and resolve issues more effectively, improving system stability and reliability.

August 29, 2023¶

Guance Updates¶

• Scenarios > SLO Charts: added failure time display.
• Deployment Edition: added option in management backend mapping rules to apply rules only to newly joined members. When users enable this option, mapping rules apply only to first-time joining members.

August 24, 2023¶

Guance Updates¶

• Billing Items:
  • Backup Logs: added four archive type billing items - OSS, OBS, AWS S3, Kafka. Based on the user-selected archive type, it summarizes and forwards the traffic size and bills accordingly;
  • Application Performance Trace, User Access PV added 30-day/60-day data storage policies.
• Monitoring:
  • Silence Rules: supports configuring alert silences based on different dimensions.
  • Monitors: supports adding tags to monitors, filtering lists based on tags; added quick filter columns to the monitor list and optimized the list;
  • SLO: added Failure Time display column.
• Logs > Backup Logs: added external storage for Kafka Message Queue.
• Explorers/Dashboards: added auto-refresh feature.
• Explorer Detail Page: added entry to bind built-in views.

Integration Updates¶

• Alibaba Cloud RDS MariaDB: display metrics for Alibaba Cloud RDS MariaDB include response time, concurrent connections, QPS, and TPS.
• Alibaba Cloud RocketMQ4: display metrics for Alibaba Cloud RocketMQ 4.0 include message throughput, latency, reliability, and horizontal scaling capability.
• Alibaba Cloud Tair Community Edition: display metrics for Alibaba Cloud Tair Community Edition include CPU utilization, memory utilization, proxy total QPS, network traffic, hit rate, etc.
• AWS DynamoDB: display metrics for AWS DynamoDB include throughput capacity units (Capacity Units), latency, concurrent connections, and read/write throughput, reflecting DynamoDB's performance and scalability in handling large-scale data storage and access.
• AWS EventBridge: display metrics for AWS EventBridge include event delivery latency, throughput, event scale, and scalability, reflecting EventBridge's performance and reliability in handling large-scale event streams and real-time data delivery.
• AWS Lambda: display metrics for AWS Lambda include cold start time, execution time, concurrent executions, and memory usage, reflecting Lambda function response speed, scalability, and resource utilization.
• HUAWEI SYS.AS: display metrics for HUAWEI SYS.AS include response time, concurrent connections, throughput, and reliability, reflecting SYS.AS's performance and stability in handling application requests and data interactions.
• HUAWEI SYS.CBR: display metrics for HUAWEI SYS.CBR include bandwidth utilization, latency, packet loss rate, and network throughput, reflecting CBR's performance and quality assurance in network transmission and bandwidth management.
• Huawei Cloud GaussDB-Cassandra: display metrics for Huawei Cloud GaussDB-Cassandra include read/write throughput, latency, data consistency, and scalability, reflecting GaussDB-Cassandra's performance and reliability in handling large-scale distributed data storage and access.
• Huawei Cloud GaussDB for MySQL: display metrics for Huawei Cloud GaussDB for MySQL include response time, concurrent connections, read/write throughput, and scalability, reflecting GaussDB for MySQL's performance and reliability in handling large-scale relational database operations.
• Huawei Cloud GaussDB-Influx: display metrics for Huawei Cloud GaussDB-Influx include write throughput, query latency, data retention policies, and scalability, reflecting GaussDB-Influx's performance and reliability in handling large-scale time-series data storage and queries.
• Huawei Cloud GaussDB-Redis: display metrics for Huawei Cloud GaussDB-Redis include read/write throughput, response time, concurrent connections, and data persistence, reflecting GaussDB-Redis's performance and reliability in handling high-concurrency data storage and caching.
• Huawei Cloud GaussDB SYS.GAUSSDBV5: Huawei Cloud GaussDB SYS.GAUSSDBV5 provides CPU, memory, disk, deadlock, SQL response time metrics, etc.
• Huawei Cloud MongoDB: display metrics for Huawei Cloud MongoDB include read/write throughput, latency, concurrent connections, and data reliability, reflecting MongoDB's performance and scalability in handling large-scale document storage and queries.
• Huawei Cloud RDS PostgreSQL: display metrics for Huawei Cloud RDS PostgreSQL include query performance, transaction throughput, concurrent connections, and data reliability, reflecting RDS PostgreSQL's performance and reliability in handling large-scale relational data storage and transaction processing.
• Tencent Cloud CKafka: display metrics for Tencent Cloud CKafka include message throughput, latency, concurrent connections, and reliability, reflecting CKafka's performance and reliability in handling large-scale message delivery and real-time data streams.
• Zadigx: display includes overview, automated build, automated deployment, automated testing, etc.
• Feishu and Incident Tracking Integration: to facilitate timely and convenient receipt of new Issues in incident tracking, you can create a Feishu, DingTalk, or WeCom robot in an internal group to receive reminders about new Issues or replies in incident tracking, helping to handle Issues promptly; you can also @ the bot to quickly reply to Issues, improving incident handling efficiency.

August 17, 2023¶

Guance Updates¶

• Management: added Sensitive Data Scanning function: achieves information masking by creating masking rules for data.
• Added billing item: Sensitive Data Scanning Traffic: based on scanning rules, calculates the original traffic size of scanned sensitive data (per GB/day).
• Billing & Plans: consumption analysis section was temporarily removed due to renovation and optimization.

August 10, 2023¶

Guance Updates¶

• Added billing item:
  • Scheduled Reports: billed based on the number of scheduled report sends per workspace per day.
• Scenarios:
  • Added *Service Management*: Service Management is a centralized entry point for accessing key information about all services. Users can view performance and business data for different services within the current workspace and all associated analyses, quickly locate and resolve service-related issues.
  • All charts support PromQL queries and expression queries.
• Logs: supports directly viewing Context Logs on the log details page; context search ranges can be selected.
• Explorer: when opening a detailed data page, supports one-click export of the current data as a JSON file.
• Application Performance Monitoring > Service > Call Topology: added a table showing upstream and downstream call relationships for the current service, displaying request count, average response time, and error count for one-way service relationships.
• Monitors > Threshold Detection: added Convert to PromQL Query for detection metrics.
• Infrastructure > Containers: added Kubernetes Events component to detail pages for Pods, Services, Deployments, Nodes, Replica Sets, Cron Jobs, and Daemonsets.

July 27, 2023¶

Guance Updates¶

• Scenarios > Dashboards: added Scheduled Report Function, allowing users to create reports based on specific dashboards and configure scheduled email sending.
• Added *Invite Members* entry in the navigation bar, allowing quick member invitations through this entry. On the management page, added Invitation Approval button. With this button enabled, after sending an invitation to a member, approval must be obtained before the member can join the workspace.
• Logs > Backup Logs adjustments:
  • Guance default archive type has been discontinued:
    • Newly created backup rules will no longer support the Guance default option;
    • Previously created backup rules remain valid.
  • Added support for backing up to external storage Alibaba Cloud OSS.
• Monitoring > New: supports saving monitors as custom template libraries, allowing users to quickly create similar monitor detections later.
• Monitoring > Create Monitor > Custom Creation: for all detection rules except [Change Detection][Range Detection][Outlier Detection], added [Last 12 Hours][Latest 24 Hours] options for detection frequency.
• *Incident Tracking: added **Delivery Channel configuration entry on the new Issue page, supporting multiple selections; added *Unknown** option for severity levels, defaulting to this option.
• To meet user data compliance requirements, Snapshots support field content masking through regex syntax.
• Scenario > Log Stream Chart added Copy as cURL and export to CSV functionality.
• Real User Monitoring > Explorer > Error: added *Pattern Analysis* function to easily view frequently occurring errors.
• Added data cap warning: when log, trace, etc., reach today's cap, data reception stops. Contact your account manager for adjustments.

July 11, 2023¶

Guance Updates¶

• Integration Upgrade: clicking any integration solution allows understanding of the full chain usage process from configuration setup, data collection to data application on the same page.
• *Monitor > Template* Function Optimization: supports creating or batch creating based on single detection rules; supports filtering based on detection library.
• Application Performance Monitoring > Traces: added Waterfall Chart Mode to the Span List page to help users analyze Span data information from a more intuitive perspective; *Service Call Relationships* changed from service level to service/resource level, drilling down to interface level to better analyze performance and calling issues, thereby helping users discover problems faster through interface-level calls.
• *Charts > Overview Chart: added thousand separator; in **Unit > Value, "Default" changed to "Ten Thousand Increment"; added empty value mapping in *Value Mapping**.
• *Charts > Tree Map*: added display value option, allowing direct display of query result values in the chart.
• *Charts > Add Link*: added query parameter, removed tags and search parameters.
• Application Performance Monitoring > Service list supports export.

Intelligent Inspection Update¶

Function Optimization:

• Application Performance Inspection: added default detection threshold change entry, now when enabling inspection, you can synchronize the trigger values for the services needing detection.
• RUM Performance Inspection: optimized root cause display logic in the page details module, making root cause localization more accurate after optimization.
• Workspace Asset Inspection: added default configuration (7 days), now enabling inspection doesn't require parameters to run.

Added Scripts:

• Cloud Message Queue RocketMQ4.0
• Huawei Cloud-CSS
• Huawei Cloud-RocketMQ
• Huawei Cloud-RabbitMQ
• Huawei Cloud-WAF-Event List
• Huawei Cloud-WAF-Event Overview

June 29, 2023¶

Guance Updates¶

This update simplified the registration process:

• International Site Guance Product Services officially launched, users can purchase through AWS Overseas Cloud Marketplace.

• International Site Guance products adopt a pricing system in US dollars. The data from workspaces registered under the Chinese site's Oregon region will be billed according to the adjusted prices.

• Guance's concept of Enterprise Account has been officially changed to Billing Center Account;

Other Updates:

• Snapshot Permissions: Read-only members support creating and deleting snapshots visible only to themselves.

June 20, 2023¶

Guance Updates¶

• RUM (Real User Monitoring) collector is used to collect user access monitoring data reported from web or mobile ends. Now provides RUM Headless One-Click Activation Service, achieving automated installation and deployment on Guance cloud hosts, automatically completing DataKit installation and RUM collector deployment. Just manually connect the application.
• Explorer: optimized interaction conversion logic for filtering and searching, allowing users to truly see what they get, and freely switch between UI and handwriting modes. Additionally: the DQL handwriting mode in the log explorer will be deprecated after the new version is launched.
• Logs > Backup Logs: added external storage type selection, supporting writing to S3(AWS) object storage and Huawei Cloud OBS data writing.
• Logs > Index: added LogEase data binding configuration entry.
• Dashboards/built-in views support root cause analysis and drill-down analysis.
• Management > Role Management: supports cloning existing user roles to reduce operation steps, quickly adding/removing permissions and creating roles.
• Infrastructure > Containers: added display of Daemonset object data, allowing dragging to change object classification display order.
• Infrastructure > Containers: Deployments and Pods support direct association with Kubernetes event logs, allowing direct viewing of specific log information in the detail page.
• Added Incident Tracking OpenAPI Interface.
• Management > Member Management list, Monitoring > Notification Targets Management > Email Groups, Incident Tracking > View Members, and all locations for selecting notification targets support searching by member nicknames.
• When work orders have status updates or new replies, customers are reminded via interface or email.
• Text input box illegal character or length limit prompt optimization.

Intelligent Inspection Update¶

• Added Inspection

  • AWS Cloudtrail Anomaly Event Inspection: AWS CloudTrail is a service used for tracking, logging, and monitoring AWS account activities. It records operations performed in the AWS account, including management console access, API calls, resource changes, etc. We can monitor CloudTrail error events to promptly discover potential security issues. For example, unauthorized API calls, denied resource accesses, abnormal authentication attempts, etc. This helps protect your AWS account and resources from unauthorized access and malicious activities; it also helps you understand the types, frequencies, and impact ranges of system faults. This helps you quickly identify issues and take appropriate corrective measures to reduce service downtime and business impact.

• Added Scripts

  • Guance Integration (Alibaba Cloud-RDS Error Logs): collects Alibaba Cloud RDS error logs for diagnosing RDS error information;
  • Filebeats Collector: collects FileBeats performance data for observing FileBeats performance, delay, etc.;
  • Logstash Collector: collects Logstash performance data for observing Logstash performance, delay, etc.

June 6, 2023¶

Guance Updates¶

• To further meet users' data viewing needs, the commercial plan for billing and plans added the Setting High Consumption Warning Function, added a consumption analysis list, supporting viewing various expenditure statistics.
• Added Menu Style Selection when creating a workspace, supporting selection of different workspace style attributes.
• Optimized log data access Permission-related Rule Adaptation, further clarifying multi-role data query permissions and permission control relationships.
• Added associated queries under Detection Dimensions in the basic attributes of event details pages, supporting viewing all field values of the current detection dimension.
• Alert strategy management supports sending different level alerts to different notification targets.
• Member Management added nickname note function to standardize member usernames within the workspace, supporting searching members by nickname notes.
• Pages such as dashboards, explorers, monitors, member management, sharing management added batch operation functions.
• Application performance monitoring services support changing colors and header sort adjustments.
• Logs, application performance monitoring > error tracking explorer pattern analysis supports sorting by document count, defaulting to descending order.
• Supports saving the selected language version to the browser locally, automatically displaying the last selected language version upon next login.
• Added frequency options for generating metrics, supporting selection of 1 minute, 5 minutes, 15 minutes.

Guance Deployment Edition Updates¶

• Management backend added Password Security Policy: added password length limit of 8 characters and password validity period function.

Intelligent Inspection Update¶

• Added Inspection

  • Workspace Asset Inspection: for service inspections, ensure services operate normally, promptly discover faults or anomalies, reduce business losses. Secondly, inspections help improve service availability and stability, discovering and resolving potential issues. They also help improve O&M efficiency, accelerate problem diagnosis and resolution, optimize resource allocation. Ensure business security. Through regular inspections of hosts, K8s, containers, etc., O&M personnel can ensure these services efficiently and stably support business, providing enterprises with a continuous and reliable operating environment.

• Added Script

  • Gitlab R&D Efficiency Analysis: based on code submission frequency and volume per submission in Gitlab, display team and personal R&D efficiency across dimensions of team, individual, and time.

June 1, 2023¶

Guance Updates¶

DataFlux Func is Guance's extended programming platform, used for synchronizing cloud platform data, function development, management, and execution. It now supports one-click activation of DataFlux Func Managed Version on all domestic sites. After activation, Func can be automatically deployed on cloud hosts, and the corresponding Func platform can be quickly accessed from the Integration in the workspace.

May 22, 2023¶

Guance Updates¶

• RUM application configuration added custom type and associated view analysis
• DQL functions support regular expression aggregation for data statistics display, added string regular expression parsing functions to extract fields based on regular expressions, determine whether sub-strings conforming to regular expressions exist in fields
• Added PromQL syntax query entry, supports querying time series data via PromQL Query
• show_tag_value() function supports querying associated labels for corresponding metric fields
• Mini Program SDK supports collecting startup parameter-related information; added custom adding Error.
• Status Page supports subscribing to fault notifications
• Added field management function, if relevant fields are selected in locations like monitors, chart queries, explorers, corresponding description and unit information will be displayed
• Metric Analysis added table function, supports downloading
• Ticket Status adjustment
• Added incident tracking guide page, channels added time range filtering
• Backup log optimization:
  • Add Backup rule entry moved to Backup Logs > Backup Management;
  • Added all backup logic: no filter means save all log data

Guance Deployment Edition Updates¶

• Management backend added audit event record

Intelligent Inspection Update¶

• Added Inspection

  • Cloud Idle Resource Inspection: cloud computing as a brand-new IT service approach has developed rapidly, providing convenient, fast, elastic IT infrastructure and application services for enterprises and individuals, bringing high efficiency and economic benefits. However, as cloud resources gradually become the main components of enterprise data centers, the problem of huge waste of cloud resources becomes increasingly prominent. Especially within enterprises, due to demand fluctuations and isolation between departments, some cloud resources cannot be fully utilized, forming a large number of idle resources. This situation causes rising cloud service costs, declining resource efficiency, and may even reduce security and performance levels. To better manage and optimize idle cloud resources to improve cloud computing usage benefits and resource utilization, conducting cloud idle resource inspections is very necessary. Through inspections, unnecessary resources in current cloud services can be discovered and handled in time, avoiding long-term unnecessary resource usage leading to cost increases, data leakage, poor performance, and other issues.

  • Host Reboot Inspection: host abnormal reboot monitoring is an important part of modern internet system O&M. On one hand, computer system stability and reliability are crucial for business smooth operation and user experience. When hosts encounter abnormal reboot issues, it may lead to system crashes, service interruptions, and data loss risks, thereby affecting business operations and user satisfaction. On the other hand, in cloud computing and virtualization environments, the number and scale of hosts continue to increase, system complexity keeps rising, and the probability of problems also increases. This requires system administrators to use relevant system monitoring tools for real-time monitoring and promptly discover and resolve abnormal reboot issues. Therefore, reasonably implementing host abnormal reboot monitoring can help enterprises quickly diagnose problems, reduce business risks, improve O&M efficiency, and enhance user experience.

• Function Optimization

  • Idle Host Inspection: added associated fee information for cloud host types.

More intelligent inspection updates can be found in Intelligent Inspection Version History.

April 27, 2023¶

Guance Updates¶

• Overview charts support displaying multiple同期对比dimensions simultaneously (daily同比/weekly同比/monthly同比/...)
• Standard members added snapshot sharing function
• DQL query renamed to Query Tool, added execute button
• Host list display optimization, hosts in alert mute state added mute prompt
• SLO alert notification content optimization, added workspace and site information
• Optimized workspace ID and Token display logic, default hidden, supports viewing and copying
• Trial workspace added Session Replay, Profile usage restrictions

April 23, 2023¶

Guance Billing Update:¶

• Guance self-developed time series database launched, time series data storage and billing will undergo the following adjustments:

  • Infrastructure (DataKit) billing item offline, original "DataKit + Timeline" and "Timeline Only" two billing models will use only the self-developed time series database timeline for billing;
  • Self-developed time series database timeline: billed based on the number of active timelines counted on the day, unit price as low as ¥0.6 per thousand timelines.

• User Access Monitoring "Session Replay" officially starts charging, billed based on actual collected session replay data session count, ¥10 per thousand sessions.

For more details, please refer to the Billing Method document.

Guance Feature Updates:¶

• Self-developed Time Series Database launched
• Incident Tracking new features launched
• Cross-site Workspace Authorization function launched
• SLS added third-party authorization activation
• Binding index configuration page optimized, supports custom adding mapping field configuration
• Chart optimization
  • Command Panel added local Func custom function selection
  • Time Series Chart added Advanced Functions, supports local Func secondary processing of DQL query results and then returning display
• Workspaces added Time Zone Configuration, users can customize the current workspace query time zone
• Navigation menu supports right-click to open in new tab
• Blacklist duplicate name import issue fixed

Guance Deployment Edition Update¶

• Added Account Login Mapping Rule Configuration, dynamically allocating members to join workspaces and corresponding roles based on different mapping rules.

DataKit Update¶

New Features:

• Added Pinpoint API access

Feature Optimization:

• Optimized Windows installation script and upgrade script output methods, facilitating direct copy-paste in terminal
• Optimized Datakit self-document building process
• Optimized OpenTelemetry field processing
• Prom collector supports collecting info type labels and appending them to all associated metrics (enabled by default)
• In system collector, added CPU and memory utilization percentage metrics
• Datakit adds data point count marker (X-Points) when sending data, facilitating center-related metric construction
  • Also optimized Datakit HTTP User-Agent marker, changed to datakit-<os>-<arch>/<version> format
• KafkaMQ:
  • Supports processing Jaeger data
  • Optimized SkyWalking data processing process
  • Added third-party RUM access function
• SkyWalking added HTTP access function
• Added the following integration tests:
  • Apache
  • JVM
  • Memcached
  • MongoDB
  • RabbitMQ
  • Statsd
  • Tomcat
  • etcd

For more DataKit updates, please refer to DataKit Version History.

April 13, 2023¶

Intelligent Inspection Update¶

• Script Market Intelligent Inspection Script Set:

  • Optimized activation steps, no need to create new scripts, no need to create new schedules, click Install from official script market, automatically complete creation and scheduling, configure parameters to activate;
  • Updated Disk Usage Inspection: optimized disk usage inspection trend judgment algorithm, providing more accurate problem positioning for users.

• Script Market Cloud Sync Script Set:

  • Optimized activation steps, no need to create new scripts, no need to create new schedules, click Install from official script market, automatically complete creation and scheduling, configure parameters to activate;
  • Added multiple authentication methods for AWS sync;
  • Added AWS Cloudwatch Logs sync.

For more intelligent inspection updates, please refer to Intelligent Inspection Version History.

April 11, 2023¶

Guance Updates¶

Added Huawei Cloud Marketplace Activation Process¶

• Guance added a one-click activation process for Guance on Huawei Cloud Marketplace. After subscribing to Guance products on Huawei Cloud Marketplace, you can directly activate and use Guance. For more details, please refer to the document Huawei Cloud Marketplace Activation of Guance Commercial Version.

April 6, 2023¶

Guance Updates¶

• Logs added 3-day data retention strategy and pricing, for billing details please refer to document Billing Method.
• Logs added Data Access permission control, supporting granting of log data viewing rights within certain ranges to related roles
• Role Permission List added data query permissions for each functional module, supporting entrance for custom role configuration of data query permissions for corresponding modules
• Standard members added “Snapshot Management” permissions, supporting snapshot add/delete operations
• Snapshot Sharing supports search functionality. (Not supported in DQL query mode for logs)
• Supports local Func creating custom notification targets through websocket protocol, achieving external notification channel receiving alert notifications
• Explorer added copy as cURL data query functionality
• Dashboard chart configuration interaction optimization
  • Overview Chart added numerical unit option configuration, supporting selection of Chinese scientific notation carryover (default) and short scale
  • Added whether View Variables apply to chart effect display
  • When charts have grouping conditions, supports reverse applying certain grouping condition values to view variables for linked filtering
  • When charts have grouping conditions, selecting a certain grouping condition corresponding timeline or data point supports other charts with the same grouping highlighting联动display
  • Chart drag-and-drop effect optimization
• Account Inactivity Session Expiry Time default adjusted to 3 hours, this adjustment only affects accounts that haven’t edited the inactivity session expiry time configuration, not affecting those who have edited it.
• Filter History added search condition save
• User Access Monitoring Application SDK Access guide optimization
• Generate Metrics configuration optimization, supporting configuring units and descriptions for newly generated metrics
• Host Explorer supports multi-line display, label will be displayed on a new line in multi-line mode
• Time Series Chart, Pie Chart added return display quantity configuration

DataKit Update¶

New Features

• Added servo service for managing Datakit upgrades
• Added troubleshooting functionality

Feature Optimization

• Optimized upgrade functionality to avoid corruption of datakit.conf file
• Optimized cgroup configuration, removing CPU minimum value limit
• Optimized self collector, we can choose whether to enable this collector, and did some optimization on its collection performance
• Prom collector allows adding instance tag to maintain consistency with native Prometheus system
• DCA added Kubernetes deployment method
• Optimized log collection disk cache performance
• Optimized Datakit self-metric system, exposing more Prometheus metrics
• Optimized /v1/write
• Optimized token error prompt during installation process
• Monitor supports automatically getting connection address from datakit.conf
• Removed mandatory check on kernel version for eBPF, trying to support more kernel versions
• Kafka subscription collection supports multi-line json functionality
• Optimized IO module configuration, added upload worker number configuration field

Compatibility Adjustments

• This update removed most Sinker functionalities, retaining only Sinker functionality on Dataway. At the same time, both host installation configuration and Kubernetes installation configuration have been adjusted, with configuration methods differing from previous versions. Please pay attention to adjustments when upgrading
• Due to performance issues, the old version’s failed disk cache has been replaced with a new implementation method. The new implementation uses a binary format incompatible with the old one. If upgrading, old data will not be recognized. It is recommended to manually delete old cache data first (old data might affect new version disk cache), then upgrade to the new version of Datakit. Despite this, the new version’s disk cache remains experimental, please use with caution
• Datakit self-metric system has been updated, original DCA acquired metrics will have some missing parts, but will not affect DCA itself functionality

For more DataKit updates, please refer to DataKit Version History.

March 23, 2023¶

Guance Updates¶

• Help document search function optimization

• Backup Logs added extended field save logic, defaulting to back up only message content to backup logs. If "Sync Backup Extended Fields" is checked, the entire log data matching the filter criteria will be backed up

• Explorer/Dashboard Time Widget added "Time Zone Selection" and "Global Lock" functionality

• Monitor Optimization

  • Supports viewing last historical configuration, supports clicking to restore to Historical Configuration Version
  • List and page added creation, change information display
  • Change Detection added comparison dimensions, supports selecting statistical indicator comparison logic with "Yesterday" or "Last Hour"

• Intelligent Inspection event added effect feedback entry

• Snapshot sharing supports adding creator watermark display
• Registration activation process optimization, cloud marketplace activation path added site selection
• Notebook creation logic and adding content interaction adjustment
• Chart Query added label inverse selection logic
• Trace detail page Span list display logic adjustment, displayed in reverse chronological order by "duration"
• Member Management trigger audit process role modification logic adjustment
• Explorer column width save, log multi-line display logic adjustment

March 9, 2023¶

Guance Updates¶

Data Storage Strategy Change Optimization¶

Removed the logic limiting data storage strategy modifications to once per day, now supports users adjusting data storage strategies multiple times within the same day.

Note: Except for the first modification on the same day which takes effect immediately, other modification operations will take effect based on the last adjustment record on the next day. For how to change, please refer to the document Data Storage Strategy.

Chart Link Configuration Optimization¶

Chart link configuration interaction upgraded, based on text box input, supports free combination generation of final chart associated link URLs through parameter configuration. For more details, please refer to the document Custom Links.

Added Support for Creating Duplicate Named Dashboards, Notes, Custom Explorers¶

Optimized dashboard, notebook, custom explorer import functionality. If duplicate files are found during import, supports custom selection of "Skip", "Create Anyway", or "Cancel". Involved import modules:

• Scenarios: Dashboards, Notebooks, Explorers
• Management: Settings - Configuration Migration

Note: If "Cancel" is selected for import, none of the selected files will be imported this time. For more details, please refer to the document Configuration Migration.

DQL Parameter Priority Adjustment¶

If you use handwritten DQL mode to query data, the time parameter configuration in DQL will take precedence over the time widget input range. Involved functions:

• Dashboard: View Variable Default Value Query, Chart Query
• Metric Analysis
• DQL Query Tool

Log Message Data Display Optimization¶

Log viewing list supports selecting to display all message content. Involved functions:

• Log Explorer
• Associated log pages in various explorers

Monitor Configuration Page Optimization¶

When configuring monitor event notifications:

• Supports customizing "Data Gap" event notification templates
• Event content supports adding jump links, besides default links provided by official, you can also customize jump links

For more details, please refer to the document Monitor Configuration.

SSO Related Optimization¶

• SSO users support modifying account information and session persistence time strategies
• SAML account mapping rule configuration optimization, compatible with various case formats of "Email"
• Single Sign-On link acquisition logic optimization, prioritizes listing login links for already joined workspaces for SSO users who have already joined workspaces

Other Function Optimizations¶

• Commercial version activation process supports choosing between "Guance Direct Activation", "Alibaba Cloud Marketplace Activation", and "Amazon Cloud Marketplace Activation" three methods;
• Explorer left * query function range adjustment, newly activated workspaces no longer default support left * query, please contact customer manager if needed;
• SLIMIT limit adjustment, time series chart queries with group by grouping will default return up to 20 data entries;
• New workspace newbie guide process optimization.

DataKit Update¶

New Features

• Pipeline supports key deletion
• Pipeline adds new KV operations
• Pipeline adds time functions
• netstat supports IPV6
• diskio supports io wait metrics
• Container collection allows Docker and Containerd coexistence
• Integrate Datakit Operator configuration documentation

Function Optimization

• Optimize Point Checker
• Optimize Pipeline replace performance
• Optimize Datakit installation process under Windows
• Optimize confd configuration processing process
• Add Filebeat integrated test capability
• Add Nginx integrated test capability
• Reconstruct OTEL Agent
• Reconstruct Datakit Monitor information

For more DataKit updates, please refer to DataKit Version History.

February 28, 2023¶

Guance Updates¶

Added Session Replay Functionality¶

Session Replay is a rebuilt demonstration of user website experiences, generating video recordings by capturing clicks, mouse movements, and page scrolls to deeply understand user operational experiences. For more details, please refer to the document Session Replay.

Optimized AWS Activation Process¶

Guance optimized the one-click activation process for Guance on AWS Cloud Marketplace. After subscribing to Guance products on the AWS Cloud Marketplace, you can directly activate and use Guance. For more details, please refer to the document Activating Guance on AWS.

February 23, 2023¶

Guance Updates¶

Optimized Real User Monitoring¶

Added Automated Tracking for Real User Monitoring¶

Real User Monitoring added automated tracking, achieved through a "browser plugin" to record user access behaviors using browsers, creating code-free end-to-end tests. For more details, please refer to the document Automated Tracking.

Real User Monitoring Application List, Explorer, Analysis Dashboard Layout Overall Adjustment¶

• Real User Monitoring application list display layout adjustment, supports jumping to view current application's "Analysis Dashboard" and "Explorer" content details from the application list.

• Real User Monitoring "Explorer" supports viewing user access data for all applications. You can view and analyze data for different applications by filtering "Application ID".

• Real User Monitoring "Analysis Dashboard" supports switching to view Web, Mobile, Mini-program scenario analysis views.

Added CDN Quality Analysis¶

Real User Monitoring added CDN provider information collection, analyzing charts for CDN quality from different providers. For configuration details, please refer to Real User Monitoring Collector Configuration.

Added UniAPP Application Access¶

Real User Monitoring added UniAPP application access, current version supports Android and iOS platforms. For more details, please refer to UniApp Application Access.

Scenario Optimization¶

Added Custom Explorer Navigation Menu¶

In the scenario explorer list, added support to add current explorers to infrastructure, metrics, logs, application performance monitoring, real user monitoring, availability monitoring, security inspection, CI visualization navigation menus. For more details, please refer to Adding Explorer Navigation Menu.

Enhanced Scenario View Variable Cascading Functionality¶

When configuring cascading queries for scenario view variables, supports using = , != for exact matching of variable values, supports using match(re) , not match(re) , wildcard , not wildcard for fuzzy matching of variable values. For more details, please refer to the document View Variables.

Pie Chart Added Merge Configuration Option¶

Pie charts added merge configuration options, supports merging redundant data points into "Other" for display, improving pie chart readability. For more details, please refer to the document Pie Chart.

Adjusted Chart Query Operator Translation Logic¶

Adjusted translation logic for match/not match operators in chart queries, removed default right * matching logic for match operator in log data, manual addition required if needed.

Other Functional Optimizations¶

• Guance Commercial Version Registration process supports binding Guance billing center account;
• Configuring Monitors, "Detection Dimension" supports non-mandatory selection.

DataKit Update¶

New Features

• Command line added line protocol parsing functionality
• Datakit yaml and helm support resource limit configuration
• Datakit yaml and helm support CRD deployment
• Added SQL-Server integration testing
• RUM supports resource CDN tagging

Function Optimization

• Optimized dial testing logic
• Optimized installation prompts under Windows
• Optimized powershell installation script template
• Optimized k8s Pod, ReplicaSet, Deployment association methods
• Reconstructed point data structure and functionality
• Datakit自带 eBPF collector binary installation

For more DataKit updates, please refer to DataKit Version History.

February 16, 2023¶

Guance Updates¶

Optimized Workspace Permission Management¶

Added Member Roles and Permission List Management¶

Guance added role management functionality, supporting setting different Guance functional access permissions for employees in enterprises to achieve permission isolation among different employees.

Guance provides four default member roles: "Owner", "Administrator", "Standard", and "Read-only". In addition to default roles, Guance supports creating new roles in role management and assigning permission ranges to roles to meet different user permission needs. For more details, please refer to the document Role Management.

Optimized Member Invitation, Added Select Member Permissions¶

Within the current space, inviting new members defaults to read-only members, now supports selecting one or multiple roles to set permissions for new members. For more details, please refer to the document Member Management.

Added Batch Modify Member Permissions¶

In member management, added batch modify permissions functionality. Click "Batch Modify Permissions", select members needing batch permission changes, click "OK", then in the pop-up dialog box select permissions for members and click "OK" to proceed. For more details, please refer to the document Member Management.

Optimized SSO Management, Added SAML Mapping Functionality¶

Guance added SAML mapping configuration-based fine-grained single sign-on scheme for enterprises, after enabling SAML mapping supports dynamic assignment of access permissions to enterprise employees, employees can access Guance based on assigned role permissions.

In Guance workspace "Management" - "Member Management" - "SSO Management" - "SSO Login", enable "SAML Mapping" and configure mapping relations in "SAML Mapping". For more details, please refer to the document SSO Management.

Member Management Page Display Optimization¶

In member management, added custom role management functionality, adjusted search, quick filtering, and other layouts. For more details, please refer to the document Member Management.

Permission Change Audit Optimization¶

Based on the newly added role permission management, adjusted the trigger conditions for billing center audits, when user roles are granted Token viewing, operation permissions, it triggers Guance billing center audit.

Added Login Session Persistence Time Setting¶

Guance supports setting session persistence time for accounts logged into the workspace, including SSO single sign-on accounts and workspace registered accounts. Supports setting "Inactivity Login Session Persistence Time" and "Login Session Maximum Persistence Time" for logged-in accounts. After setting, expired login sessions will become invalid.

• Inactivity Login Session Persistence Time: supports setting range 30 ~ 1440 minutes, default 30 minutes;
• Login Session Maximum Persistence Time: supports setting range 0 ~ 7 days, where 0 means never expires, default 7 days.

Added Ticket Management¶

For issues encountered in Guance, users can submit tickets for consultation and suggestions, official will provide timely handling and feedback. For example, difficult issues encountered during use, consultation regarding purchasing and fees, submitting requirements and suggestions to Guance etc.

The ticket system is based on personal account level, users can view all tickets submitted by themselves in ticket management, regardless of workspace. Ticket Management Entry: bottom left corner "Account" - "Ticket Management". For more details, please refer to the document Ticket Management.

Other Functional Optimizations¶

• Added language selection when creating workspace, language options affect templates for events, alerts, SMS, etc., within the workspace. If English is selected, corresponding templates will default to English;
• Optimized workspace locking functionality. If the billing center account is overdue or cloud marketplace subscription is abnormal, it may lead to workspace lock. After workspace lock, new data will stop reporting. Guance provides a 14-day grace period during which you can continue viewing and analyzing historical data, and unlock to resume using Guance. For more details, please refer to the document Workspace Lock.

Intelligent Inspection Update¶

• RUM Performance Inspection: supports jumping to view problematic Sessions via session IDs affecting users, providing more professional optimization methods in inspection event reports.
• Cloud Account Instance Dimension Bill Inspection: added support for AWS account instance dimension bill inspection.

For more intelligent inspection updates, please refer to Intelligent Inspection Update Log.

Best Practice Update¶

• Cloud Platform Access
  • Alibaba Cloud - Alibaba Cloud EventBus Best Practice

For more best practice updates, please refer to Best Practice Version History.

February 9, 2023¶

DataKit Update¶

New Features

• Datakit host installation can customize default collectors to enable
• Provides error tracing for OTEL
• Provides RUM Session Replay capability

Functional Optimizations

• Datakit pyroscope profiling multi-language recognition
• Optimized CPU, Disk, EBPF, Net Chinese and English documents
• Optimized elasticsearch, postgresql, dialtesting English documents
• Optimized DCA, Profiling documents
• Optimized log collection process
• iploc yaml configuration method document support

For more DataKit updates, please refer to DataKit Version History.

Intelligent Inspection Update¶

Added Inspections¶

• RUM Performance Inspection: Real User Monitoring (RUM) is an application performance monitoring technology aimed at evaluating website performance by simulating real user behavior when browsing websites. The purpose of RUM is to understand website performance from the user's perspective, including website loading time, page rendering effects, page element loading, and interactive responses. The main usage scenarios for RUM performance inspection are client-side websites, such as e-commerce websites, financial websites, entertainment websites, etc., which all require presenting users with a fast and smooth access experience. Through RUM performance analysis, developers can quickly understand actual user experiences to improve website performance.
• Kubernetes Health Inspection: Nowadays, Kubernetes has taken over the entire container ecosystem, acting as the brain for distributed deployment of containers, aiming to manage service-oriented applications using cross-host cluster distribution. Kubernetes provides mechanisms for application deployment, scheduling, updating, service discovery, and scaling, but how do we ensure the health of Kubernetes nodes? Through intelligent inspection, we can retrieve and identify issues based on current node resource states, application performance management, service failure logs, etc., thus accelerating event investigation, reducing engineer workload, decreasing mean time to repair, and improving end-user experience.

For more intelligent inspection updates, please refer to Intelligent Inspection Update Log.

January 17, 2023¶

Guance English Version Launched¶

January 12, 2023¶

Guance Updates¶

Added Guance Site Service Status Page¶

Guance provides a Status Page to help you view the service status of different Guance sites in real-time. If you have already logged into Guance, you can view the service status of various Guance sites by clicking the lower-left corner Help > Status Page. For more details, please refer to the document Status Page.

Added Support for Binding Self-Built Elasticsearch/OpenSearch Indices¶

Guance added support for binding self-built Elasticsearch/OpenSearch indices, helping unify and quickly view and analyze your log data. For more details, please refer to the document Binding Indices.

Added Network Explorer List Mode¶

In Infrastructure - Network, selecting Host / Pod / Deployment / Service, supports switching to the corresponding network list to view TCP retransmission count, TCP connection count, TCP close count, TCP latency, sent bytes, received bytes, status codes between source IP/port and destination IP/port.

For more details, please refer to the document Network.

Added Frontend Application Span Request Latency Distribution Display¶

On the Trace Details page, if the current trace belongs to frontend application calls, you can view request latency distribution in the trace details, including Queueing (queue), First Byte (first packet), Download (download) request latency proportion, helping you intuitively view process consumption proportion of a certain frontend Span.

Note: The RUM SDK must be version 2.2.10 or above to see this data display. If cross-domain exists, adjust header configuration, for more details, please refer to the document Web Application Access.

Optimized Real User Monitoring Session Interaction Logic¶

• Removed all record lists from the Session explorer;
• Optimized session detail page display: type display optimization, supports switching to absolute session occurrence time, added service column, detail page display optimization, error message optimization
• Optimized session data update logic: changed from append logic to overwrite logic based on session_id
• If the trace contains spans generated by frontend application calls, the service value of the span will be filled based on the service value in the current user access data. If no service information exists in the user access data, it will default to "browser"

For more details, pleaserefer to the document Session (Session).

Pod Metric Data Collection Default Disabled¶

In the latest DataKit version, container collector's Pod metric data configuration has been adjusted to default disabled enable_pod_metric = false. For more details, please refer to the document Container Data Collection.

Other Functional Optimizations¶

• Binding MFA authentication adjusted to email verification
• Registration adjusted phone verification to email verification
• Login security verification adjusted to slider verification
• Added Guance Exclusive Plan guide when creating workspace
• Workspace added note display functionality
• Cloud account settlement user added billing list viewing in Guance Billing & Plans
• Table charts support setting aliases based on "by group"
• Optimized timeline display in monitor configuration, only displayed after selecting dimension
• Optimized log data gap alert configuration
• OpenAPI added create workspace interface

DataKit Update¶

• confd added Nacos backend
• Log collector added LocalCache feature
• Supports C/C++ Profiling data
• RUM Session Replay file upload

• WEB DCA supports remote config updates

• Optimized SQL data resource consumption issues

• Optimized Datakit Monitor

For more DataKit updates, please refer to DataKit Version History.

Best Practice Updates¶

• Cloud Platform Access
  • AWS - EKS Deployment of DataKit.
• Monitoring
  • Application Performance Monitoring (APM) - Tracing - Using datakit-operator to inject dd-java-agent.

For more best practice updates, please refer to Best Practice Version History.