Change Log (2023)¶
This document records the update contents of each online release of Guance, including DataKit, Guance best practices, Guance integration documents, and Guance.
December 28, 2023¶
Guance Updates¶
- Monitoring:
- Added Smart Detection of User Access: Supports performance anomaly and error analysis for websites/APPs; related detection metrics include LCP, FID, CLS, etc.
- Infrastructure Survival Detection V2: Introduced V2 version of infrastructure survival detection, optimized detection logic, and resolved several triggering issues related to V1 and process detection.
- User Access Monitoring (RUM):
- Added Public Network DataWay method to receive RUM data without installing collectors; Web applications support direct upload of SourceMaps in the console, allowing multiple files to be uploaded based on different versions and environments.
- Error Viewer > Error Details: Added a Formatted error information page displaying parsed Sourcemap file errors, supporting switching between formatted and original format error messages. If no Sourcemap file is configured or does not match after uploading, only the original format error message will be displayed.
- Application Performance Monitoring (APM):
- Optimized Service Topology Diagram: Adjusted display styles for upstream/downstream services, nodes, and service names.
- Optimized Service Details: Bound performance view dashboards to display current service performance metrics, supporting custom user views to override updates and drill-down analysis.
- Optimized Trace Detail Flamegraph and Waterfall Chart Display: Flamegraph added execution time and percentage display; Waterfall chart supports relative and absolute time switching.
- Chart Optimization:
- Time Series Table Chart added Display Column configuration: Supports setting query data display columns and allows users to customize column names manually. Users can adjust column widths manually in edit mode, saving changes for list display; supports drag-and-drop adjustment of display column order.
- Chart links added Value Variables for link navigation.
- Dashboard:
- Added Home Dashboard: Supports workspace home dashboard configuration.
- Infrastructure:
- Host Viewer added Show Only Online Hosts switch filter: Optimized logic for obtaining online host lists, supporting selection of whether to list hosts with data reported within the last 10 minutes.
Guance Deployment Edition Updates¶
- Supports external platforms embedding Guance pages using URL parameters to hide left and top menus, and floating operations.
- Supports external platforms embedding Guance dashboards or viewer pages via iframe.
New Integrations¶
- Added Kubecost integration
December 14, 2023¶
Guance Updates¶
- Monitoring:
- Added Smart Monitoring:
- Host Smart Detection: Supports CPU spike/drop/range increase, memory spike/drop/range increase detection;
- Log Smart Detection: Supports log count spike/drop, error log spike detection;
- Application Smart Detection: Supports request count spike/drop, error request count spike, request delay spike/drop/range increase detection.
- Anomaly Detection: Added trigger rule prerequisites, initiating anomaly detection rules when the detected value meets the condition, improving monitoring accuracy.
- Added Smart Monitoring:
- Paid Plans and Billing:
- Added Data Forwarding Usage Analysis list: View all data forwarding rules' forwarding counts in the current workspace. If the forwarding rule is to backup logs in Guance modules, it will show corresponding retention policies. Also supports time widget filtering to quickly view historical log backup situations.
- Events:
- Added Smart Monitoring Event Viewer: View all events generated by smart monitoring.
- Logs:
- Data Access added [Show Only Relevant Rules] configuration: When enabled, only access rules affecting the current account's data queries are displayed.
- Log > Viewer: Added data access rule restriction prompts.
- Infrastructure > Container > Kubernetes:
- Added Kubernetes Analysis Dashboard: Container object analysis dashboard to help understand various infrastructure conditions in Kubernetes from different dimensions.
- Container > Viewer: UI optimization.
- Metrics:
- Metrics > Viewer:
- Table chart added [Query Tool] mode: Returns results consistent with Shortcuts > Query Tool; if multiple queries are added, the first query result is returned by default; this mode supports exporting up to 1000 query records.
- Added copy query condition function, optimizing page experience.
- Optimized query components: Simple queries' [by grouping] support free dragging to adjust order.
- Metrics > Viewer:
- Viewer:
- Adjusted all viewers to hide trend charts in analysis mode.
- SSO:
- Optimized SSO user workspace listing logic, fixing automatic logout due to lack of access permissions.
Guance Deployment Edition Updates¶
- Added Independent Alert Notification Configuration: When this configuration is enabled, choosing [Do Not Aggregate Alerts] sends an alert notification for each event, helping efficiently manage alert notifications.
- Added Event Link Login-Free Viewing Configuration: When enabled, all built-in event-related links in alert notifications from workspaces can be accessed without login. If disabled, all previously sent login-free links become invalid to ensure data security.
- Optimized [Scheduled Reports]: Customizable query range configuration, upper limit extended from 30 days to 360 days, meeting expanded scheduled report needs.
New/Updated Integrations¶
- Added APISIX
- Updated Alibaba Cloud Kafka
- Updated Dameng
November 30, 2023¶
Guance Updates¶
- Monitoring:
- Create Monitor > Event Content > Insert Link: Supports automatically generating jump links based on detected metrics, adjustable filtering conditions and time ranges after inserting links; supports custom jump links.
- Alert Strategy Management: Added [Smart Aggregation] mode, where you can cluster events by "Title" or "Content" over a period, with each group generating one alert notification.
- Management:
- Overall style optimization for the module menu page.
- Added [Attribute Claims]: Through fixed fields
organization
,business
to help quickly identify and perform linked queries globally. - Added [Regular Expressions]: Switchable between [Custom] and [Template Library] lists; supports user-defined regular expression templates applicable to [Snapshot Sharing] and [Data Access Rules].
- Ticket Management:
- Ticket level changed from "Account Level" to "Workspace Level", allowing all members to view all tickets within the workspace;
- Added [All Tickets], [Submitter], and [My Tickets] lists.
- Workspace Management: Dissolving workspace operation added risk confirmation prompt.
- Workspaces [Description] feature deprecated.
- Data forwarding: Query and statistics adjustments and optimizations
- Query side: Adjusted content display data range, defaulting to other data content except
time
; - Made some robustness optimizations for data forwarding functionality.
- Query side: Adjusted content display data range, defaulting to other data content except
- Logs:
- Data Access:
- Added data desensitization rules, supporting configuring multiple fields and applying multiple regular expressions;
- Supports configuring all [Indexes] and [Roles];
- Added desensitization preview to judge whether rules meet requirements.
- Data Access:
- Snapshot > Share Snapshot:
- Share link validity period added 1, 3, 7 days, default selected 1 day;
- Data desensitization: Supports configuring multiple fields and applying multiple regular expressions;
- Supports previewing snapshots, allowing you to check all configured page effects in advance.
- RUM: Adjusted [Create Application] page layout, optimizing user experience.
- Pattern Analysis:
- RUM > Error Viewer & APM > Error Tracking: Changed to
drain()
algorithm aggregation logic under pattern analysis mode; added input box to modify clustering fields, defaulting toerror_message
, up to 3 fields can be entered, customizable as needed.
- RUM > Error Viewer & APM > Error Tracking: Changed to
Guance Deployment Edition Updates¶
- Added support for customizing email headers and logos;
- Guance will discontinue Banner information settings, no longer providing related Banner maintenance support.
New Integration¶
- Added logstash
New Best Practices¶
- Incident Tracking and JIRA Two-Way Linkage Best Practice
November 21, 2023¶
Guance Updates¶
- Management: Added MFA Security Authentication switch on the [Settings] page. Once administrators/owners enable this feature, all users (regular members / SSO members) must complete MFA authentication before entering the space.
Guance Deployment Edition Updates¶
- Added MFA Security Authentication switch, supporting system default or custom identity verification methods.
November 16, 2023¶
Guance Updates¶
- Monitors:
- [Alert Silencing] function reintroduced, still configurable to define the interval for repeated alert notifications.
- Removed the requirement to configure any of "Critical", "Important", "Warning" trigger conditions; now supports configuring any one of critical, important, warning, data interruption, informational triggers.
- Infrastructure Survival Monitoring: Supports metric configuration for infrastructure survival detection, allowing higher frequency detection configurations through this mode.
- Scenarios
- Charts:
- Advanced settings: Deprecated [Original Interval] parameter configuration, default configuration changed to [Auto Align], supporting custom selection of data intervals for charts.
- Time Series Chart: Changed [Display Density] to [Maximum Return Points], default value 720, supporting any integer between 2-1000.
- Fixed PromQL variable linkage causing alias function failure.
- Service Management:
- Added built-in dropdown for switching services directly without returning to the list.
- POD page in detail view deprecated.
- [Resource Invocation] performance charts changed to composite charts, optimizing page display experience.
- Charts:
- Management
- SSO Management:
- During SSO login, workspaces support listing all authorized workspaces under the current [Identity Provider ID]; supports locating target workspaces directly via [Search] function.
- [User SSO] added [Import/Export] function to quickly configure multiple workspace single sign-on settings.
- Workspace Language:
- Adjusted default display language logic in the console, following browser language settings by default.
- When changing workspace language, event, alert, SMS, and other notification templates will also use the modified language template.
- SSO Management:
- Incident association with incident tracking added联动标识:
- In unresolved incident lists, icons indicate whether incidents are associated with specific incident tracks.
- Incident Tracking: If there are synchronized created associated event information by monitors, icons can quickly show the number of associated events.
- Infrastructure > Host: Optimized sorting issues in host viewer metric data.
- Pipeline usability improvements:
- Data source selection column added text prompting configured Pipeline scripts;
- Log data sample acquisition added "Index" selection, solving sample data acquisition issues when users do not use the default index.
Guance Deployment Edition Updates¶
- Single Sign-On: Supports dynamically appending phone numbers to user accounts during OIDC login based on returned user information.
New Integrations¶
- Added argocd, fluentd, redis-sentinel
November 9, 2023¶
Guance Updates¶
- Monitors > Alert Strategy Management:
- Notification Configuration: Logic changed to configure one or more notification targets for individual anomaly levels.
- Recovery Notification Logic Change: When historical abnormal alert events recover, Guance sends recovery notifications to corresponding notification targets.
- Added 【Alert Aggregation】: Supports configuring alert notification aggregation based on rules, with two aggregation methods:
- No Aggregation: Under this mode, alerts within every 20-second interval are merged into one alert notification sent to the corresponding notification target;
- Rule Aggregation: Choose four aggregation rules and send alert notifications based on the aggregation cycle.
- Added 【Aggregation Cycle】: In rule aggregation mode, new events within 1-30 minutes will be aggregated into notifications, and new events exceeding the aggregation cycle will be aggregated into new alert notifications.
- Management > Data Forwarding: Supports custom date range queries, selecting multiple dates and defining start and end times.
November 2, 2023¶
Guance Updates¶
- Management:
- SSO Management: Supports OIDC / OAuth2.0 Protocol Single Sign-On Configuration;
- Data Permission Management: Adding [Role] during authorization configuration; after role configuration, data viewing and query access restrictions in the authorized workspace are determined based on the selected role scope.
- Data Forwarding:
- Navigation position moved to the [Management] module, still accessible via secondary menu items under [Logs], [User Access Monitoring], [Application Performance Monitoring];
- AWS S3 and Alibaba Cloud OSS support "Cross-Account Authorization" configuration, enabling mutual authorization of data permissions between two accounts, simplifying configuration processes.
- Paid Plans and Billing:
- Supports data forwarding to Guance internal storage, calculating daily charges based on data volume stored in Guance storage objects within the workspace;
- Events > Unresolved Events:
- Currently, unresolved event lists store data for the past 24 hours;
- Added display preferences: Default [Standard] mode, supports switching to [Extended] mode to open historical trends of event detection results;
- Supports exporting the current event list as CSV;
- Event details page added Extended Fields tab; basic attributes tab page optimized.
- Infrastructure > Network:
- Optimized [Overview] template, added quick filters for users to filter and view network paths. Added 5 statistical charts supporting analysis of sent/received bytes, TCP retransmissions, and other network metrics;
- Added [Network Flow] viewer, allowing viewing of all L4(netflow), L7(httpflow) network flow data on the timeline;
- Other viewer detail pages added [Topology] mode display, directly showing upstream/downstream relationships and key network metrics of the current object.
- Scenarios:
- View Variables: Supports adding PromQL queries;
- Charts:
- Added [Data Sampling] for workspaces using Doris data storage;
- Time auto-align feature optimized: For all metric data and Doris data chart queries, when time auto-align is enabled, return data timestamps align to "whole seconds/minutes/hours";
- Leaderboard, Overview Chart, Table Chart: Added [Rule Mapping], allowing configuration of font color/background color for mapped value ranges.
- Viewer: Analysis mode optimized, supporting free aggregation queries based on data and displaying results in chart form;
- Service Management > Resource Invocation: Resource leaderboard added [Requests Per Second] option.
- Synthetic Tests > Tasks: Support import/export.
- Doris Log Data Engine temporarily does not support
with_labels
linked queries.
Guance Deployment Edition Updates¶
- Supports custom session expiration duration configuration, uniformly setting Login Session Duration for front-end users.
October 19, 2023¶
Guance Updates¶
- Paid Plans and Billing: Billing item 【Data Forwarding】statistical logic changed to "based on data forwarding rules".
- Management
- SSO Management: Supports creating multiple SSO IDP configurations, enabling enable/disable operations for individual IDP configurations, and enabling SAML mapping.
- Data Permission Management > Sensitive Data Desensitization: Supports configuring sensitive data masking rules at the role level, using regular expressions for desensitization. Configuration supports field-level desensitization rules for specific data types, with newly added desensitization rule preview testing.
- Monitors: Added External Event Detection, sending abnormal events or records from third-party systems to HTTP servers via POST requests to generate Guance event data.
- Scenarios
- Service Management > Resource Invocation: Added quantity sorting for corresponding lists, defaulting from largest to smallest;
- Chart Links: Added passing start and end times of currently selected data points as parameters, variables being
#{timestamp.start}
,#{timestamp.end}
; - Chart Aliases: Configured based on legend sequences;
- Table Chart: Added 【Time Series Table Chart】.
- Metrics > Metric Analysis: Table Chart added 【Time Series Mode】.
Guance Deployment Edition Updates¶
- Added Custom Mapping Rule Configuration: When enabled, corresponding workspaces can define custom mapping rules. Workspace custom mapping rules have higher priority than backend management mapping rules;
- Added Query Quantity Limits: Different user workspaces have customized query limits to prevent low cluster performance due to large query volumes, enhancing product usage experience;
- Local Accounts Added Password Change Feature.
Integration Updates¶
- Incident Event and PagerDuty Integration: When our application or system encounters an exception, timely handling is required to ensure normal operation. To better manage and track incident events, these events can be sent to PagerDuty to create incidents, which can then be tracked, analyzed, and resolved within PagerDuty. Quickly sending incident events to PagerDuty provides better management and tracking capabilities, ensuring the normal operation of the system. This method also helps analyze and resolve problems, improving system stability and reliability.
September 26, 2023¶
Guance Updates¶
- Scenarios > Service Management: Added 【Upstream/Downstream Topology】component to resource invocation, allowing users to view upstream/downstream resource invocation relationships for the current resource.
- Logs > Data Forwarding: Data forwarding rules support RUM, APM data.
September 21, 2023¶
Guance Updates¶
- Logs:
- Data Forwarding: Added external storage forwarding rule data query; supports enabling/disabling forwarding rules;
- Index Binding: Added label binding for easier fine-grained data range query authorization.
- Infrastructure > Custom:
- Changed concept of 【Default Attributes】 to 【Required Attributes】: Reported data must contain these attribute fields, otherwise reporting will fail;
- Supports adding resource catalogs to secondary menus for easier viewing.
- Custom viewer added quick filters.
- Scenarios:
- Scheduled Reports: Added DingTalk, WeCom, Lark notification methods;
- Charts: 【Time Series Chart, Pie Chart, Bar Chart, Histogram, Scatter Plot, Bubble Chart, Table Chart, Rectangular Tree Map, Funnel Chart, Leaderboard, Map, Hexagonal Map】added data formats, defining 【Decimal Places】and 【Thousands Separator】.
- Monitoring > Notification Targets Management: Dismantled mail group type, existing configurations unaffected.
- Snapshots: Shared Snapshots: Added IP whitelist access restrictions.
- Incident Tracking: 【Level】supports custom creation; enables/disables default levels.
- Integration > Extensions: DataFlux Func (Automata) and RUM Headless now support overseas sites: Oregon, Frankfurt, Singapore.
Integration Updates¶
Huawei Cloud:
-
Huawei CCE: Guance supports monitoring the operational status and service capabilities of various resources in Huawei CCE, including Containers, Pods, Services, Deployments, Clusters, Nodes, Replica Sets, Jobs, Cron Jobs, etc. You can install
DataKit
via DaemonSet in Kubernetes to collect data from Kubernetes resources. Ultimately, monitor the real-time operational status of various Kubernetes resources in Guance. -
Huawei CSS (Elasticsearch): Core performance indicators of Huawei Cloud Search Service CSS for Elasticsearch include query latency, indexing speed, search speed, disk usage rate, and CPU usage rate, all of which are key indicators for evaluating and optimizing Elasticsearch performance.
-
Huawei SYS.AS: Core performance indicators of Huawei SYS.AS include CPU utilization, memory usage rate, disk I/O, network throughput, and system load, all of which are key indicators for evaluating and optimizing the performance of the auto-scaling system.
-
Huawei ASM: Huawei Cloud's ASM's tracing data output to Guance for viewing and analysis.
AWS:
-
AWS CloudFront: Core performance indicators of AWS CloudFront include total requests, data transfer, HTTP error rate, cache hit rate, and latency, which help users evaluate and optimize CDN performance.
-
AWS MediaConvert: Includes data transfer, video errors, job count, padding, etc.
-
AWS Aurora Serverless V2: Includes connection count, IOPS, queue, read/write latency, network throughput, etc.
-
AWS Redshift: Core performance indicators of AWS Redshift include query performance, disk space usage, CPU utilization, database connections, and disk I/O operations, all of which are key indicators for evaluating and optimizing data warehouse performance.
-
AWS Simple Queue Service: Displayed metrics include the approximate existence time of the oldest undelivered message in the queue, delayed messages that cannot be immediately read, the number of messages in transit, and the number of messages retrievable from the queue.
-
AWS Timestream: Displayed metrics include system errors (internal service errors), the total number of invalid requests in the current AWS region and account, the elapsed time of successful requests and sample quantities, the amount of data stored in memory, and the amount of data stored in magnetic storage.
-
AWS Neptune Cluster: Displayed metrics include cold start time, execution time, concurrent executions, and memory usage, reflecting the response speed, scalability, and resource utilization of the Neptune Cluster functions.
September 7, 2023¶
Guance Updates¶
- Scenarios > Dashboards/Viewers: Added global Cross-Workspace Query configuration.
- Scenarios > Chart Queries: Automatic alignment of time intervals added "1 second" display when the time control range is less than or equal to 【Past 15 Minutes】.
- Scenarios > Service Management:
- Service List added binding multiple built-in views to analysis dashboards; added associations, team information;
- Added resource invocation analysis dashboard;
- Supports saving snapshots.
- Logs > Backup Logs:
- Officially renamed to Data Forwarding;
- Added trace and user access data sources;
- Original backup log billing item name changed to data forwarding billing item.
- Logs > Viewer: Added entry to create a new monitor; supports snapshot saving for viewer detail pages.
- Management:
- Global Tags: Added global tag feature for unified tag management;
- Field Management: Added aliases, set display columns;
- Workspace Management: Function consolidation and page optimization;
- Member Management: Original member groups formally renamed to teams;
- Sensitive Data Scan: Added scan rule count statistics; added jump links.
- Monitoring:
- Synthetic Testing Anomaly Detection: Added test metrics, which can be detected based on the 【Metric】dimension;
- Mutation, Outlier, Range Detection: Supports selecting all data sources.
Integration Updates¶
Alibaba Cloud:
- aliyun_analyticdb_postgresql: Alibaba Cloud AnalyticDB PostgreSQL metrics display, including CPU, memory, disk, coordinator node, instance queries, etc.
- aliyun_clickhouse_community: Alibaba Cloud ClickHouse metrics display, including service status, log traffic, operation count, overall QPS, etc.
- aliyun_kafka: Alibaba Cloud
KafKa
includes message throughput, latency, concurrent connections, and reliability, reflecting Kafka's performance and reliability in handling large-scale message transmission and real-time data streams. - aliyun_lindorm: High-throughput, low-latency data read/write capability, supporting high-concurrency transaction processing, and strong consistency and high-reliability data storage and query services.
- aliyun_polardb_1.0: Alibaba Cloud PolarDB distributed 1.0 metrics display includes CPU utilization, memory utilization, network bandwidth, and disk IOPS.
- aliyun_polardb_2.0: Alibaba Cloud PolarDB distributed 2.0 displays computing layer and storage node metrics, including CPU utilization, connection usage, disk usage, disk usage rate, memory utilization, network bandwidth, etc.
- aliyun_rds_postgresql: Alibaba Cloud RDS PostgreSQL metrics display, including CPU utilization, memory utilization, etc.
- aliyun_rocketmq5: Alibaba Cloud RocketMQ 5.0 metrics display includes message throughput, latency, reliability, and horizontal scalability.
AWS:
- aws_dynamodb_DAX: AWS DynamoDB DAX metrics display includes CPU utilization of nodes or clusters, bytes received or transmitted on all network interfaces, and packet count, reflecting the operational status of DynamoDB DAX.
- aws_memorydb: Core performance metrics of AWS MemoryDB include low-latency memory read/write capability, high-concurrency transaction processing capability, and linearly scalable storage capacity and throughput.
Huawei Cloud:
- huawei_functiongraph: HUAWEI FunctionGraph metrics display includes call count, error count, rejection count, concurrency, reserved instance count, runtime (including maximum, minimum, and average runtime), reflecting the running status of FunctionGraph functions.
- huawei_kafka: Includes message throughput, latency, concurrent connections, and reliability, reflecting Kafka's performance and reliability in handling large-scale message transmission and real-time data streams.
- huaweiyun_SYS_DDMS: Huawei Cloud SYS.DDMS monitoring view metrics display includes message throughput, latency, concurrent connections, and reliability, reflecting DDMS's performance and reliability in handling large-scale message transmission and real-time data streams.
Tencent Cloud:
- tencent_keewidb: Tencent Cloud KeeWiDB metrics display, including connection count, requests, cache, keys, slow queries, etc.
- tencent_mariadb: High-performance read/write capability, low-latency query response time, and support for high-concurrency transactions and scalability.
- tencent_memcached: High-speed memory read/write capability, low-latency data access time, and high-concurrency access processing capability.
- tencent_tdsql_c_mysql: High-throughput read/write capability, low-latency query response time, and support for high-concurrency transactions and scalability.
Other:
- openai: OpenAI metrics display includes total requests, response time, request count, request error count, and consumed token count.
- monitor_jira: When our application or system encounters an exception, timely handling is required to ensure normal operation. To better manage and track incident events, these events can be sent to Jira to create incidents, which can then be tracked, analyzed, and resolved within Jira. Quickly sending incident events to Jira provides better management and tracking capabilities, ensuring the normal operation of the system. This method also helps analyze and resolve problems, improving system stability and reliability.
August 29, 2023¶
Guance Updates¶
- Scenarios > SLO Charts: Added fault time display.
- Deployment Edition: Backend management Mapping Rules added configuration to apply adaptation rules only to new members, effective only for the first joining members when enabled.
August 24, 2023¶
Guance Updates¶
- Billing Items:
- Backup Logs: Added OSS, OBS, AWS S3, Kafka four archiving type billing items, statistically summarizing forwarded traffic based on user-selected archiving types and billing according to corresponding data;
- Application Performance Trace, User Access PV added 30-day/60-day data retention policies.
- Monitoring:
- Silence Rules: Supports configuring silence based on different dimensions.
- Monitors: Supports adding tags to monitors, filtering lists by tags; added quick filter columns to the monitor list and made some optimizations;
- SLO: Added Fault Time display column.
- Logs > Backup Logs: Added Kafka Message Queue external storage.
- Viewers/Dashboards: Added Auto Refresh Function.
- Viewer Detail Pages: Added Bind Built-in Views entry.
Integration Updates¶
- Alibaba Cloud RDS MariaDB: Alibaba Cloud RDS MariaDB metrics display includes response time, concurrent connections, QPS, and TPS.
- Alibaba Cloud RocketMQ4: Alibaba Cloud RocketMQ 4.0 metrics display includes message throughput, latency, reliability, and horizontal scalability.
- Alibaba Cloud Tair Community Edition: Alibaba Cloud Tair Community Edition metrics display includes CPU utilization, memory utilization, proxy total QPS, network traffic, hit rate, etc.
- AWS DynamoDB: AWS DynamoDB metrics display includes throughput capacity units (Capacity Units), latency, concurrent connections, and read/write throughput, reflecting DynamoDB's performance and scalability in handling large-scale data storage and access.
- AWS EventBridge: AWS EventBridge metrics display includes event delivery latency, throughput, event scale, and scalability, reflecting EventBridge's performance and reliability in handling large-scale event streams and real-time data delivery.
- AWS Lambda: AWS Lambda metrics display includes cold start time, execution time, concurrent executions, and memory usage, reflecting Lambda functions' response speed, scalability, and resource utilization.
- HUAWEI SYS.AS: HUAWEI SYS.AS metrics display includes response time, concurrent connections, throughput, and reliability, reflecting SYS.AS's performance and stability in handling application requests and data interactions.
- HUAWEI SYS.CBR: HUAWEI SYS.CBR metrics display includes bandwidth utilization, latency, packet loss rate, and network throughput, reflecting CBR's performance and quality assurance in network transmission and bandwidth management.
- Huawei Cloud GaussDB-Cassandra: Huawei Cloud GaussDB-Cassandra metrics display includes read/write throughput, latency, data consistency, and scalability, reflecting its performance and reliability in handling large-scale distributed data storage and access.
- Huawei Cloud GaussDB for MySQL: Huawei Cloud GaussDB for MySQL metrics display includes response time, concurrent connections, read/write throughput, and scalability, reflecting its performance and reliability in handling large-scale relational database operations.
- Huawei Cloud GaussDB-Influx: Huawei Cloud GaussDB-Influx metrics display includes write throughput, query latency, data retention policy, and scalability, reflecting its performance and reliability in handling large-scale time-series data storage and querying.
- Huawei Cloud GaussDB-Redis: Huawei Cloud GaussDB-Redis metrics display includes read/write throughput, response time, concurrent connections, and data persistence, reflecting its performance and reliability in handling high-concurrency data storage and caching.
- Huawei Cloud GaussDB SYS.GAUSSDBV5: Provides CPU, memory, disk, deadlock, SQL response time data.
- Huawei Cloud MongoDB: Huawei Cloud MongoDB metrics display includes read/write throughput, latency, concurrent connections, and data reliability, reflecting its performance and scalability in handling large-scale document storage and querying.
- Huawei Cloud RDS PostgreSQL: Huawei Cloud RDS PostgreSQL metrics display includes query performance, transaction throughput, concurrent connections, and data reliability, reflecting its performance and reliability in handling large-scale relational data storage and transaction processing.
- Tencent Cloud CKafka: Tencent Cloud CKafka metrics display includes message throughput, latency, concurrent connections, and reliability, reflecting its performance and reliability in handling large-scale message transmission and real-time data streams.
- Zadigx: Zadigx displays overview, automated builds, automated deployment, automated testing, etc.
- Lark and Incident Tracking Integration: To facilitate timely receipt of new Issues in Incident Tracking, you can create a bot in an internal group (Lark, DingTalk, or WeCom) to receive reminders for new Issues or new replies in Incident Tracking, helping to handle Issues promptly; you can also quickly reply to Issues by mentioning the bot, improving anomaly handling efficiency.
August 17, 2023¶
Guance Updates¶
- Management: Added Sensitive Data Scan function: By creating desensitization rules for data, achieve information shielding.
- Added billing item: Sensitive Data Scan Traffic: Based on scanning rules, statistically summarize the size of original sensitive data traffic scanned (per GB/day).
- Paid Plans and Billing: Consumption analysis section was temporarily removed due to renovation and optimization.
August 10, 2023¶
Guance Updates¶
- Added billing item:
- Scheduled Report: Charged based on the number of scheduled reports sent daily in the workspace;
- Scenarios:
- Added Service Management: Service Management is a centralized entry point for accessing key information about all services, allowing users to view performance and business data of different services within the current workspace and all associated analyses, quickly locate and resolve service-related issues.
- All charts support PromQL and expression queries.
- Logs: Directly view Context Logs in log detail pages; context search range can be selected.
- Viewer: When opening a data detail page, supports one-click Export of current data as a JSON file.
- Application Performance Monitoring > Service > Call Topology: Added upstream/downstream call relationship table, displaying request count, average response time, and error count for single-directional service relationships.
- Monitor > Threshold Detection: Added Convert to PromQL Query for detection metrics.
- Infrastructure > Container: Pods, Services, Deployments, Nodes, ReplicaSets, CronJobs, Daemonset detail pages added Kubernetes Events component.
July 27, 2023¶
Guance Updates¶
- Scenarios > Dashboard: Added Scheduled Report Function, supporting users to create reports based on certain dashboards and configure scheduled email sending.
- Navigation bar added Invite Members entry, allowing quick invitation of members. In the management page, added Approval of Invitations button. When this button is enabled, invitations sent to members must be approved in the invitation record for member join applications.
- Logs > Backup Logs has the following adjustments:
- Guance default archiving type offline:
- Newly created backup rules will no longer support the 【Guance】default option;
- Existing backup rules remain effective.
- Added support for backing up to external storage Alibaba Cloud OSS.
- Guance default archiving type offline:
- Monitoring > New: Supports saving monitors as Custom Template Libraries for quick creation of similar monitor detections.
- Monitoring > New Monitor > Custom Creation: Except for 【Mutation Detection】【Range Detection】【Outlier Detection】, all detection rules' detection frequencies added 【Last 12 Hours】【Latest 24 Hours】options.
- Incident Tracking: Added Delivery Channel configuration entry on the new Issue page, supporting multi-selection; added Unknown option to severity level, default selected.
- To meet user data compliance requirements, Snapshots support desensitization of certain content in fields using regex syntax.
- Scenario > Log Stream Chart added Copy as cURL and export to CSV file features.
- User Access Monitoring > Viewer > Error: Added Cluster Analysis feature for easy viewing of frequently occurring errors.
- Added data limit prompts: When log, trace, and other data reach today's limit, data reception stops. Contact your customer manager for adjustments.
July 11, 2023¶
Guance Updates¶
- Integration upgrade: Click any integration solution to understand the full chain usage scheme from configuration access, data collection to data application on the same page.
- Monitor > Template function optimization: Supports creating or batch creating based on a single detection rule; supports filtering based on the detection library.
- Application Performance Monitoring > Trace: Span List page added Waterfall Chart Mode, helping users analyze Span data information more intuitively; Service Call Relationship changed from service (service) level to service/resource level, drilling down to interface level for better analysis of performance and call issues, thus helping users find problem points faster through interface calls.
- Charts > Overview Chart: Added thousand separator; in Unit > Value, "default" changed to "ten thousand";- Charts > Rectangular Tree Map: Added display value option, allowing the query result values to be shown directly in the chart.
-
Charts > Add Link: Added
query
parameter, removedtags
,search
two parameters. -
Application Performance Monitoring > Service list supports export.
Intelligent Inspection Updates¶
Function Optimization:
- Application Performance Inspection: Added entry to change default detection thresholds, now you can modify the trigger values of services that need to be detected when enabling inspections.
- RUM Performance Inspection: Optimized root cause display logic in page detail modules, making root cause localization more accurate after optimization.
- Workspace Asset Inspection: Added default configuration (7 days), now inspections can run without parameters when enabled.
New Scripts:
- Cloud Message Queue RocketMQ4.0
- Huawei Cloud-CSS
- Huawei Cloud-RocketMQ
- Huawei Cloud-WAF Event List
- Huawei Cloud-WAF Event Overview
June 29, 2023¶
Guance Updates¶
This update simplifies the registration process:
- International Guance Product Services officially launched, users can purchase from AWS overseas cloud market.
-
International Guance products adopt a dollar-based pricing system. Data from workspaces registered at the original Oregon site in China will be billed according to the adjusted prices.
-
The concept of Guance Corporate Account is officially renamed to Billing Center Account;
Other updates:
- Snapshot Permissions: Read-only members support creating and deleting Visible Only to Me snapshots.
June 20, 2023¶
Guance Updates¶
- RUM (Real User Monitoring) collector is used to collect user access monitoring data reported by web or mobile ends. Now provides RUM Headless one-click activation service, achieving automated installation and deployment on Guance cloud hosts, automatically completing DataKit installation and RUM collector deployment. You only need to manually integrate applications.
- Viewer: Optimized filtering, searching interaction conversion logic, ensuring what you see is what you get, and allowing free switching between UI and handwritten modes. Note: The DQL handwritten mode for log viewers will be deprecated after the new version launch.
- Logs > Backup Logs: Added external storage type selection, supporting writing to S3(AWS) Object Storage and Huawei Cloud OBS.
- Logs > Index: Added LogEase Data Binding Configuration Entry.
- Dashboards/Built-in Views support Root Cause Analysis and Drill-down Analysis.
- Management > Role Management: Supports Cloning Existing User Roles to reduce operational steps, quickly add/remove permissions, and create roles.
- Infrastructure > Containers: Added Daemonset Object Data display, allowing drag-and-drop changes to object classification display order.
- Infrastructure > Containers: Deployments, Pods support direct association with Kubernetes event logs, view specific log information directly on detail pages.
- Added Incident Tracking OpenAPI Interface.
- Management > Member Management lists, Monitoring > Notification Targets Management > Mail Group, Incident Tracking > View Members, all notification target selections support searching by member nickname.
- When a ticket status updates or has new replies, notify customers via interface or email reminders.
- Optimized prompts for invalid characters or length limits in text input fields.
Intelligent Inspection Updates¶
-
New Inspections
- AWS Cloudtrail Anomaly Event Inspection: AWS CloudTrail is a service used for tracking, logging, and monitoring activities in AWS accounts. It records operations performed within AWS accounts, including management console access, API calls, resource changes, etc. By monitoring CloudTrail error events, potential security issues can be identified promptly. For example, unauthorized API calls, denied resource access, abnormal authentication attempts, etc. This helps protect your AWS account and resources from unauthorized access and malicious activities; it also allows you to understand the types, frequency, and impact scope of failures occurring in the system. This helps you quickly identify problems and take appropriate corrective measures to reduce downtime and business impact.
-
New Scripts
- Guance Integration (Alibaba Cloud-RDS Error Logs): Collects Alibaba Cloud RDS error logs for RDS error diagnostics;
- Filebeats Data Collector: Collects FileBeats performance data for observing FileBeats performance, latency, etc.
- Logstash Data Collector: Collects Logstash performance data for observing Logstash performance, latency, etc.
June 6, 2023¶
Guance Updates¶
- To further meet user data viewing needs, the paid plan and billing for commercial editions added High Consumption Warning Settings, added consumption analysis lists, supporting viewing various expenditure statistics.
- Added Menu Style Selection when creating workspaces, supporting different workspace style attributes.
- Optimized permission-related rules for log data access, further clarifying multi-role data query permissions and corresponding control relationships.
- Under the basic attributes of the event detail page, the Detection Dimension added associated queries, supporting viewing and filtering all field values under the current detection dimension.
- Alert Strategy Management supports sending alerts to different notification targets based on different severity levels.
- Member Management added nickname annotation function, standardizing member usernames within the workspace, supporting searching members through nickname annotations.
- Batch operation functions added to dashboard, viewer, monitoring, member management, sharing management, etc., page lists.
- Application Performance Monitoring services support modifying colors and adjusting header sorting.
- Log, application performance monitoring > Error Tracking Viewer cluster analysis supports sorting document counts, defaulting to descending order.
- Supports saving selected language versions during login to browser local storage, automatically displaying the last selected language version upon next login.
- Generated metric frequency options adjusted, supporting selecting 1 minute, 5 minutes, 15 minutes.
Guance Deployment Edition Updates¶
- Backend management added Password Security Policy: Added password 8-character length limit and password validity period function.
Intelligent Inspection Updates¶
-
New Inspections
- Workspace Asset Inspection: Ensuring normal service operation by timely discovering faults or anomalies, reducing business losses. Additionally, inspections help improve service availability and stability, identifying and resolving potential issues. They also enhance operational efficiency, accelerating problem diagnosis and resolution, optimizing resource allocation. Ensuring business security. Through regular inspections of hosts, K8s, containers, etc., operations personnel can ensure these services efficiently and stably support business, providing a continuous and reliable operating environment for enterprises.
-
New Scripts
- Gitlab Development Efficiency Analysis: Based on Gitlab's code commit frequency and each code volume, displays team development efficiency by team, individual, and time dimensions.
June 1, 2023¶
Guance Updates¶
DataFlux Func is Guance's extension programming platform, used for synchronous cloud platform data, function development, management, and execution. Now supports DataFlux Func (Automata) one-click activation service in all domestic sites, completing automatic deployment of Func in cloud hosts after activation, and quick login to the corresponding Func platform in the workspace Integration.
May 22, 2023¶
Guance Updates¶
- RUM application configuration added Custom Types and associated view analysis
- DQL function supports Regex Aggregation data statistics display, adding string regex parsing functions to extract fields based on regex patterns and check if fields contain matching substrings
- Added PromQL syntax query entry, supporting PromQL Query for time series data
- show_tag_value() function supports querying associated tags for specified metric fields
- Mini Program SDK supports collecting startup parameter-related information; Added Custom Error Reporting.
- Status Page supports Subscribing to Incident Notifications
- Added field management function, showing corresponding descriptions and unit information for selected fields in Monitor, Chart Queries, Viewers, etc.
- Metric Analysis added table functionality, supporting downloads
- Ticket Status adjustments
- Added incident tracking guide page, channels added Time Range Filtering
- Backup Logs Optimization:
- Backup Rule Entry moved to Backup Logs > Backup Management;
- Added full backup logic: not adding filters indicates saving all log data
Guance Deployment Edition Updates¶
- Backend management added Audit Events logging
Intelligent Inspection Updates¶
-
New Inspections
-
Cloud Idle Resource Inspection: With the rapid development of cloud computing as a new IT service method, it provides convenient, fast, and elastic IT infrastructure and application services for enterprises and individuals, bringing high efficiency and economy. However, as cloud resources gradually become the main component of enterprise data centers, the issue of significant waste of cloud resources becomes more prominent. Especially within enterprises, due to demand fluctuations and departmental isolation, some cloud resources cannot be fully utilized, forming a large number of idle resources. This situation can significantly increase cloud service costs, decrease resource efficiency, and potentially lower security and performance levels. To better manage and optimize cloud idle resources, improving cloud computing benefits and resource utilization, performing cloud idle resource inspections is essential. Through inspections, unnecessary resources in current cloud services can be discovered and handled promptly, avoiding unnecessary expenses, data breaches, poor performance, and other issues caused by long-term unnecessary resource usage.
-
Host Restart Inspection: Host abnormal restart monitoring is an important part of modern internet system operations. On one hand, the stability and reliability of computer systems are crucial for smooth business operations and user experience. When hosts encounter abnormal restarts, it can lead to system crashes, service interruptions, and data loss, affecting business operations and user satisfaction. On the other hand, with the increasing number and scale of hosts and rising system complexity in cloud and virtualization environments, the probability of issues increases, requiring system administrators to use relevant monitoring tools for real-time monitoring and timely discovery and resolution of abnormal restarts. Therefore, implementing reasonable host abnormal restart monitoring can help diagnose problems quickly, reduce business risks, improve operational efficiency, and enhance user experience.
-
-
Function Optimization
- Idle Host Inspection: Added cost-related information for cloud host types.
For more intelligent inspection updates, refer to Intelligent Inspection Version History.
April 27, 2023¶
Guance Updates¶
- Overview charts support displaying multiple comparative dimensions simultaneously (daily YoY, weekly YoY, monthly YoY, etc.)
- Standard members added snapshot sharing function
- DQL query renamed to Query Tool, added execute button
- Host list display optimized, hosts in alert silence have new mute prompt
- SLO alert notification content optimized, added workspace and site information
- Optimized display logic for workspace ID and token, default hidden, supports viewing and copying
- Experience edition workspaces added Session Replay, Profile usage restrictions
April 23, 2023¶
Guance Billing Updates:¶
-
Guance's self-developed time-series database GuanceDB officially launched, time-series data storage and billing will be adjusted as follows:
- Infrastructure (DataKit) billing items offline, original "DataKit + Time Series", "Only Time Series" two billing models will be charged based solely on GuanceDB time series;
- GuanceDB Time Series: Charges based on active time series count per day, price as low as ¥0.6 / thousand time series.
-
User Access Monitoring "Session Replay" officially starts charging, charged based on actual collected session replay data session count, ¥10 / thousand sessions.
More details can be found in the Billing Method documentation.
Guance Feature Updates:¶
- GuanceDB Time-Series Database officially launched
- Incident Tracking new features launched
- Cross-Site Workspace Authorization feature launched
- SLS added Third-Party Authorization opening
- Index binding configuration page optimized, supports custom addition of mapping field configurations
- Chart optimizations
- Command Panel added custom function selection for local Func
- Time Series Chart added Advanced Functions, supporting local Func processing DQL query results and returning for display
- Workspaces added Time Zone Configuration, users can customize the timezone for query times in the current workspace
- Integration > DataKit page guidance optimized
- Viewer column bar distribution chart added statistical time interval display
- Navigation menu supports right-click to open in new tab
- Fixed blacklist duplicate import issues
Guance Deployment Edition Updates¶
- Added Account Login Mapping Rule Configuration, dynamically assigning members to workspaces and corresponding roles based on different mapping rules.
DataKit Updates¶
New Features:
- Added Pinpoint API integration
Function Optimizations:
- Optimized Windows installation script and upgrade script output, facilitating direct copy-paste in terminal
- Optimized Datakit's own documentation build process
- Optimized OpenTelemetry field handling
- Prom collector supports collecting
info
type labels and appending them to all related metrics (default enabled) - In the system collector, added CPU and memory percentage metrics
- Datakit adds data point count marking (
X-Points
) in sent data, aiding related metric building in the center- Also optimized Datakit HTTP's
User-Agent
marking todatakit-<os>-<arch>/<version>
format
- Also optimized Datakit HTTP's
- KafkaMQ:
- Supports handling Jaeger data
- Optimized SkyWalking data processing flow
- Added third-party RUM integration function
- SkyWalking added HTTP integration function
- Added the following integration tests:
- Apache
- JVM
- Memcached
- MongoDB
- RabbitMQ
- Statsd
- Tomcat
- etcd
More DataKit updates can be found in the DataKit Version History.
April 13, 2023¶
Intelligent Inspection Updates¶
-
Script Market Intelligent Inspection Script Set:
- Optimized enablement steps, no need to create new scripts or schedules, clicking install from the official script market automatically completes creation and scheduling, configure parameters to enable;
- Updated Disk Usage Rate Inspection: Optimized disk usage rate trend judgment algorithm, providing more precise problem location for users.
-
Script Market Cloud Sync Script Set:
- Optimized enablement steps, no need to create new scripts or schedules, clicking install from the official script market automatically completes creation and scheduling, configure parameters to enable;
- Added AWS sync with multiple authentication methods;
- Added AWS Cloudwatch Logs sync.
More intelligent inspection updates can be found in the Intelligent Inspection Version History.
April 11, 2023¶
Guance Updates¶
Added Huawei Cloud Store Opening Process¶
- Guance added a one-click opening process for Huawei Cloud Store, subscribing to Guance products on the Huawei Cloud Store allows direct use of Guance. More details can be found in the Opening Guance Commercial Edition on Huawei Cloud Store documentation.
April 6, 2023¶
Guance Updates¶
- Logs added 3-day data retention policy and pricing, refer to the Billing Method documentation for billing-related information.
- Logs added Data Access permission control, supporting granting viewing permissions for a certain range of log data to relevant roles
- Role Permission List added data query permissions for each functional module, supporting configuring data query permissions for custom roles
- Standard members added "Snapshot Management" permissions, supporting snapshot creation and deletion operations
- Snapshot Sharing supports search functionality. (DQL query mode does not support adjusting search scope)
- Supports creating Custom Notification Targets via websocket protocol for local Func, enabling external notification channels to receive alert notifications
- Viewer added Copy as cURL data query function
- Dashboard chart configuration interaction optimized
- Overview Chart added numerical unit option configuration, supporting selection of Chinese scientific notation (default) and short scale
- Added whether View Variables apply to chart effect display
- When charts have grouping conditions, supports applying the value of a certain grouping condition in reverse to view variables for linked filtering
- When charts have grouping conditions, selecting a certain grouping condition's corresponding timeline or data point supports highlighting similar groupings in other charts
- Drag-and-drop effects optimized
- Account Inactivity Session Expiration Time default set to 3 hours, this adjustment applies only to accounts that have not edited the inactive session expiration time configuration, not affecting accounts that have already edited the inactive session expiration time configuration.
- History Filter added saved search conditions
- User Access Monitoring Application SDK Integration guidance optimized
- Generate Metrics configuration optimized, supporting configuring units and descriptions for newly generated metrics
- Host Viewer supports multiline display, label displays on a new line in multiline mode
- Time Series Chart, Pie Chart added return display quantity configuration
DataKit Updates¶
New Features
- Added servo service to manage Datakit upgrades
- Added troubleshooting function
Function Optimizations
- Optimized upgrade function to prevent datakit.conf file corruption
- Optimized cgroup configuration, removed CPU minimum value limit
- Optimized self collector, allowing disabling this collector and optimizing its collection performance
- Prom collector allows adding instance tag to maintain consistency with native Prometheus system
- DCA added Kubernetes deployment method
- Optimized disk cache performance for log collection
- Exposed more Prometheus metrics in Datakit's own metrics system
- Optimized /v1/write
- Optimized error prompts during installation when token is incorrect
- Monitor automatically retrieves connection address from datakit.conf
- Removed eBPF kernel version checks to support more kernel versions
- Kafka subscription collection supports multi-line JSON function
- Optimized IO module configuration, added upload worker count configuration field
Compatibility Adjustments
- Removed most Sinker functions, retaining only Dataway Sinker functions. Both host installation configuration and Kubernetes installation configuration of Sinker have been adjusted, and the configuration methods differ from previous ones. Please note these adjustments during upgrades.
- Replaced the old failed disk cache implementation due to performance issues. The new implementation's binary format is incompatible with the old cache. If upgrading, it is recommended to manually delete old cache data (old data may affect new version disk cache), then upgrade to the new Datakit version. Despite this, the new version's disk cache remains experimental, please use cautiously.
- Datakit's own metrics system has been updated, resulting in missing some previously obtained metrics from DCA, but it does not affect the operation of DCA itself.
More DataKit updates can be found in the DataKit Version History.
March 23, 2023¶
Guance Updates¶
-
Help Document Search Function Optimization
-
Backup Logs added extended field save logic, default backing up only message content to backup logs. If "Sync Extended Fields" is checked, it backs up the entire log data that meets the filter criteria.
- Viewer/Dashboard Time Control added "Time Zone Selection" and "Global Lock" functions
-
Monitor Optimization
- Supports viewing historical configurations, supports clicking to restore to Historical Configuration Versions
- Added creation and change information display in lists and pages
- Mutation Detection added comparison dimensions, supporting comparing statistical indicators with "Yesterday", "Last Hour"
-
Intelligent Inspection events added feedback entry
- Snapshots sharing supports adding "Creator" watermark display
- Registration and opening process optimization, cloud market opening path added site selection
- Notes creation logic and content addition interaction adjustments
- Chart Query added label exclusion logic
- Trace detail page Span list display logic adjusted, sorted by "Duration" in descending order
- Member Management role modification logic adjusted after triggering review process
- Viewer column width saving, log display multiline logic adjustments
March 9, 2023¶
Guance Updates¶
Data Retention Policy Change Optimization¶
Removed the logic limiting data retention policy modifications to once per day, supporting multiple adjustments to data retention policies within the same day.
Note: The first modification on the same day takes effect immediately, while subsequent modifications will take effect the next day based on the last adjustment record. Refer to the Data Retention Policy documentation for more information.
Chart Link Configuration Optimization¶
Upgraded chart link configuration interaction, supporting free combination generation of final chart-associated link URLs via parameter configuration. Refer to the Custom Links documentation for more details.
Added Support for Creating Duplicate Dashboards, Notes, Custom Viewers¶
Optimized the import function of dashboards, notes, custom viewers, supporting custom actions like "Skip", "Still Create", "Cancel" when encountering duplicate files. Involved import modules:
- Scenarios: Dashboards, Notes, Viewers
- Management: Settings - Configuration Migration
Note: If "Cancel" is selected during import, none of the selected files will be imported. Refer to the Configuration Migration documentation for more details.
DQL Parameter Priority Adjustment¶
When using handwritten DQL mode to query data, the time parameter configuration in DQL will take precedence over the input range of the time widget. Involved functions:
- Dashboard: Default value query of view variables, chart query
- Metric Analysis
- DQL Query Tool
Log Message Data Display Optimization¶
Log view lists support selecting to display all message content. Involved functions:
- Log Viewer
- Associated log pages in various viewer detail pages
Monitor Configuration Page Optimization¶
When configuring monitor event notifications:
- Supports custom "Data Gap" event notification templates
- Event content supports adding jump links, besides the default provided links, custom jump links can also be added
Refer to the Monitor Configuration documentation for more details.
SSO Related Optimizations¶
- SSO users support modifying account information and session persistence time policies
- SAML account mapping rule configuration optimized, compatible with "Email" in various case formats
- Single sign-on link retrieval logic optimized, listing login links for workspaces already joined by SSO users with priority
Other Function Optimizations¶
- Commercial edition opening process supports three ways to choose from: "Guance Direct Opening", "Alibaba Cloud Market Opening", and "Amazon Cloud Market Opening";
- Removed left * query function range for newly opened workspaces, no longer default supporting left * query for new workspaces. Contact your client manager if needed;
- SLIMIT limit adjustment, when there is a
group by
in time series chart queries, the default returns up to 20 data points; - New user workspace onboarding guide process optimized.
DataKit Updates¶
New Features
- Pipeline supports key deletion
- Pipeline adds new KV operations
- Pipeline adds time functions
- netstat supports IPv6
- diskio supports io wait metrics
- Container collection allows coexistence of Docker and Containerd
- Consolidated Datakit Operator configuration documentation
Function Optimizations
- Optimized Point Checker
- Optimized Pipeline replace performance
- Optimized Windows Datakit installation process
- Optimized confd configuration processing flow
- Added Filebeat integration testing capability
- Added Nginx integration testing capability
- Restructured OTEL Agent
- Restructured Datakit Monitor information
Refer to the DataKit Version History for more DataKit updates.
February 28, 2023¶
Guance Updates¶
Added Session Replay Function¶
Session Replay is a reconstruction demonstration of user experience on websites, capturing clicks, mouse movements, and page scrolls to generate video records, gaining deeper insights into user operations. Refer to the Session Replay documentation for more details.
Optimized AWS Opening Process¶
Guance optimized the one-click opening process for AWS Marketplace, allowing direct use of Guance after subscribing to Guance products on AWS Marketplace. Refer to the Opening Guance on AWS documentation for more details.
February 23, 2023¶
Guance Updates¶
User Access Monitoring Optimization¶
Added User Access Monitoring Automated Tracking¶
User Access Monitoring added automated tracking, implemented via "browser plugin" to record user behavior using the browser, creating code-free end-to-end tests. Refer to the Automated Tracking documentation for more details.
User Access Monitoring Application List, Viewer, Analysis Dashboard Layout Overall Adjustment¶
- User Access Monitoring application list display layout adjusted, supporting jumping to view "Analysis Dashboard" and "Viewer" content details for the current application.
- User Access Monitoring "Viewer" supports viewing user access data for all applications, filter "Application ID" to view and analyze data from different applications.
- User Access Monitoring "Analysis Dashboard" supports switching views for Web, Mobile, Mini Programs scenarios.
Added CDN Quality Analysis¶
User Access Monitoring added CDN vendor information collection, analyzing charts to evaluate the quality of different vendors' CDNs. Refer to the User Access Monitoring Collector Configuration for more configurations.
Added UniAPP Application Integration¶
User Access Monitoring added UniAPP application integration, currently supporting Android and iOS platforms. Refer to the UniApp Application Integration documentation for more details.
Scenario Optimization¶
Added Custom Viewer Navigation Menu¶
In the scenario viewer list, added support for adding the current viewer to the navigation menu of Infrastructure, Metrics, Logs, APM, RUM, Synthetic Tests, Security Check, CI Visualization. Refer to the Add Viewer Navigation Menu documentation for more details.
Enhanced Scenario View Variable Cascade Function¶
In scenario view variable cascade query configuration, supports using =
, !=
for exact match of variable values, and match(re)
, not match(re)
, wildcard
, not wildcard
for fuzzy match of variable values. Refer to the View Variable documentation for more details.
Pie Chart Added Merge Configuration Option¶
Pie Chart added merge configuration option, supporting merging redundant data points into "Others" for better readability. Refer to the Pie Chart documentation for more details.
Adjusted Chart Query Operator Translation Logic¶
Adjusted translation logic for match / not match operators in chart queries, removing the default addition of right * matching logic for log-type data, which can be manually added in the input box if needed.
Other Function Optimizations¶
- Guance Commercial Edition Registration process supports binding Guance Billing Center account;
- Configuring Monitors allows "Detection Dimensions" to be non-mandatory.
DataKit Updates¶
New Features
- Command line added row protocol parsing function
- Datakit yaml and helm support resource limit configuration
- Datakit yaml and helm support CRD deployment
- Added SQL-Server integration testing
- RUM supports resource CDN labeling
Function Optimizations
- Optimized dial test logic
- Optimized Windows installation prompts
- Optimized powershell installation script template
- Optimized k8s Pod, ReplicaSet, Deployment association methods
- Restructured point data structure and functions
- Datakit includes eBPF collector binary installation
Refer to the DataKit Version History for more DataKit updates.
February 16, 2023¶
Guance Updates¶
Optimized Workspace Permissions Management¶
Added Member Roles and Permissions List Management¶
Guance added role management function, supporting setting different Guance function access permissions for employees within enterprises to achieve permission isolation among different employees.
Guance defaults provide four member roles: "Owner", "Administrator", "Standard", and "Read-only". Besides default roles, Guance supports creating new roles in role management and assigning permission scopes to roles to meet different users' permission needs. Refer to the Role Management documentation for more details.
Optimized Member Invitation, Added Select Member Permissions¶
In the current workspace, invited new members have default read-only permissions, and added support for selecting one or more roles to set new member permissions. Refer to the Member Management documentation for more details.
Added Bulk Modify Member Permissions¶
In member management, added bulk modify permissions function. Click "Bulk Modify Permissions", select members needing batch permission modification, click "Confirm", choose permissions for members in the pop-up dialog, and click "Confirm". Refer to the Member Management documentation for more details.
Optimized SSO Management, Added SAML Mapping Function¶
Guance added SAML mapping configuration to provide finer-grained single sign-on solutions for enterprises. After enabling SAML mapping, it supports dynamically assigning access permissions to enterprise employees, who can access Guance based on assigned roles.
In Guance workspace "Management"-"Member Management"-"SSO Management"-"SSO Login", enable "SAML Mapping" and configure the mapping relationship. Refer to the SSO Management documentation for more details.
Member Management Page Display Optimization¶
In member management, added custom role management function, adjusting search, quick filter layouts. Refer to the Member Management documentation for more details.
Permission Change Review Optimization¶
Based on the added role permission management, adjusted the trigger conditions for fee center reviews. When user roles are granted Token viewing and operation permissions, it triggers the Guance fee center review. Refer to the Permission Change Review documentation for more details.
Added Login Session Persistence Time Setting¶
Guance supports setting session persistence time for accounts logging into workspaces, including SSO single sign-on accounts and workspace-registered accounts, supporting setting "No Operation Login Session Persistence Time" and "Maximum Login Session Persistence Time", settings after which timeout login sessions will expire.
- No Operation Login Session Persistence Time: Supports setting range 30 ~ 1440 minutes, default 30 minutes;
- Maximum Login Session Persistence Time: Supports setting range 0 ~ 7 days, where 0 means never timeout, default 7 days.
Added Ticket Management¶
For issues encountered in Guance, users can submit tickets for consultation and suggestions, and the official team will handle and respond promptly. For example: difficult-to-resolve issues during use, inquiries about purchases and fees, proposing demand suggestions to Guance, etc.
The ticket system is account-level, allowing users to view all tickets submitted by themselves across workspaces. Ticket management entry: bottom-left corner "Account"-"Ticket Management". Refer to the Ticket Management documentation for more details.
Other Function Optimizations¶
- Workspace creation added language selection, language options affect event, alert, SMS templates within the workspace. If English is chosen, the above corresponding templates will default to English templates;
- Optimized workspace lock function, if the fee center account is overdue or cloud market subscription is abnormal, it leads to workspace locking. After workspace locking, new data reporting stops, Guance provides a 14-day buffer period during which historical data can still be viewed and analyzed, and unlocking can resume Guance usage. Refer to the Workspace Lock documentation for more details.
Intelligent Inspection Updates¶
- RUM Performance Inspection: Supports jumping to view problematic Session IDs impacting users, providing more professional optimization suggestions in inspection event reports.
- Cloud Account Instance-Level Bill Inspection: Added support for AWS account instance-level bill inspection.
Refer to the Intelligent Inspection Update Log for more intelligent inspection updates.
Best Practice Updates¶
- Cloud Platform Integration
- Alibaba Cloud - Alibaba Cloud EventBridge Best Practices
Refer to the Best Practice Version History for more best practice updates.
February 9, 2023¶
DataKit Updates¶
New Features
- Datakit host installation can customize default collectors enabled
- Provides OTEL error tracking
- Provides RUM Session replay capability
Function Optimizations
- Datakit Pyroscope profiling multi-programming language recognition
- Optimized CPU, Disk, EBPF, Net Chinese and English documentation
- Optimized Elasticsearch, PostgreSQL, Dial Testing English documentation
- Optimized DCA, Profiling documentation
- Optimized log collection process
- IPloc YAML configuration method documentation support
Refer to the DataKit Version History for more DataKit updates.
Intelligent Inspection Updates¶
New Inspections¶
- RUM Performance Inspection: Real User Monitoring (RUM) is an application performance monitoring technology aimed at evaluating website performance by simulating real-user behavior on browsing websites. RUM aims to understand website performance from the user's perspective, such as load time, page rendering, element loading, and interaction response. RUM performance inspection is mainly used for client-side websites, such as e-commerce, financial, entertainment websites, etc., which require presenting a fast and smooth user experience. Analyzing RUM performance results can help developers quickly understand the actual user experience and rapidly improve website performance.
- Kubernetes Health Inspection: Nowadays, Kubernetes has swept the container ecosystem, serving as the brain for distributed container deployments, managing service-oriented applications. Kubernetes provides mechanisms for application deployment, scheduling, updates, service discovery, and scaling. However, how to ensure the health of Kubernetes nodes? Intelligent inspections can retrieve and detect resource states, APM, service fault logs, etc., to accelerate event investigation, reduce engineer pressure, minimize average repair time, and improve end-user experience.
Refer to the Intelligent Inspection Update Log for more intelligent inspection updates.
January 17, 2023¶
Guance English Version Launched¶
January 12, 2023¶
Guance Updates¶
Added Guance Site Service Status Page¶
Guance provides a Status Page to help you view the service status of different Guance sites in real-time. If logged into Guance, you can view the service status of various Guance sites by clicking on the bottom-left Help > Status Page. Refer to the Status Page documentation for more details.
Added Binding Self-built Elasticsearch/OpenSearch Index¶
Guance added support for binding self-built Elasticsearch/OpenSearch indexes, helping you quickly view and analyze log data. Refer to the Bind Index documentation for more details.
Added Network Viewer List Mode¶
Under "Infrastructure"-"Network", choosing "Host / Pod / Deployment / Service" supports switching to the corresponding network list to view source IP/port and destination IP/port TCP retransmission count, TCP connections, TCP closure count, TCP delay, bytes sent, bytes received, status codes, etc. Refer to the Network documentation for more details.
Added Frontend Application Span Request Duration Distribution Display¶
On the trace detail page, if the current trace belongs to a frontend application call-generated Span, you can view request duration distribution, including Queueing (queue), First Byte (first byte), Download (download) request duration ratios, helping you intuitively view the consumption ratio of a particular Span process.
Note: User Access Monitoring SDK must be version 2.2.10 or higher to see this data display. If cross-origin situations exist, adjust header configuration as needed. Refer to the Web Application Integration documentation for more details.
Optimized User Access Monitoring Session Interaction Logic¶
- Removed all record lists from Session Viewer;
- Optimized Session detail page display: Type display optimization, support switching absolute session occurrence time, added service column, detail page display optimization, error information optimization
- Changed Session update logic from append to cover based on session_id
- If there is a frontend application call-generated Span in the trace, the Span's service value will be filled based on the current user access data's service value. If the user access data does not contain service information, it defaults to "browser".
Refer to the Session (Session) documentation for more details.
Pod Metrics Collection Default Disabled¶
In the latest DataKit version, the container
collector's Pod metrics configuration is set to default disabled enable_pod_metric = false
. Refer to the Container Data Collection documentation for more details.
Other Function Optimizations¶
- Bound MFA authentication changed to email verification
- Registration changed phone verification to email verification
- Login security verification changed to slider verification
- Added Guance Exclusive Edition guidance during workspace creation
- Added workspace remark display function
- Cloud account settlement users added viewing bill lists in Guance Paid Plans and Billing
- Table charts support setting aliases based on
by grouping
- Optimized time series charts in monitor configuration, displayed only after selecting dimensions
- Optimized Data Gap Alert Configuration for Log-Type Data
- OpenAPI added create workspace interface
DataKit Updates¶
- confd added Nacos backend
- Log collector added LocalCache feature
- Supports C/C++ Profiling data
- RUM Session Replay file reporting
-
WEB DCA supports remote config updates
-
Optimized SQL data resource consumption issues
- Optimized Datakit Monitor
Refer to the DataKit Version History for more DataKit updates.
Best Practice Updates¶
- Cloud Platform Integration
- AWS - EKS Deploy DataKit.
- Monitoring Monitoring
- Application Performance Monitoring (APM) - Trace - Using datakit-operator to inject dd-java-agent.
Refer to the Best Practice Version History for more best practice updates.