Release Notes (2021)¶

This document records the update content descriptions for each release of Guance, including DataKit, Guance best practices, Guance integration documentation, and Guance.

December 30, 2021¶

Optimized Binding to Built-in Views¶

"Guance" supports associating built-in views with different tracing services, applications, log sources, projects, etc., by binding fields. According to the bound fields, you can view the associated built-in views (system views, user views) on the corresponding Explorer detail pages. Supported Explorers include scenario custom Explorers, infrastructure, logs, traces, user access, security checks, availability, etc.

Optimized Log Explorer¶

In the Log Explorer, the left-hand source list expands by default upon the first login and can be manually collapsed; the Explorer will remember the last state by default.
In the Log Explorer, click the settings button on the left to manually add filter fields for quick filtering.
In the log data list, you can hover over the log content with your mouse to expand and view all the log content. Clicking the "Copy" button copies the entire log content to the clipboard. When expanded, if possible, the system formats the log JSON; otherwise, it displays the log content normally.

Optimized Associated Display in Explorer Detail Pages¶

In the detail pages of the Log, Infrastructure, Trace, Security Check Explorers, optimized associated displays include hosts, Metrics, traces, containers, Pods, etc. Two types of associated displays are supported: fixed display and non-fixed display (displayed based on whether the associated field is included).

For example, in the Log Explorer detail page associated with a host, the associated fields are "host". To view related hosts in the log details, the "host" field must match; otherwise, the related host page cannot be viewed in the log details. After matching the fields, you can view the basic information and Metric performance status of the host under the associated host.

Attribute View: Includes basic host information, integration operation status. If cloud host collection is enabled, you can also view cloud vendor information.
Metric View: You can view default 15-minute Metric performance views for related hosts. Click 「Open this View」 to go to the built-in view, where you can customize and modify the host view via cloning and save it as a user view. The user view can then be viewed in the log detail page through binding.

Snapshot sharing supports hiding the top bar on the share page. In the snapshot list, clicking the share button allows advanced settings 「Hide Top Bar」 to be configured in the pop-up dialog box.

Optimized Chart Query Results Showing Thousand Separators¶

Guance dashboard chart query results support automatically adding thousand separators to data display. If a unit is set, the data format will follow the set unit. After setting is completed, you can preview the result.

Other Optimizations¶

Improved performance of the host network topology map query, added target domain name display in the network topology map node. That is, if the target host is not in the current workspace but the target domain exists and the port number of the target domain is less than 10000, the target domain will be displayed in the topology map.
Improved logic for pinning dashboards and notes in the scene dashboard:
Unfavorited dashboards are sorted in reverse chronological order by creation time
Favorited dashboards are sorted in reverse chronological order by favoriting time
Favorited dashboards are displayed above unfavorited dashboards
Improved cascading query logic for view variables, i.e., when two variables are linked, selecting * for the first variable does not filter the linked variable, displaying all value options.
Added help documentation links to the collapsed navigation bar on the left.

December 16, 2021¶

Added Similarity Metric Query in Time Series Charts¶

Under analysis mode in the time series charts, you can select "chart queries" as trend lines/columns for metric queries and "view similar trend metrics." By selecting an absolute time range, you can query similar metric trends within the space.

Added statistics display for lists of related logs, traces, containers, etc., in Explorer detail pages. Supports directly obtaining statistical quantities of related data in the tab titles of Explorer detail pages, including infrastructure, logs, application performance, user access, security checks, etc.

Added Export Functionality for Explorer Charts¶

Guance supports exporting any chart from the Guance space Explorer to a dashboard, note, or clipboard.

Added Explorer Search Match Query¶

Guance supports wildcard search in the Explorer search bar using a format like "host:cc*" for filtering log data from hosts with names starting similarly. Additionally, a "delete" button has been added to the right of the search bar for one-click deletion of entered text.

Through the "Container" section below the log details page in "Guance", you can view all container (CONTAINER) data related to the log's host within the last ten minutes.
Related trace and container data in log details support filtering by "trace_id" or "host".
Log details content display supports both Json and Text viewing modes, automatically showing formats based on message type.
Through the approximate text Explorer, you can view detailed logs associated with Pattern clustering.
Hover tips in the Log Explorer have removed color coding.

Optimized Mute Policies, Supporting Muting for Monitors¶

Guance supports users managing all mute rules in the current space through "Mute Management" in the "Monitoring" feature. Guance provides three types of mute: host mute, monitor mute, and group mute, supporting mute management for different hosts, monitors, and groups so that mute objects do not send alarm notifications to any notification targets during the mute period.

Optimized Monitor Management¶

Repeated monitors in the monitor list can affect users' quick location of monitoring objects. "Guance" supports choosing whether to create duplicate monitors from templates. Users can also use the newly added "Batch Management" tool to customize export/deletion of monitors.

Optimized View Variable Query Display¶

Default values have been added to dashboard view variables, allowing previews of all current view variables and selection of initial variables to view by default on the dashboard.
Dragging view variables with mouse hover (hover) adjusts their order.
Removed the "Settings" button for view variables, enabling "Sort," "Hide," and "Delete" functions directly in the view variable list.

Optimized Dashboard, Note Chart Lock Time Settings¶

Guance supports adding "More" options in dashboard and note chart lock time settings to customize lock time ranges. After this optimization, the lock time component and chart component functions remain consistent.

Optimized Help Center Page Entry¶

In the Guance help center, you can quickly view product documentation, updates, blogs, live review recordings, and more. You can also join our official service group by scanning a code.

December 2, 2021¶

Added Owner Member Role¶

Guance added an owner role for the current workspace. Currently, four workspace member permissions are supported: "Owner," "Administrator," "Standard Member," and "Read-only Member," which constrain the management, configuration, operation, and browsing permissions for different member categories. The "Owner" role has the highest operational permissions and can designate the "Administrator" for the current space and perform any management, configuration, operations, and data browsing. In the Guance workspace "Manage"-"Member Management"-"Edit," you can edit and update member permissions.

Added Custom Explorer for Scenarios¶

"Guance" provides a quick-to-build Explorer based on log data ranges in scenarios, supporting space members collaboratively building custom-scenario-based Explorers to meet customized viewing needs. Completed "Explorers" can be exported and shared with others, sharing Explorer templates.

Added Export User View to Dashboard¶

"Guance" supports exporting user-created views in the "Built-in Views" to a json file, which can be used for importing scenes or built-in views into different workspaces.

Optimized Host Network Observability, Added Network Flow Data List View¶

"Guance" supports displaying different visual charts based on selected protocols on the "Network" page of the "Host" details in the infrastructure section, and customizing the display fields for the network flow data list.

By clicking "View Network Flow Data," you can view the network flow data for the last two days by default, including time, source IP/port, destination IP/port, source host, transmission direction, protocol, bytes sent, etc. You can customize the display fields or add filter conditions to filter all string-type keyword fields.

Added sourcemap Functionality¶

When releasing applications in production environments, to prevent issues such as code leakage, files are generally converted and compressed during the packaging process. While these measures ensure code safety, they also result in collected error stack information being obfuscated, making it difficult to directly locate problems and complicating subsequent bug resolution.

To address this issue, "Guance" provides sourcemap functionality for web applications, supporting the de-obfuscation of code to facilitate easier source code localization during error troubleshooting, helping users resolve problems faster.

Added Analysis of Host-associated Security Checks¶

"Guance" supports viewing security check data related to the host within the past day and performing keyword searches, multi-label filtering, and data sorting on these security check data.

Added DataKit Collector Kubernetes Installation Guide¶

"Guance" supports adding a guide for installing the DataKit collector in a Kubernetes cluster under the workspace "Integration"-"DataKit".

Optimized Associated Trace Query for User Access Monitoring¶

"Guance" supports adding attributes to the current filter or copying them (copying the tag to the local clipboard) on the trace details page and the performance details page of the user access view (User Access Monitoring Viewer).

Optimized Registration Upgrade Process¶

Guance added direct selection of opening the Guance billing platform during account registration and optimized the upgrade process to the Agile Edition after logging into the workspace,

Price Reduction Adjustment¶

Guance adopted the latest technology to optimize data storage costs, hence adjusting the pricing with a new tiered billing model based on data storage strategies, including log data, application performance Trace, and user access PV RUM PV for these three billing items.

Additionally, to assist enterprises with more favorable prices and comprehensive observability of IT infrastructure and application systems, Guance launched three package plans according to different stages of enterprise development: Startup Acceleration Pack, Entrepreneur Development Pack, and Enterprise Standard Pack, along with stackable traffic packs for enterprises to use according to their own needs and package stacking.

Other Optimization Features¶

Added LCP, FID, CLS, FCP related detection indicators for user access monitoring. In the Guance workspace 「Monitoring」-Monitor, click 「+Create New Monitor」, select 「User Access Indicator Detection」, and enter the configuration page for detection rules.
Changed grouping in simple queries of monitors to detection dimensions. Detection dimensions determine which dimension triggers the detection rule, i.e., the triggering object. "Guance" supports adding multiple detection dimensions, and triggering alarms if any one of the detection dimensions meets the alarm condition.
Optimized navigation menu display. When the navigation bar of the Guance workspace is collapsed, the secondary menu shows the navigation name at the top.

November 18, 2021¶

Guance supports users creating identity providers based on workspaces. During login, users input their company email to obtain the corresponding SSO login link, click the SSO login link to complete verification login. In the Guance workspace 「Management」-「SSO Management」-「Create Identity Provider」, you can set up SSO single sign-on for employees.

Added SLO Chart to Dashboards and Notes¶

Added SLO charts in the scenario dashboard and notes. SLO charts can directly choose set monitoring SLOs for SLO data display, and by selecting different SLO names, the SLO data results are displayed synchronously.

Added Custom Group Field Addition for Infrastructure Grouping¶

In Guance infrastructure Explorer, click the settings button next to the group on the right side, and you can add custom group tags. After adding, you can choose to group and aggregate displays according to the added group tags.
Note: Only administrators can add custom group tags.

Added SLO Notification Mute Configuration¶

If an event is not very urgent but has a high frequency of alarm notifications, you can reduce the notification frequency by setting notification mute. After setting mute, the event will continue to occur, but no notifications will be sent. Events generated will be stored in the event management.

Optimized Chart Links¶

Guance supports adding built-in links and custom links to charts. Through links, you can jump from the current chart to the target page, and by modifying the corresponding variable values in the template variables, data information is transmitted, completing data linkage. Chart links support opening from a new page, the current page, or a slide-out detail page for linked analysis.

Price Reduction Adjustment¶

Daily DataKit price reduced to 3 yuan per unit
Availability API dial tests adjusted to 1 yuan per 10,000 tests

Other Optimization Features¶

Launched a free new version for China region 1 (Alibaba Cloud): Free Plan split into Alibaba Cloud login and AWS login. For Alibaba Cloud login, the timeline data retention strategy is 30 days, while other data retention strategies are 7 days. For AWS login, all data retention strategies are 1 day;
Optimized SLO deduction logic: Monitors in disabled status will not be counted in the deduction scope;
Added dashboard label function: When creating/modifying a dashboard view, you can add custom labels to dashboards to help with quick filtering;
Optimized log highlight display: When searching logs in the search bar, only the matched keywords in the returned list remain highlighted;
Optimized Explorer search: Added help documentation links to the Explorer search dropdown;
Optimized Markdown format for text charts: Added support for unordered lists and ordered lists, optimizing display format.

November 4, 2021¶

Added Scenario Notes¶

In scenarios, you can create multiple notes for summary reports. These support inserting real-time visual charts for data analysis, inserting text documents for explanations, combining charts and documents for data analysis and summary reports; support exporting infrastructure, log, application performance, user access, etc., Explorer data to notes for data analysis; support sharing notes with all workspace members, retaining abnormal data analysis, helping with retracing, locating, and solving problems.

Upgraded Scenario Views to Dashboards¶

Guance upgraded scenario views to dashboards and adjusted dashboard functionalities and layouts. In scenarios, you can create multiple dashboards to build data insight scenarios, support searching dashboards via keywords, support adding visual charts to dashboards for data analysis, and support filtering and finding corresponding dashboards quickly via "My Favorites," "Import Projects," "My Creations," and "Frequently Browsed."

Added Export to Dashboards and Notes in Explorers¶

Infrastructure, log monitoring, application performance monitoring, availability monitoring, security inspection, etc., explorers added export to dashboards and notes.

Upgraded Anomaly Detection Library to Monitoring¶

The original 「Anomaly Detection Library」 was upgraded to 「Monitoring」, and the names of the original 「Anomaly Detection Library」、「Detection Rules」, etc., have changed. Specific changes are as follows:

Monitors (originally referred to as "Anomaly Detection Rules") provide "Threshold Detection," "Log Detection," and various other monitoring methods, allowing users to configure detection rules and trigger conditions themselves and receive alarm notifications promptly.
Templates (originally referred to as "Built-in Detection Library"), Guance includes various ready-to-use availability monitoring templates for Docker, Elasticsearch, Host, Redis monitoring. Successful creation of a template automatically adds the corresponding official monitor to the current workspace.
Groups (originally referred to as "Custom Detection Library"), the grouping function supports you to create meaningful monitor combinations, facilitating group management of various monitors.

Added SLO Monitoring Functionality and Export to Dashboards

¶

「Monitoring」 added SLO monitoring, supporting quality scoring of system service providers (Providers) in the cloud era, comparing whether the corresponding SLI (Service Level Indicator) meets the target needs. Simultaneously, "Guance" also supports exporting SLO as views to dashboards for synchronized SLO monitoring in dashboards.

Other Optimization Features¶

Chart optimizations:
- Removed group selection in overview charts;
- Adjusted style selections for time series charts, pie charts, and bar charts;
- Added tooltip information for time slices;
- JSON for charts supports editing, linking with queries/settings, and validating input JSON, displaying error messages if errors exist;
- Style optimizations in analysis mode for time series charts;
Added billing tips for paid plans and accounts, choosing aliyun or aws settlement methods, and directly displaying bill lists with links to corresponding cloud service consoles for viewing bills.

October 21, 2021¶

Added Host Network Distribution Diagram¶

Added a host network distribution diagram, providing observable infrastructure networks. In 「Infrastructure」-「Host」, click the small icon in the upper-left corner to switch to viewing host network distribution situations. In 「Network Distribution Diagram」, you can visually query the network traffic between hosts in the current workspace, quickly analyzing TCP latency, TCP fluctuations, TCP retransmissions, TCP connection counts, and TCP shutdown counts between different hosts.

Added User Access Monitoring Tracking Function¶

Added a 「Tracking」 function for user access monitoring. Supports users creating tracking tasks through 「User Access Monitoring」 to monitor custom trace trajectories in real-time. By predefining trace trajectories, you can filter trace data centrally, precisely querying user access experiences, and detecting vulnerabilities, anomalies, and risks in a timely manner.

Added Scene Chart JSON Format Query¶

In 「Scene」 editing charts, each correct chart query corresponds to a JSON text. Supports mutual parsing between JSON texts and chart queries within the workspace, helping you understand the details of chart drawing.

Optimized DCA Desktop Client Application¶

Optimized UI display of the DCA desktop client and added host status.

online: Indicates normal data reporting, allowing you to view DataKit's running status and configuration collectors through DCA;
unknown: Indicates remote management configuration is not enabled or not on the same local network;
offline: Indicates the host has not reported data for more than 10 minutes or the host name has been modified, showing the original host name in offline status. If the host does not report data normally and exceeds 24 hours without data, the host record will be removed from the list.

Optimized Event Host Linkage Query and Detection Rule Query¶

Optimized the event module to support linkage queries for associated hosts, allowing real-time monitoring of logs, containers, processes, traces, and inspection events related to the event within the selected time component range. Supports one-click viewing of the associated detection rules and querying other triggered events under the corresponding detection rules.

Adjusted Billing Method¶

Choose billing settlement method based on node login method, including CloudCare account, Aliyun, AWS. Among them, CloudCare account settlement is the general method, Aliyun login nodes can choose Aliyun account settlement (under implementation), AWS login nodes can choose AWS account settlement (already implemented).
Removed Session count and Browser dial test count billing dimensions, removing Session count and Browser dial test count statistics and views in 「Paid Plans and Bills」, adding security inspection count statistics chart.

Other Optimization Features¶

Optimized scene chart addition function, removing the 「Add Chart」 button under 「Edit」 mode, all chart types available for addition are selectable at the top of the scene;
Optimized scene chart grouping function, supports deleting groups only and keeping existing charts entering the default group;
Added regional ranking switches for China map/World map, default off;
Optimized Explorer query method, merging search and filter bars, supporting keyword search, label field filtering, and associated searches based on labels, fields, and text.

September 28, 2021¶

Added Host Network Performance Monitoring¶

Host network performance monitoring supports viewing network traffic between host services, containers, and any tagged infrastructure. It supports viewing source host to destination network traffic and data connections based on IP/ports, providing real-time visualization to help businesses understand the operational status of business systems' networks, quickly analyze, track, and locate problem faults, preventing or avoiding business issues caused by degraded or interrupted network performance.

After successful collection of host network data, it will be reported to the Guance console. In the 「Infrastructure」-「Host」 details page under 「Network」, you can view all network performance monitoring data information within the workspace.

Added Chart Linked Queries¶

In the scenario view, you can view the DQL query statement and associated links of the chart by a single click, or perform linked queries on relevant logs, containers, processes, traces, etc., under different grouped query tags. When the chart query contains host (host) information, you can view the related host monitoring view. For example, clicking any chart will allow you to view the DQL query statement, set links, and perform linked queries on related logs, containers, processes, traces, host monitoring views, etc.

Added Rectangular Treemap¶

A rectangular treemap is used to visualize the percentage distribution of metric data under different groups. The color of the rectangular treemap represents the group's tag (Tag), and the area represents the metric data. When multiple metric queries are added, you can choose the main displayed metric, and the size of the area is shown based on the selected metric data results, Top/Bottom, and quantity. For example, this chart visualizes the CPU usage rate rankings of hosts.

Added Application Performance and User Access Monitoring Associated Queries¶

In the trace details of application performance monitoring, you can view associated (same trace_id) real user access experience data through the 「Related View」 at the top of the page. This function not only helps you view actively monitored application performance data but also enables you to quickly gain insights into real user access situations. For more application performance monitoring, refer to the Trace Analysis documentation.

Added Absolute Time Range Query for Infrastructure¶

Infrastructure added 「Host」、「Container」、「Process」 query range absolute time, defaulting to displaying host data for the last 24 hours, container data for the last ten minutes, and process data for the last ten minutes. The query range can be refreshed manually. Hovering over an offline host displays the offline handling prompt.

Optimized Concurrent Comparison Function for Charts¶

Optimized the concurrent comparison function for charts, supporting comparisons of concurrent data for time series charts, overview charts, etc. You can choose year-over-year (comparison of the same time point in adjacent time periods) or month-over-month (comparison of adjacent time periods). Based on the locked time of the chart, you can choose month-over-month, daily month-over-month, weekly month-over-month, monthly month-over-month, weekly year-over-year, monthly year-over-year, etc.

Optimized SLIMIT for Chart Queries¶

Default SLIMIT is added to grouped chart queries, limiting the number of points or series returned for time series charts. A chart limits returning 10,000 points, and a query returns up to 10 timelines.

Cloud Dial Tests Adjusted to Availability Monitoring¶

Cloud dial tests are divided into API dial tests and Browser dial tests, adjusted to availability monitoring. After adjustment, API dial tests are retained. Other features such as overview analysis, Explorer analysis, self-built node functions remain unchanged. For more details, refer to the Availability Monitoring documentation.

Price Reduction Adjustment¶

Log price reduced from 1 yuan per 1 million to 0.5 yuan per 1 million
Removed Session billing dimension for user access monitoring, adjusted to 0.3 yuan per 1,000 PVs

For more details on pricing and data expiration strategies, refer to the Pay-as-you-go documentation.

September 9, 2021¶

DataFlux Renamed to "Guance"¶

In the cloud computing era, observability is increasingly adopted and valued by more enterprises. DataFlux, as an observability platform introduced by ZYUN Technology for the cloud era, to make it easier for enterprises and users to understand, officially renamed to "Guance" in this release. The website URL is "guance.com".

At the same time, we designed a new Logo for "Guance", using letters C and G as the basis to form a radar-like wave pattern, reflecting detection and observation characteristics, fully aligning with the features of observability, and embodying the core protection system built by "Guance" for enterprises and users based on data.

Added Approximate Text Log Viewer¶

"Guance" supports similarity calculation and analysis of the message field in raw log data. Select the time range in the upper-right corner to fix the current time period, obtain 10,000 log data entries within that time period for approximate analysis, aggregate logs with high similarity, extract and statistically analyze common Patterns, helping quickly discover abnormal logs and locate problems.

Pattern Clustering Details

Click the Pattern clustering list to draw out the current full Pattern clustering list. Return data lists are arranged in reverse chronological order, supporting the display of the most recent 50 log data entries, which can be displayed in 1 line, 3 lines, or 10 lines.

Added Container Jobs and Cron Jobs Viewer¶

"Guance" added Container 「Jobs」、「Cron Jobs」 viewers. Select the corresponding viewer in the left object list under 「Infrastructure」-「Container」, supporting viewing the operational status and service capability metrics of Jobs and Cron Jobs in Kubernetes, thereby achieving real-time monitoring of Kubernetes clusters and deployed resources. Refer to the Container documentation for more details.

Added DCA Desktop Client Application¶

DCA, DataKit Control APP, is a desktop client application aimed at conveniently managing already installed and configured collectors, supporting viewing integration lists, configuration file management, Pipeline management, and online viewing of integration configuration documentation. You can remotely connect to DataKit through DCA, make online changes to collectors, and apply updates after saving.

In the "Guance" workspace, click 「Integrations」-「DCA」 sequentially to download the installation package. After downloading, you can install it on your computer to remotely manage DataKit.

Added Mobile App¶

DataFlux Mobile can help you view log data, scene views, etc., from Guance on mobile devices anytime and anywhere, and receive all alarm events notified via email, DingTalk bot, WeCom bot, Webhook, etc.

In the Guance workspace, you can download the DataFlux Mobile app through 「Integrations」-「Mobile」.

Added Label Filtering for Metrics, Optimized Three Viewing Modes for Metrics¶

The DataKit collector appends the tag host=<DataKit hostname> by default to all collected data,

Tags are a set of properties identifying the object of a data point collected, divided into tag names and tag values. On the 「Metrics」 page, you can select the corresponding metric view for the tags you want to view. As shown in the figure below: filter hosts in the tag bar and view their usage_system, usage_total, usage_user, usage_iowait metric views.

On the left side of the 「Metrics」 page, you can choose to switch metric viewing modes, supporting three viewing modes: flat layout, mixed layout, list layout, defaulting to the flat layout.

Optimized Anomaly Detection¶

Added window (window) function for use in anomaly detection rule queries and chart queries, i.e., supporting using selected time intervals as windows (record sets) with detection frequencies as offsets to recalculate statistics for each record.

• When performing chart queries, supports adding window functions, i.e., using selected time intervals as windows (supporting 1 minute, 5 minutes, 15 minutes, 30 minutes, 1 hour, 3 hours), combined with aggregation functions to perform statistical calculations on each record.
• When configuring anomaly detection rule configurations, added window function as the plotting area for query results, returning real-time anomaly detection metric data used to trigger alerts.

Added percent() function for use in aggregation functions in anomaly rule queries and chart queries. Supports adding percent() function in aggregation functions, including p50 (median value), p75 (value at the 75th percentile), p90 (value at the 90th percentile), p99 (value at the 99th percentile).

Added label filtering for use in anomaly rule queries and chart queries, supporting selecting host label properties for filtered display. Before selecting labels in queries, you need to set label properties for hosts in 「Infrastructure」-「Host」.

Optimized Unresolved Event Display Style¶

In the unresolved event list, you can preview the window function of the event for the last 6 hours:
• The dashed-line border effect represents the time period affected by the anomaly event
• When the detection library rule type is threshold, log, application performance indicator, user access indicator detection, security inspection, anomaly process, cloud dial test detection, you can view related anomaly detection metric data based on alert levels, including critical, error, warning.
• When the detection library rule type is mutation, interval, water level, you can quickly identify the time point when the current event was triggered based on the "vertical line" on the chart.

You can view the status distribution, DQL function, and window function line chart of anomaly events on the event details page.
• Status distribution: Displays event statuses (critical, important, warning, data interruption) within the selected time range (default is the last 6 hours)
• DQL query statement: Returns real-time metric data based on custom query statements from anomaly detection rules, defaulting to displaying the last 6 hours of real-time metric data
• Window function: Based on anomaly detection rules, uses the selected time range as a window (record set) with detection frequency as offset, recalculates statistics for each record, and returns real-time anomaly detection metric data used to trigger alerts. Defaults to displaying the last 6 hours of real-time anomaly detection metric data

Optimized Scene View Analysis¶

In preview mode, double-clicking a chart enlarges it for analysis mode viewing. In edit mode, double-clicking a chart enters edit mode for adding, deleting, and modifying charts.

Optimized Infrastructure Binding to Built-in Views¶

When selecting built-in views, duplicate named views are filtered out. When system views and user views have the same name, user views are prioritized for display, meaning only user views can be selected. If you need to select a system view, you must change or delete the duplicate-named user view.

Optimized Billing Method, Added Cloud Dial Test Billing, Adjusted Data Expiration Strategy¶

Added PV quantity statistics: Session quantity and PV quantity are billed based on the lower actual cost incurred.
Added Cloud Dial Test task count billing: Opened self-built node management for cloud dial tests, supporting any space administrator to create new dial test nodes globally; cloud dial test billing dimensions will charge based on the number of calls made by the current workspace's cloud dial test tasks; Free Plan workspaces can create up to 5 dial test tasks and only support "China Region" dial test nodes; Agile Plan and higher plan workspaces support creating more dial test tasks and using more international dial test nodes.

August 26, 2021¶

DataFlux Studio¶

Added Chart Query Label Filtering¶

DataFlux supports selecting host label properties for filtered display in chart queries. Before selecting labels in chart queries, you need to set label properties for hosts in 「Infrastructure」-「Host」. As shown in the figure below, there are two hosts with the "production" label property, hence displaying data from these two hosts.

Added Infrastructure Container Cluster, Replicate Set, Node Viewers¶

DataFlux added Cluster, Replicate Set, Node viewers for containers, supporting viewing the operational status and service capability metrics of Cluster, Replicate Set, Node in Kubernetes, thereby achieving real-time monitoring of Kubernetes clusters and deployed resources.

Added Quick Filtering for User Access Monitoring View Viewer¶

DataFlux supports quick filtering settings in the View Viewer by clicking the settings button on the left, allowing custom addition of filter fields. After selecting the fields to add, click "Complete" to proceed.

Note: If the added filter field represents a time field, you can filter by selecting a time range to view corresponding page content. For example, loading_time (page load time).

DataFlux added help documentation entries in the navigation menu. When the viewer does not upload data, DataFlux provides quick access to "How to Start Data Collection" entries to help you initiate real-time monitoring in different viewers. Including how to start log monitoring, how to start cloud dial testing, how to collect host objects, etc.

Optimized Log Viewer¶

DataFlux optimized the log viewer, highlighting different contents of logs in different colors, allowing you to quickly obtain key data information from logs. Supports light and dark themes.

Log Content	Light Theme	Dark Theme
Date (log occurrence time)	Yellow	Light Yellow
Keywords (HTTP protocol related, e.g., GET)	Green	Light Green
Text (string enclosed in quotes)	Blue	Light Blue
Default (text without any markers)	Black	Gray
Numbers (log status codes, e.g., 404)	Purple	Light Purple

Optimized Overview Statistics for Security Inspections¶

DataFlux supports customizing the view of the security inspection overview page. By clicking the 「Jump」 button, you can navigate to the corresponding built-in view of the overview page for viewing, editing, copying, and exporting.

Optimized Workspace Switching¶

DataFlux supports switching to other workspaces or creating new workspaces by clicking the 「Current Space」 name.

Optimized System Theme Color Switching¶

DataFlux added an "Automatic" option for system theme colors, which automatically switches theme colors based on computer appearance settings.

Other Optimization Features¶

Optimized 「Service」 details in application performance monitoring. In the service details page, clicking the resource name of the service directly navigates to 「Trace」 to view the trace situation of the corresponding resource;
Optimized 「Performance」 details in the user access monitoring View Viewer. Clicking error data (data marked as "error" in the View list) allows you to view the corresponding error details;
Optimized tag name and tag value display in the metric Viewer;
Optimized X-axis time display for time series charts. Default time range is the last 15 minutes, X-axis segments by minute intervals; Last day, X-axis segments by hour intervals; Last 7 days, X-axis segments by day intervals;
Optimized expression queries. When querying charts, if the expression query contains multiple query statements, the group labels must remain consistent;
Optimized host integration run situation. In 「Infrastructure」-「Host」-「Integration Run Situation」, added version information of the installed DataKit on the host;
Optimized snapshot sharing. Supports sharing snapshots with "anyone" who has the sharing link, or encrypted sharing with those who have the link and key.

August 12, 2021¶

DataFlux Studio¶

Added 3 Types of Permission Roles, Optimized Scene View Permissions¶

DataFlux currently supports defining three workspace member permissions, including "Administrator," "Standard Member," and "Read-only Member," respectively constraining the management, operation, and viewing permissions for different member categories. "Administrators" can customize the permission scopes for members, such as: limiting read-only members' accessible scene views, limiting standard members' editable scene views, etc.

In the DataFlux workspace 「Management」-「Member Management」-「Modify」, you can edit and update member permissions.

Added Infrastructure Host Details to View Connection Tracking and File Layout Optimization¶

DataFlux supports viewing host system information on the infrastructure host details page, including host name, operating system, processor, memory, network, hard disk, connection tracking numbers, file handle numbers, etc.

Added Scene View Snapshot Saving Function¶

In the DataFlux workspace, enter 「Scene」-「Node」, click the 「Settings」 button in the top navigation bar, and select 「Save Snapshot」 to save the currently displayed data content of the view as a snapshot.

Additionally, DataFlux supports quickly saving snapshots via page function buttons and shortcut keys (Ctrl+K ). In scene views and all viewers, using the shortcut key Ctrl+K will quickly pop up the 【Save Snapshot】 dialog box. Enterthe name and click 【OK】 to add the current page as a new snapshot.

Note: If there are other shortcut keys in your background program that conflict with the shortcut key Ctrl+K, you will not be able to use the shortcut key function for 「Save Snapshot」.

DataFlux supports unified management of charts and snapshots shared within the current space. After completing chart sharing in 「Scene View」, you can view the chart sharing list within the current space through 「Management」-「Sharing Management」-「Chart Sharing」, and perform chart viewing, embedding code viewing, and canceling sharing.

Added User Email Replacement, Mobile Replacement Unbinding Function¶

In the DataFlux workspace, click the lower-left 「Account」-「Settings」-「Basic Settings」 to replace or unbind mobile and email.

Added Custom User Access Monitoring SDK Data Collection Content¶

DataFlux supports customizing data collection content for the user access monitoring SDK, helping users locate and analyze data by setting different types of identifiers under specific scenarios through custom user identification, custom session settings, and adding extra data TAGs.

Added Free Quota for Paid Edition Session, Task Scheduling, Trace¶

DataFlux paid edition adds 1 million log data entries per day, 100 Session counts, 10,000 task scheduling counts, and 1 million Trace counts per DataKit daily.

Optimized Scene Chart Analysis Mode¶

DataFlux supports previewing object data interactions over four times the query cycle via the timeline below the time series chart in analysis mode, and selecting the time range displayed on the time series chart by dragging the timeline. For example: if the current time is 14:00 and the time range is selected as 【10:00-11:00】, then the timeline range is 【08:00-12:00】.

Note: A single query statement in the time series chart returns up to 10 timelines, i.e., according to the results of the group by condition, data exceeding 10 timelines displays only the first 10 timelines in order.

Optimized Infrastructure Host and Container Honeycomb Charts¶

Hovering the mouse over host and container objects allows you to view the host/container name, CPU usage rate, and MEM usage rate.

Optimized Log Source List Display Based on Viewer Time Range¶

DataFlux supports filtering the log source list based on the selected viewer time range. For example, in the 「Log Viewer」 of the DataFlux workspace, selecting a 15-minute time range in the upper-right corner shows only logs with data within the last 15 minutes in the left log list.

Optimized System Theme Color Switching¶

DataFlux supports switching system theme colors, divided into light and dark themes. Click the account in the lower-left corner and select the required theme under 「System Theme」 to switch directly.

Other Optimization Features¶

Adjusted the notification sending content type of Webhook from text format to JSON format.
Added an alarm mute option of 15 minutes for anomaly detection library alert settings, meaning no notifications for the same alert within a 15-minute time range.
Adjusted the display style of unresolved event lists, changing log alert event statistics from table charts to time series charts.

August 4, 2021¶

DataFlux Studio¶

Added Container Services and Deployments Viewers¶

DataFlux supports displaying container states comprehensively from different dimensions through 「Container」、「Pod」、「Services」、「Deployments」 viewers.

In the workspace 「Infrastructure」-「Container」, you can switch to 「Services」 via the data type filter bar in the upper-left corner to view detailed information of all retained Services in the space, including Service name, service type, Cluster IP, External IP, runtime duration, etc.

Switching to 「Deployments」 allows you to view detailed information of all retained Deployments in the space, including Deployment name, available replicas, upgraded replicas, readiness, runtime duration, etc.

July 29, 2021¶

DataFlux Studio¶

Added Global Label Functionality for Infrastructure¶

DataFlux added global Label functionality for infrastructure, supporting users to add custom labels to infrastructure objects such as hosts, containers, and processes, and filter and display infrastructure objects with the same label through added labels.

In the infrastructure object list, click the object name to draw out the details page to add tags 「Label Attributes」 for the object.

After adding custom labels, you can filter and display objects with the same label in the object list through the added labels.

Added SMS Notification Targets; Added SMS Cost Statistics for Paid Plans and Bills¶

DataFlux supports users managing notification targets for sending alerts, currently supporting adding DingTalk bots, WeCom bots, Lark bots, custom Webhooks, email groups, and SMS groups.

Note:

Members receiving SMS notifications must first be invited to join the workspace under 「Management」 - 「Member Management」 before they can be selected.
The free version of DataFlux does not support SMS notifications, while other versions charge 10 yuan for every 100 SMS messages, billed daily.

Added Slide Show Mode for Scene Views¶

DataFlux added slide show mode for scene views, supporting browsing all node views under specified scenes using slide show mode and customizing the slide show interval.

Added Workspace Token Replacement Function¶

DataFlux supports the current space administrator changing the token within the space and customizing the expiration time of the current token. Enter 「Management」-「Basic Settings」-「Replace Token」, select the expiration time and confirm 「Replace」. DataFlux will automatically generate a new token, and the old token will expire within the specified time.

Note:

After replacing the token, the original token will expire within the specified time. If any proxy uses this token, data reporting will stop immediately. Please check integration configurations promptly;
Replacing the token will trigger 「Operation Events」 and 「Notifications」.

Added DQL Query Mode for Metrics¶

DataFlux supports switching 「Search」 to 「DQL Query Mode」 in the workspace 「Metrics」, allowing direct input of DQL statements for queries. You can view corresponding tags and metrics on the left and visualized charts returned by query statements on the right.

Optimized Multi-line Display for Log Viewer¶

DataFlux supports choosing "1 line", "3 lines", or "10 lines" display for logs in the "Settings" of the log viewer to view complete log contents.

Optimized Service and Trace Switching Views and Response Time Line Chart in Application Performance Monitoring¶

DataFlux supports retaining the current filter conditions (including: environment, version) and time range when switching between 「Service」 and 「Trace」 viewers. For example: In application performance monitoring 「Service」, choose 「Environment」 as production_a, and 「Time Range」 as Last 30 Minutes.

Switching to application performance monitoring 「Trace」 retains consistent filter conditions and 「Service」.

Optimized Installation Guide for DataKit Collector¶

DataFlux supports custom installation options when installing DataKit, such as cloud vendors, namespaces, global tags, etc.; DataKit offline installation supports directly downloading offline installation packages for different operating systems by clicking.

Optimized Synchronous and Asynchronous Call Display in Flame Graph¶

DataFlux's flame graph in application performance monitoring supports viewing detailed data on synchronous and asynchronous call chain performance. For example, through the flame graph, you can clearly see which requests were made asynchronously, when they started, when they ended, and how much total time was spent.

Optimized Field Alias Display in Viewer¶

DataFlux supports custom aliases for fields displayed in the viewer. For example, in the infrastructure host object, users can modify field aliases in "Add Display Columns". After modification, you can view them in the viewer and details.

Optimized Self-built Node Location for Cloud Dial Test¶

DataFlux splits the geographical location of self-built nodes for cloud dial tests into two filter boxes: country and province (or city). If the country filter box selects China, the next filter box filters out the province list; if the country selects non-China, the next filter box filters out the city list. The filter box defaults to showing 20 entries and supports fuzzy search.

Optimized DQL Query Functions¶

DataFlux DQL added exists, wildcard, with_labels, and other query functions.

July 15, 2021¶

DataFlux Studio¶

Added Third-party Development Tool Integration for User Access Monitoring¶

DataFlux added integration of mini-programs developed using the uniapp development framework. By introducing the sdk file, it monitors the performance indicators, error logs, and resource request data of mini-programs and reports them to the DataFlux platform.

Added Data Gap Anomaly Detection¶

DataFlux added data gap anomaly detection, triggering events based on configured custom detection cycles. Generated data gap events are uniformly saved in the event repository.

After configuring the data gap detection rules to take effect, the first detection of data gaps and continuous data gaps will not generate data gap alert events; if data is detected and data reporting occurs with a gap within the configured custom detection cycle, a data gap alert event will be generated.

Added Built-in Detection Libraries for Elasticsearch, Redis, and Docker¶

DataFlux currently supports 4 built-in detection libraries: Elasticsearch, Redis, Host, and Docker. You do not need to configure manually, as they are ready-to-use out of the box. If you want more details, you can directly click the corresponding built-in detection library.

Redis Detection Library: Includes abnormal increase in the number of client connections waiting for blocking commands
Host Monitoring: Includes multiple data metrics such as host CPU, memory, disk, etc.
Elasticsearch Detection Library: Includes abnormal ES JVM heap memory, thread pool, search query load, etc.
Docker Monitoring: Includes multiple data metrics such as container CPU, memory, etc.

Added "All Trace Viewer" for Application Performance¶

DataFlux provides three trace screening viewing lists: "All Span," "Top Span," and "Traceid." Span represents the logical work unit within a given time period in a distributed system, and multiple spans form a trace trajectory.

All Spans: Displays all collected span data within the selected time range.
Top-level Spans: Filters and displays all span data entering for the first time within the selected time range.
All Traces: Filters and displays all trace data containing initial top-level spans within the selected time range.

Added Trace Detail Topology Call Relationship Diagram

DataFlux added a corresponding service topology call relationship diagram in the application performance monitoring detail page to view the call relationships between various services.

Added Error Details Page for User Access¶

DataFlux supports viewing user access error details on the user access details page, including error data information, error type, and error occurrence time during the user access.

Clicking the error information navigates to the corresponding error details page.

Added Security Inspection Overview Statistics¶

In 「Security Inspection」-「Overview」, you can view the overview of security inspection events occurring on different hosts through filtering hosts, security inspection levels, and security inspection categories, including the number of security inspection events of different levels and visualization chart analysis, and rankings of different categories and rules of security inspection events.

Added Handling Suggestions for Security Inspection Events¶

In the security inspection viewer, click the inspection event you want to view. In the drawn-out details page, you can view handling suggestions for the security inspection event, including theoretical basis, risk items, audit methods, remedial measures, etc.

DataFlux added support for displaying secondary navigation via "mouse hover," thereby shortening the time users spend finding target data.

Added Member Management Search Function¶

DataFlux supports searching for current workspace members quickly based on email or name in 「Member Management」.

Added Binding Built-in Views to Infrastructure Objects¶

DataFlux supports binding built-in views (system views, user views) to the details pages of infrastructure objects by the current space administrator. For example, the built-in system view "Disk Monitoring View" is bound in the figure below.

Optimized Event List Display by Detection Library Type¶

DataFlux supports displaying corresponding event information in the event list based on different detection library types.

When the detection library rule type is threshold, mutation, interval, water level, application performance indicator, or user access indicator detection, it displays the corresponding baseline and information based on the configured trigger conditions, including critical, error, warning.
When the detection library rule type is log, security inspection, anomaly process, or cloud dial test detection, it queries and displays all log data for anomaly events.

As shown in the figure below, there are three different detection library types, including threshold detection, security inspection detection, and process data detection.

Optimized Deletion of Metric Sets¶

DataFlux supports administrators deleting metric sets within the space. Enter 「Management」-「Basic Settings」, click 「Delete Metric Set」, input keywords to query and select the metric set name, and click 「Confirm」 to enter the deletion queue. Deleting a metric set generates system notification events, such as creating a delete metric set task, executing the delete metric set task successfully, or executing the delete metric set task unsuccessfully.

Optimized Query Time Range for Built-in Views in Viewers¶

Changed the query time range for built-in views, including 「Host Monitoring」 views on infrastructure object, trace, and log details pages and 「Process」 views on trace and log details pages.

When viewing trace and log details pages, 「Host Monitoring」 default displays performance data associated with the host within the selected time component range.
When viewing infrastructure object (host, container) details pages, 「Host Monitoring」 default displays host performance data for the last 24 hours.
When viewing trace details pages, 「Process」 default displays real-time process data 10 minutes before and after the occurrence time of the trace.
When viewing log details pages, 「Process」 default displays real-time process data 10 minutes before and after the generation time of the log.

Optimized Quick Filtering Interaction in Viewers¶

If the current field value is too long in quick filtering of DataFlux viewers, the exceeding part is displayed as ···. When hovering the mouse over the current field value area, it extends to display based on the field value length.

July 1, 2021¶

DataFlux Studio¶

Added Unresolved Event Statistics Viewer¶

DataFlux added an unresolved event statistics viewer. In the DataFlux workspace's Events, by switching the viewer in the upper-left corner, you can view all unresolved events continuously triggered in the space, as well as data volume statistics and alarm information details for unresolved events under different alarm levels.

Added Chart Link Function¶

DataFlux added link functions for time series charts, bar charts, overview charts, dashboards, pie charts, ranking charts, scatter plots, bubble charts, maps, and honeycomb charts. Chart links help you navigate from the current chart to the target page, supporting modifying the corresponding variable values in the link via template variables to transmit data information and complete data linking.

Chart links support acquiring template variables through queries, adding internal and external links, opening in new pages, current pages, or sliding detail pages, and adding aliases for display.

After adding the link, clicking the chart allows you to view clickable "custom links".

Added Application Performance Monitoring Bound Links and Built-in Views¶

DataFlux supports adding built-in views, including built-in views and linkable web addresses, in individual service details. In the service list, click 「Settings」 to add one or more jump links or built-in views and customize names.

After adding built-in views, you can view the corresponding built-in pages by checking service details.

Added PV/UV Overview Statistics for User Access Monitoring Scenarios¶

DataFlux added PV/UV overview statistics for user access monitoring in Web, iOS, Android, and Mini Program scenarios. This allows quick comparison of PV/UV differences and understanding of actual user access quantities.

Added Notification Target: Lark Bot¶

DataFlux supports users managing notification targets for sending alerts, currently supporting adding emails, DingTalk bots, WeCom bots, Lark bots, and custom Webhooks.

Optimized Infrastructure Resource Directory¶

Besides host, container, and process objects, all other object data in the infrastructure can be reported to 「Infrastructure」-「Custom」 via DataFlux Func for viewing and analysis. Supports binding built-in views to resource directory data and manually adding tags for filtering.

Reporting resource directory data requires first installing and connecting DataKit and Func, then reporting data to DataKit via Func, and finally DataKit reporting data to the DataFlux workspace.

Optimized Detection Rules for Anomaly Detection Libraries¶

DataFlux added recovery alert configuration for anomaly events; added support for regex matching styles in filter conditions, optimizing ＝～ to match, and adding not match; added support for non-numeric data matching in trigger conditions, adding match, not match regex matching, and between.

Optimized Associated Logs in Viewer Details Pages¶

DataFlux supports filtering associated logs in the side panel of trace details pages based on trace_id by default, viewing associated log details under the same trace_id conditions.

In trace details, clicking 「Logs」 below the flame graph allows you to view associated logs based on the current trace-related host and trace ID (trace_id field). Additionally, you can perform keyword searches and multi-label filtering on logs. If you need to view more detailed log content, you can click the log content to navigate to the log details page or click the jump button to open it on the log page.

Added log association pages in viewers.

Optimized Viewer Search Styles¶

Adjusted search styles for new scenes, metrics, application performance monitoring, user access monitoring, anomaly detection libraries, host silence management, integrations, management/built-in views, snapshots, etc.

Deployment Version Supports Modifying Data Retention Duration¶

Added change data storage strategy to basic information in workspace management.

June 17, 2021¶

DataFlux Studio¶

Added Log Analysis Mode¶

DataFlux supports grouping large amounts of raw data based on 1-3 tags through the log grouping function, reflecting the distribution characteristics and trends of grouped data at different times. DataFlux supports three ways of browsing grouped data: line chart, area chart, column chart.

Added Log Filtering¶

Added log filtering function (log blacklist), supporting setting filtering rules to filter out logs that meet the conditions, i.e., after configuring log filtering, logs that meet the conditions will no longer be reported to the DataFlux workspace, helping users save on log data storage costs.

In 「Logs」-「Filter Rules」-「Create New Rule」, select "Log Source", add one or more data filtering conditions with a relationship of and（AND）, to filter collected log data. Log data that meets the filtering conditions will not be reported to the dashboard.

Added Saving Metric Browser Snapshots, Added Snapshot Link Copy Function¶

DataFlux supports creating quick-access data copies for metric viewers and saving them uniformly in the "Snapshot" directory; added generating shareable snapshot links, supporting sharing snapshot links with other members within the space, allowing quick reproduction of instant copied data information, restoring data to a certain point in time and a certain data display logic.

Added Pod Viewer for Containers¶

DataFlux added a Pod viewer under 「Infrastructure」-「Container」. Through the filter in the upper-left corner, you can switch to 「Pod」 to view detailed information of all collected Pods, including Pod name, affiliated node Node, contained one or more containers, start status, running status, and related metrics. You can also switch to the honeycomb chart for viewing.

Clicking a Pod in the honeycomb chart allows you to view the Pod's details, including Pod name, namespace, visual monitoring charts, etc.

Added Free Quota Warning Notifications¶

Added warning notifications for free edition usage quotas and notifications when quotas are used up, supporting sending emails and generating system notifications. Learn more about message notifications. System message notifications can be viewed in the DataFlux workspace 「Account」-「Notifications」.

DataFlux supports chart sharing, which can be embedded in codes outside DataFlux for visual data display and analysis. The shared charts will change accordingly based on changes in the charts within DataFlux. Charts shared in scene views are stored uniformly in 「Integration」-「Embedded Share」.

Optimized Chart Queries and Chart Styles and Settings¶

Adjusted and optimized visualization chart queries, styles, and settings in scene views, adding functions such as hiding chart titles, time slice settings, precision settings for overview chart data, baseline settings for ranking charts, color fill settings for maps/honeycomb charts.

DataFlux supports viewing all supported collectors, DataKit installation instructions, DataKit upgrade commands, Function installation instructions, and embedded share chart codes in the integrations section.

In the DataFlux workspace, click the 「Integrations」 menu on the left to view all currently supported collectors. Clicking a collector displays its configuration details.

In the DataFlux workspace, click 「Integrations」-「DataKit」 to obtain DataKit installation instructions, including Linux, Windows, MacOS three major operating systems, and offline installation methods. If DataKit is already installed but not the latest version, you can obtain the update script via 「DataKit Upgrade」 here.

In the DataFlux workspace, click 「Integrations」-「Function」 to obtain Function installation instructions.

Optimized Host Details Page¶

In 「Infrastructure」-「Host」, clicking the host name in the list draws out the details page to view the host's basic information, processor, memory, network, hard disk, etc. Supports automatic unit conversion of data and displaying different host monitoring views based on different operating systems.

June 3, 2021¶

DataFlux Studio¶

Added Browser Log Collection¶

DataFlux supports actively sending different levels of log data (corresponding source:browser_log metric type log data) to DataFlux through web browsers or JavaScript clients.

Added Session Viewer for User Access Monitoring¶

DataFlux user access monitoring viewer added viewing user access behavior monitoring data (session data) and session data details related to Web/Mini Program/Android/iOS applications. Open 「User Access Monitoring」-「Select Any Application」-「Viewer」 in the workspace, you can switch to the Session viewer. The Session viewer statistics include session duration, number of pages, number of operations, number of errors, etc. Clicking a single session allows you to view the entire session's detailed records. Through viewing and analyzing session data, you can understand real user access data from multiple dimensions, helping improve application performance experience.

Added Browser Dial Test, Cloud Dial Test Anomaly Detection Templates, and Optimized Self-built Nodes¶

Browser Dial Test

DataFlux added browser dial tests. In DataFlux 「Cloud Dial Test」, click 「New」-「Browser Dial Test」 to create a new Browser dial test task, obtaining real-time user access experience data for web pages, including page load time, resource load time, etc.

Anomaly Detection Template

「Cloud Dial Test Data Detection」is used to monitor cloud dial test data within the workspace. By setting thresholds (boundaries) for specified data volumes generated by dial test tasks within a certain time period, alarms can be triggered when the data volume reaches the threshold range. You can also customize alarm levels, and different alarm events will be triggered when the specified data volume reaches different threshold ranges.

Self-built Nodes

DataFlux cloud dial test self-built nodes added "Node Code", used to obtain the code for node information, ensuring the node code is not duplicated within the current space.

Added Welcome Page for Registration¶

A welcome page is prompted after registering and logging into a DataFlux account, where you can view a DataFlux introduction video, and scan to join the official DataFlux WeChat and DingTalk service groups.

Added Support for DataFlux Func in Free Plan, Adjusted Billing Items¶

All versions of DataFlux fully support the DataFlux Func platform for custom functions. DataFlux Func is a script development, management, and execution platform based on Python with ServerLess-like features. At the same time, to reduce user costs for using DataFlux, DataFlux adjusted the billing logic for application performance monitoring and user access monitoring. After adjustment, application performance monitoring tallies trace counts, and user access monitoring tallies daily session counts.

Optimized Metric Generation¶

Added user performance monitoring, user access monitoring, and security inspection metric generation, optimizing log metric generation. Metric generation can be completed in three steps: data filtering, data querying, generating metrics, including configuring dimensions, aggregation time, defining aggregation frequency, metric sets, and metric names. Examples are as follows:

Application Performance Monitoring

User Access Monitoring

Security Inspection

Optimized Built-in Views, Added Clone Function¶

Built-in views are divided into "System Views" and "User Views", supporting cloning from "System Views" to "User Views", and allowing system views and user views to have the same name. Clicking "View" on a system view redirects to the system view details.

Clicking "Clone" opens the clone view dialog box. Clicking "Confirm" creates the corresponding user view based on the current view template.

After successful creation, it redirects to the created user view page.

If the user view and system view have the same name, and the system view is applied in the Explorer detail view, such as "Infrastructure-Host-Host Details" under the host view, the user view replaces the system view in the host view display.

Optimized View Variables¶

DataFlux supports adding global variables to views. When you want to dynamically filter charts within a view, you can choose to use view variables to achieve this. After configuring the view variables, you can choose whether to enable "Default Match All" via "Advanced Settings".

After enabling, you can view the comprehensive view of all hosts via 「*」 and manually select variables for filtered viewing.

Optimized Viewers¶

When single-column information is incomplete, hover delay is 1 second before showing full tooltip information;
Key content matches highlighted in the viewer search list;
Tags in the details page support copy function; host tags support 【View Related Logs】【View Related Containers】【View Related Processes】【View Related Traces】【View Related Inspections】;
Log, application performance monitoring, user access monitoring, cloud dial test, security inspection viewer statistical charts changed to status statistics;
Added help links for starting user performance monitoring, user access monitoring, security inspections.

May 20, 2021¶

DataFlux Studio¶

Added Save Snapshots¶

DataFlux snapshots support creating snapshots for infrastructure, logs, events, application performance monitoring, user access monitoring, cloud dial tests, and security inspections viewers. Through snapshots, you can quickly view and analyze data and anomalies at different time periods and with different tags.

Added Infrastructure Host Integration Interaction¶

The 「Integration Operation Status」 of infrastructure hosts displays the operation status of integrations related to the host. There are two operation statuses: normally running integrations and integrations with errors. Normally running integrations are displayed by default as 'light blue', and erroneous integrations are displayed by default as 'red' with clickable error information viewing.

At the same time, clicking integrations with built-in view symbols (as shown in the figure below) supports "View Monitoring View". Clicking directly views the relevant built-in view.

Added Self-built Nodes, Optimized Cloud Dial Test Node Display¶

「Cloud Dial Test」supports customizing cloud dial test data collection through the DataFlux Studio console. By creating a probe point, you can periodically monitor websites, domains, backend interfaces, etc., based on the HTTP protocol, analyzing site quality anytime. DataFlux has covered 16 nodes globally, categorized by domestic, overseas, and self-built nodes. At the same time, self-built dial test nodes are supported to fully ensure service availability.

Added Process, Application Performance Monitoring, and User Access Monitoring Check Rules¶

「Process Anomaly Detection」is used to monitor process data within the workspace, supporting setting trigger alerts for one or more fields in the process data. For example: you can set alerts based on the 'host' field being 'izaqbin' and the 'state' field being 'sleep' appearing a certain number of times.

「User Access Indicator Detection」is used to monitor the indicator data of 「User Access Monitoring」within the workspace. By setting threshold ranges, alerts are triggered when the indicators reach the threshold, supporting setting alerts for individual indicators and customizing alert levels.

「Application Performance Indicator Detection」is used to monitor the indicator data of 「Application Performance Monitoring」within the workspace. By setting threshold ranges, alerts are triggered when the indicators reach the threshold, supporting setting alerts for individual indicators and customizing alert levels.

Optimized Integrations¶

After logging into the DataFlux workspace and entering the 「Integration」page, you can view all supported collectors. You can also click the "Quick Get DataKit Installation Command" in the upper-right corner to directly obtain the DataKit installation command for installation. After installation, you can start more collectors to collect data metrics.

Optimized Log Metric Generation¶

Log metric generation added log source selection, allowing you to generate metrics by selecting log sources, filtering logs, configuring dimensions, aggregation frequencies, defining metric sets, metric names, and aggregation rules. Refer to the following examples:

Application Performance Monitoring

User Access Monitoring

Security Inspection

Optimized Built-in Views¶

Built-in views are divided into system views and user views, applicable in scenarios.

System views provide pre-integrated view templates from the system, supporting modifications, exports, and restorations. Users can directly 「Export」 system views or 「Modify」 them. By 「Restoring」 the system view, you can convert the modified system view back to the original system view. Restored views cannot be recovered.

Clicking 「Clone」 opens the clone view dialog box. Clicking 「Confirm」 creates the corresponding user view based on the current view template.

Redirects to the created user view page after successful creation.

If the user view and system view have the same name and the system view is applied in the Explorer detail view, such as "Infrastructure-Host-Host Details" under the host view, the user view replaces the system view in the host view display.

Optimized View Variables¶

DataFlux supports adding global variables to views. When you want to dynamically filter charts within a view, you can use view variables to achieve this. After configuring the view variables, you can choose whether to enable "Default Match All" via "Advanced Settings."

After enabling, you can view the comprehensive view of all hosts via 「*」 and manually select variables for filtered viewing.

Optimized Explorers¶

When single-column information is incomplete, a delay of 1 second occurs before displaying the full tooltip information upon hovering.
Matching content in the Explorer search list is highlighted.
Tags in the detail page support copying functions; host tags support 【View Related Logs】【View Related Containers】【View Related Processes】【View Related Traces】【View Related Inspections】.
Statistical charts in log, application performance monitoring, user access monitoring, cloud dial test, and security inspection Explorers have been changed to status statistics.
Added help links for starting user performance monitoring, user access monitoring, and security inspections.

May 7, 2021¶

DataFlux Studio¶

Added Save Snapshots¶

DataFlux snapshots support creating snapshots for infrastructure, logs, events, application performance monitoring, user access monitoring, cloud dial tests, and security inspections Explorers. Through snapshots, you can quickly view and analyze data and anomalies at different time periods and with different tags.

Added Infrastructure Host Integration Interaction¶

The 「Integration Operation Status」 of infrastructure hosts displays the operation status of collectors related to the host. There are two operation statuses: normally running integrations and integrations with errors. Normally running integrations are displayed by default as 'light blue', and erroneous integrations are displayed by default as 'red' and support viewing error information by clicking.

At the same time, clicking integrations with built-in view symbols (as shown in the figure below) supports "View Monitoring View". Clicking opens the corresponding built-in view.

Added Self-built Nodes, Optimized Cloud Dial Test Node Display¶

「Cloud Dial Test」supports customizing cloud dial test data collection through the DataFlux Studio console. By creating a probe point, you can periodically monitor websites, domains, backend interfaces, etc., based on the HTTP protocol, analyzing site quality anytime. DataFlux covers 16 nodes globally, categorized by domestic, overseas, and self-built nodes. At the same time, it supports self-built dial test nodes to fully ensure service availability.

Added Process, Application Performance Monitoring, and User Access Monitoring Check Rules¶

「Process Anomaly Detection」is used to monitor process data within the workspace, supporting setting trigger alerts for one or more fields in the process data. For example: you can set alerts based on the appearance count of the 'host' field being 'izaqbin' and the 'state' field being 'sleep'.

「User Access Indicator Detection」is used to monitor the indicator data of 「User Access Monitoring」within the workspace. By setting threshold ranges, alerts are triggered when the indicators reach the threshold, supporting setting alerts for individual indicators and customizing alert levels.

「Application Performance Indicator Detection」is used to monitor the indicator data of 「Application Performance Monitoring」within the workspace. By setting threshold ranges, alerts are triggered when the indicators reach the threshold, supporting setting alerts for individual indicators and customizing alert levels.

Optimized Integrations¶

After logging into the DataFlux workspace and entering the 「Integration」page, you can view all supported collectors. You can also click the "Quick Get DataKit Installation Command" in the upper-right corner to directly obtain the DataKit installation instruction for installation. After installation, you can start more collectors to collect data metrics.

Optimized Log Metric Generation¶

Log metric generation added log source selection, allowing you to generate metrics by selecting log sources, filteringlogs, configuring dimensions, aggregation frequencies, defining metric sets, metric names, and aggregation rules. Refer to the following examples:

Application Performance Monitoring

User Access Monitoring

Security Inspection

Optimized Built-in Views¶

Built-in views are divided into system views and user views, which can be applied in scenarios.

System views provide pre-integrated view templates from the system, supporting modification, export, and restoration. Users can directly 「Export」 system views or 「Modify」 them. By 「Restoring」 the system view, you can convert the modified system view back to the original system view. Restored views cannot be recovered.

Clicking 「Clone」 opens the clone view dialog box. Clicking 「Confirm」 creates the corresponding user view based on the current view template.

Redirects to the created user view page after successful creation.

If the user view and system view have the same name and the system view is applied in the Explorer detail view, such as "Infrastructure-Host-Host Details" under the host view, the user view replaces the system view in the host view display.

Optimized View Variables¶

DataFlux supports adding global variables to views. When you want to dynamically filter charts within a view, you can use view variables to achieve this. After configuring the view variables, you can choose whether to enable "Default Match All" via "Advanced Settings."

After enabling, you can view the comprehensive view of all hosts via 「*」 and manually select variables for filtered viewing.

Optimized Explorers¶

When single-column information is incomplete, there is a 1-second delay before showing the full tooltip information upon hovering.
Matching content in the Explorer search list is highlighted.
Tags in the details page support copy functions; host tags support 【View Related Logs】【View Related Containers】【View Related Processes】【View Related Traces】【View Related Inspections】.
Statistical charts in log, application performance monitoring, user access monitoring, cloud dial test, and security inspection Explorers have been changed to status statistics.
Added help links for starting user performance monitoring, user access monitoring, and security inspections.

April 15, 2021¶

DataFlux Studio¶

Enabled New DataFlux Logo¶

Adopted a robot brain style logo, not only giving a strong sense of technology but also highlighting DataFlux's powerful capabilities in massive data integration, processing, and analysis. Like a robot, it can operate in real-time, quickly, and infinitely scalable, providing easy-to-use and flexible visualization charts for data analysis and business operation analysis, enhancing operational efficiency.

Added Cloud Dial Tests¶

DataFlux provides users with an out-of-the-box cloud testing solution, supporting HTTP protocol dial tests. Utilizing a globally covered monitoring network, it end-to-end tracks web page and application performance, recording real-time feedback information from all dial tests, providing DNS, SSL, TTFB, etc., performance test results, helping you identify problems early, locate issues, and improve user experience.

DataFlux cloud dial tests support analyzing response time and availability rates of current dial test tasks from geographical and trend perspectives.

Added Container Object Distribution Chart¶

[Container Objects] added a honeycomb distribution chart. In the container list page, by clicking the icon on the left side of the list, you can switch to the container distribution chart display. Through the distribution chart, you can visually query container distribution information. The distribution chart supports the following functions:

Search: Enter search keywords
Filter: Filter tags and select filtering objects, allowing multiple selections
Group: Display objects grouped, allowing multiple selections
Fill: Choose the metrics to fill, where the size of the metric value will determine the color of the filled legend.
Fill Rules: Based on the results of the filled metrics, fill the legend colors. Divide the maximum and minimum values of the metric into five equal parts, resulting in five intervals, each corresponding to five colors.

Added Alibaba Cloud Host Details¶

If the host is a cloud host and has configured 「Cloud Association」, clicking the host name in the list will draw out the 「Cloud Vendor Information」 of the cloud host object, including cloud platform, instance name, instance ID, instance specifications, region, availability zone, creation time, network type, billing type, IP address, etc.

Added Table Chart Metric Sorting¶

Table charts support metric sorting, defaulting to sorting by the first queried metric. Clicking the table header switches ascending/descending order, synchronously adjusting the Top/Bottom in the corresponding query. Clicking other queried metrics for sorting synchronously adjusts the Top/Bottom in the corresponding query.

Added Quick Filtering Item 「Duration」 for Traces¶

Default progress bar minimum and maximum values are [Trace] data list's smallest and largest durations
Supports dragging the progress bar to adjust maximum/minimum values, with the input box values changing synchronously
Supports manually entering maximum/minimum values, pressing "Enter" or "Clicking outside the input box" to perform filtering searches
Input fields turn red when entered incorrectly, preventing searches; correct format: pure "number" or "number+ns/μs/ms/s/min"
If no unit is entered for searching, it defaults to appending "s" to the entered number and then performing the filtering search
If a unit is manually entered, it performs the search directly

Added Email Groups¶

In [Notification Targets], added email group notification targets. Email groups can add multiple members simultaneously. After completion, selecting this email group in the anomaly detection library's "Alert Settings" sends alert emails to all added member emails simultaneously.

Optimized Anomaly Detection Library¶

DataFlux includes various built-in detection libraries, ready-to-use out of the box. It supports multiple built-in detection libraries such as hosts, and once enabled, related anomaly event alerts are received immediately.

In the 「Detection Library」, supports 「Import/Export Detection Libraries」. After configuring all detection rules, you can export the detection library via JSON files. The exported detection library can be imported into other detection libraries. During import, it verifies whether duplicate named detection items exist, allowing options to 「Replace」 or 「Skip」.

Optimized Object Explorers and Details¶

Host objects added operating system small icon displays
Container objects added container type small icon displays
Process slide-out detail pages added 「Start Time」 display

Optimized Data Storage Strategy, Paid Plans, and Bills¶

Basic information of workspace management added change data storage strategy
Usage statistics of workspace management optimized to paid plans and bills

April 7, 2021¶

DataFlux Studio¶

Added View Variable Object Mapping¶

When using 「Object Mapping」, you must first define a view variable based on object class fields. After configuring object mapping in 「View Variables」, you need to use the mapped label fields as grouping in 「Chart Queries」 and enable 「Field Mapping」 in 「Chart Settings」. Then, you can view the set object mapping display in the view charts.

Optimized Event Grouping¶

DataFlux supports grouping 「Anomaly Events」by 「Detection Items」to aggregate related events. Clicking 「Aggregated Events」 allows you to quickly view associated event lists, abnormal event status distributions across different hosts, and metric monitoring. Abnormal event status distributions include critial, error, warning, ok, and Mute, corresponding to five status colors. The bottom color is green, filling backward corresponding status colors based on the event occurrence time point. The filling range corresponds to the detection frequency. If the group contains host and host muting is set, the muting time range is displayed in gray.

Optimized Detection Item Queries¶

「Anomaly Detection Library」's 「Detection Rules」's 「Detection Metrics」only allow adding one query by default, supporting switching between Simple Query and 「Expression Query」; uniformly changed 「Detection Rules」's 「Trigger Conditions」M1 to Result; supports adding AS aliases to queries.

DataKit (v1.1.4-rc2)¶

Fixed frequent collection of Alibaba Cloud monitoring data collectors (aliyuncms) causing some other collectors to hang.

March 25, 2021¶

DataFlux Studio¶

Added Cloud Service Association¶

DataFlux supports managing cloud service account AccessKey information through 「Cloud Association」in a unified and centralized manner. After configuration, you can periodically synchronize cloud host information under the affiliated cloud account in [Infrastructure-Host], displaying all cloud host information, such as CPU, memory, network, disk, etc.

If you no longer need the association, you can delete the linked Alibaba Cloud RAM sub-account AK information. Deleting the association triggers an association invalidation notification event, which can be viewed in Events-Notification Events. For more details on cloud associations, refer to the documentation on Cloud Associations.

Added Operation Event Auditing¶

DataFlux supports auditing operation events in workspaces, storing operation events uniformly in Events-「Operation Events」.

Added Host Muting¶

If you need to perform operations such as stress testing on a single cloud host, which would trigger frequent alerts, you can temporarily enable the host muting function. In 「Infrastructure」-「Host」, click the cloud host details to select the host muting time.

All muted hosts can be viewed in 「Anomaly Detection Library」-「Host Muting Management」. Deleting muted hosts allows you to receive alerts for the corresponding host again.

Added Notification Target: WeCom Bot¶

DataFlux supports users managing notification targets for sending alerts, currently supporting adding emails, DingTalk bots, WeCom bots, and custom Webhooks.

Optimized Event Viewer, Added Grouped Aggregation Viewing¶

In the event list viewer, through grouping functions, DataFlux supports quickly aggregating and statistically analyzing related events based on grouping labels. For example, in 「Anomaly Events」, based on "Detection Item" grouping, you can quickly obtain all events triggered by the detection item. By switching to the aggregated event list, you can view these event details.

Optimized Detection Item Queries¶

「Anomaly Detection Library」's 「Detection Rules」's 「Detection Metrics」allow only one query by default, supporting switching between Simple Query and 「Expression Query」. Uniformly changed 「Detection Rules」's 「Trigger Conditions」M1 to Result. Supports adding AS aliases to queries.

DataKit (v1.1.4-rc2)¶

Fixed frequent collection of Alibaba Cloud monitoring data causing some other collectors to hang.

March 4, 2021¶

DataFlux Studio¶

Added View Variable Object Mapping¶

When using 「Object Mapping」, you must first define a view variable based on object class fields. After configuring object mapping in 「View Variables」, you need to use the mapped tag fields as groups in 「Chart Queries」 and enable 「Field Mapping」 in 「Chart Settings」. Then, you can view the set object mapping display in the view charts.

Optimized Event Grouping¶

DataFlux supports grouping 「Anomaly Events」by 「Detection Items」to aggregate related events. Clicking 「Aggregated Events」 allows you to quickly view associated event lists, abnormal event status distributions across different hosts, and metric monitoring. Abnormal event status distributions include critical, error, warning, ok, and Mute, corresponding to five status colors. The base color is green, filling backward with corresponding status colors based on the event occurrence time points. The filling range corresponds to the detection frequency. If the group contains host and host muting is set, the muting time range is displayed in gray.

Optimized Detection Item Queries¶

「Anomaly Detection Library」's 「Detection Rules」's 「Detection Metrics」allow only one query by default, supporting switching between Simple Query and 「Expression Query」. Uniformly changed 「Detection Rules」's 「Trigger Conditions」M1 to Result. Supports adding AS aliases to queries.

DataKit (v1.1.4-rc2)¶

Fixed the issue of frequent collection by the Alibaba Cloud monitoring data collector (aliyuncms) causing some other collectors to freeze.

DataKit (v1.1.4-rc1)¶

Added more information to the message field of the process collector for easier full-text search.
The host object collector supports custom tags, facilitating cloud attribute synchronization.

DataKit (v1.1.4-rc0)¶

Added file collector, dial test collector, and HTTP message collector.
Internally supports ActiveMQ/Kafka/RabbitMQ/gin (Gin HTTP access logs)/Zap (third-party log framework) log cutting.
Enriched statistics information on the [http://localhost:9529/stats] page, adding collection frequency (n/min), data size per collection, etc.
DataKit itself adds some cache space (disappears upon restart), avoiding data loss due to occasional network issues.
Improved Pipeline date conversion functions, enhancing accuracy. Additionally, added more Pipeline functions (parse_duration()/parse_date()).
Trace data added more business fields (project/env/version/http_method/http_status_code).
Various detailed improvements to other collectors.

March 25, 2021¶

DataFlux Studio¶

Added Cloud Service Association¶

DataFlux supports centrally managing cloud service account AccessKey information through 「Cloud Association」. After configuration, you can regularly synchronize cloud host information under the affiliated cloud account in [Infrastructure-Host], displaying all cloud host information, such as CPU, memory, network, disk, etc.

If you no longer need the association, you can delete the associated Alibaba Cloud RAM sub-account AK information. Deleting the association triggers an association invalidation notification event, which can be viewed in Events-Notification Events. For more details on cloud associations, refer to the Cloud Association documentation.

Added Operation Event Audit¶

DataFlux supports auditing operation events in workspaces, storing operation events uniformly in Events-「Operation Events」.

Added Host Mute¶

If you need to perform operations like stress testing on a single cloud host, which may trigger frequent alarms, you can temporarily enable the host mute function. In 「Infrastructure」-「Host」, click the cloud host details to select the host mute time.

All muted hosts can be viewed in 「Anomaly Detection Library」-「Host Mute Management」. Deleting muted hosts allows you to receive alerts for the corresponding hosts again.

Added Notification Target: WeCom Robot¶

DataFlux supports users managing notification targets for sending alerts, currently supporting adding email, DingTalk robot, WeCom robot, and custom Webhook notifications.

Optimized Event Viewer, Added Event Group Aggregation Viewing¶

In the event list viewer, through grouping functions, DataFlux supports quickly aggregating and statistically analyzing related events based on grouping labels. For example, in 「Anomaly Events」, based on "Detection Item" grouping, you can quickly obtain all events triggered by the detection item. By switching to the aggregated event list, you can view the details of these events.

Optimized Trace Service Filtering and Topology Charts¶

In the 「Service」 list of 「Application Performance Monitoring」, you can switch the list to topology chart mode to view the call relationships between services. It supports filtering and displaying based on different performance indicators and customizing the color ranges for trace service performance indicators.

Other Optimization Features¶

Optimized log, event, infrastructure, application performance monitoring, user access detection viewers' search and export, added export to views. Optimized log, event, trace, infrastructure-container, infrastructure-process detail page label filtering and associated query analysis.
Optimized time components, optimized scene view single-query charts (overview charts, dashboards, ranking charts) simple query and expression query switching.
Optimized offline host display: when the host is offline, CPU usage rate, memory usage rate, load are not displayed, values are filled as " - ".
Optimized anomaly detection library detection rules, added water level detection, interval detection, and mutation detection.

DataKit (v1.1.4-rc1)¶

Added more information to the message field of the process collector for easier full-text search.
Host object collector supports custom tags, facilitating cloud attribute synchronization.

DataKit (v1.1.4-rc0)¶

Added file collector, dial test collector, and HTTP message collector.
Internally supports ActiveMQ/Kafka/RabbitMQ/gin (Gin HTTP access logs)/Zap (third-party log framework) log cutting.
Enriched [http://localhost:9529/stats] page statistics information, adding collection frequency (n/min), data size per collection, etc.
DataKit itself adds some cache space (disappears upon restart), avoiding data loss due to occasional network reasons.
Improved Pipeline date conversion functions, enhancing accuracy. Additionally, added more Pipeline functions (parse_duration()/parse_date()).
Trace data added more business fields (project/env/version/http_method/http_status_code).
Other collectors underwent various detailed improvements.

March 4, 2021¶

DataFlux Studio¶

1. Optimized Time Series Charts, Bar Charts, Rankings, Log Stream Charts, Alert Statistics Charts, Object List Charts¶

Time Series Chart: Added 「Display Density」, including 「Low: 60 points」、「Medium: 180 points」、「High: 360 points」、「Very High: 720 points」. Added 「Stacked Display」, supporting only bar charts, default off.
Rankings: Chart display optimization
Bar Charts: Chart display optimization
Log Stream Chart: Added search box, supporting searching for message content
Alert Statistics Chart: Query display optimization
Object List Chart: Query display optimization

2. Added Automatic Unit Conversion¶

Default query result values automatically convert units for display following 「Scientific Notation K, M, B」, retaining two decimal places (1 thousand = 1K, 1 million = 1M, 1 billion = 1B)
RMB automatically converts units 「Yuan, Ten Thousand Yuan, Hundred Million Yuan」, retaining two decimal places
After setting units, scientific notation is canceled, displaying according to the user-set unit

3. Added Object Management¶

DataFlux supports users managing notification targets, currently supporting adding DingTalk bot notification configurations and custom Webhook notification configurations.

4. Adjusted Event, Log, Trace, Application Monitoring, Object Host, Object Container, Object Process, Object Other Viewers, Supporting Exporting CSV Documents, Maximum Support Exporting Recent 5000 Data Entries.¶

Events

DataFlux supports collecting all event data generated based on the 「Anomaly Detection Library」. Users can view and search all event data within the workspace on the Events page.

Object Host

DataFlux supports collecting object host data. In the host list under 「Object」, you can view and search all host object data information.

Clicking the host name in the list draws out the details page to view detailed information about the host object, including basic information, CPU, memory, network, hard disk, etc.

Object Container

DataFlux supports collecting object container data. In the container list under 「Object」, you can view and search all container object data information. Clicking the container name in the list draws out the details page to view detailed information about the container object.

Object Process

DataFlux supports collecting object process data. In the process list under 「Object」, you can view and search all process object data information. Clicking the process name in the list draws out the details page to view detailed information about the process object.

Object Others

DataFlux supports collecting other object data, such as Alibaba Cloud ECS, etc. In the other list under 「Object」, you can view and search all other object data information. Clicking the other object name in the list draws out the details page to view detailed information about the other object.

Logs

DataFlux supports collecting various formats of log data, including system logs, Nginx logs, Apache logs, and more types of log data, allowing quick viewing and analysis of all log data within the current workspace.

Trace

DataFlux supports viewing trace services and trace lists in 「Trace」. In the service list, you can view or search all services receiving trace data. In the trace list, you can query trace data, export trace data, view trace details, and perform full analysis of trace performance through flame charts and span lists.

DataFlux supports both light and dark themes. Here is an example with the dark theme.

Service List

Trace Topology

Trace List

Flame Chart

Application Monitoring

DataFlux supports collecting Web, Android, iOS, and Mini Program application data and provides application monitoring scenarios, allowing quick viewing and analysis of application conditions. Taking Web applications as an example:

Web Browser

Web Application Details

February 2, 2021¶

DataFlux Studio¶

Added area chart style for time series charts
Added object host, container, process, new host honeycomb chart
Optimized anomaly detection, added built-in detection libraries
Optimized events, objects, logs, traces, browser, and page functions
Optimized log stream chart queries
Optimized rankings, dashboards, overview chart queries, added expression query mode
Optimized visualization chart queries, supporting switching between simple queries and DQL queries
Optimized grouping logic, including scatter plots, bubble charts, maps, honeycomb charts, and table charts
Optimized filtering conditions to support real-time filtering

DataKit¶

Added host object data collection
Added container object data collection
Added process object data collection

January 14, 2021¶

DataFlux Studio¶

Added Explorer layout, optimized data structure, supporting queries/analysis for objects/traces/RUM/logs modules
Added Mini Program application monitoring
Added time series charts, chart types can be selected as line charts or bar charts
Adjusted chart UI
Adjusted log stream chart queries and settings
Optimized bar chart, ranking chart, table chart-related settings
Threshold detection adjusted to DQL UI query mode

Release Notes (2021)¶

December 30, 2021¶

Optimized Binding to Built-in Views¶

Optimized Log Explorer¶

Optimized Associated Display in Explorer Detail Pages¶

Optimized Snapshot Sharing¶

Optimized Chart Query Results Showing Thousand Separators¶

Other Optimizations¶

December 16, 2021¶

Added Similarity Metric Query in Time Series Charts¶

Added Related Data Statistics Display in Explorer Detail Pages¶

Added Export Functionality for Explorer Charts¶

Added Explorer Search Match Query¶

Optimized Log Explorer and Log-related Data Queries¶

Optimized Mute Policies, Supporting Muting for Monitors¶

Optimized Monitor Management¶

Optimized View Variable Query Display¶

Optimized Dashboard, Note Chart Lock Time Settings¶

Optimized Help Center Page Entry¶

December 2, 2021¶

Added Owner Member Role¶

Added Custom Explorer for Scenarios¶

Added Export User View to Dashboard¶

Optimized Host Network Observability, Added Network Flow Data List View¶

Added sourcemap Functionality¶

Added Analysis of Host-associated Security Checks¶

Added DataKit Collector Kubernetes Installation Guide¶

Optimized Associated Trace Query for User Access Monitoring¶

Optimized Registration Upgrade Process¶

Price Reduction Adjustment¶

Other Optimization Features¶

November 18, 2021¶

Added SSO Login¶

Added SLO Chart to Dashboards and Notes¶

Added Custom Group Field Addition for Infrastructure Grouping¶

Added SLO Notification Mute Configuration¶

Optimized Chart Links¶

Price Reduction Adjustment¶

Other Optimization Features¶

November 4, 2021¶

Added Scenario Notes¶

Upgraded Scenario Views to Dashboards¶

Added Export to Dashboards and Notes in Explorers¶

Upgraded Anomaly Detection Library to Monitoring¶

Added SLO Monitoring Functionality and Export to Dashboards¶

Other Optimization Features¶

October 21, 2021¶

Added Host Network Distribution Diagram¶

Added User Access Monitoring Tracking Function¶

Added Scene Chart JSON Format Query¶

Optimized DCA Desktop Client Application¶

Optimized Event Host Linkage Query and Detection Rule Query¶

Adjusted Billing Method¶

Other Optimization Features¶

September 28, 2021¶

Added Host Network Performance Monitoring¶

Added Chart Linked Queries¶

Added Rectangular Treemap¶

Added Application Performance and User Access Monitoring Associated Queries¶

Added Absolute Time Range Query for Infrastructure¶

Optimized Concurrent Comparison Function for Charts¶

Optimized SLIMIT for Chart Queries¶

Cloud Dial Tests Adjusted to Availability Monitoring¶

Price Reduction Adjustment¶

September 9, 2021¶

DataFlux Renamed to "Guance"¶

Added Approximate Text Log Viewer¶

Added Container Jobs and Cron Jobs Viewer¶

Added DCA Desktop Client Application¶

Added Mobile App¶

Added Label Filtering for Metrics, Optimized Three Viewing Modes for Metrics¶

Optimized Anomaly Detection¶

Optimized Unresolved Event Display Style¶

Optimized Scene View Analysis¶

Optimized Infrastructure Binding to Built-in Views¶

Optimized Billing Method, Added Cloud Dial Test Billing, Adjusted Data Expiration Strategy¶

August 26, 2021¶

DataFlux Studio¶

Added Chart Query Label Filtering¶

Added Infrastructure Container Cluster, Replicate Set, Node Viewers¶

Added SLO Monitoring Functionality and Export to Dashboards

¶