Traces¶
In the Guance console, you can view all related data in APM > Trace. You can search, filter, export trace data, view trace details, and perform a comprehensive analysis of trace performance through flame graphs, Span lists, etc. Both synchronous and asynchronous calls can clearly track the data details of each trace.
Trace List¶
Guance provides three types of trace viewing lists, which are All Spans, Entry Spans, and All Traces.
A Span represents a logical unit of work in a distributed system within a given time period, and multiple Spans constitute a trace trajectory (trace).
Display all collected Span data within the currently selected time range.
Filter and display all Span data that first entered within the currently selected time range.
Filter and display all Trace data containing the initial top-level Span within the currently selected time range.
Query and Analysis¶
-
Time widget: The Trace explorer defaults to showing data from the last 15 minutes. You can customize the time range for data display.
-
In the Trace explorer search bar, it supports various search and filtering methods.
- Note: When you switch to view service or trace explorer, Guance defaults to retain your current filter conditions and time range.
-
Analysis Mode: In the Trace explorer analysis bar, you can perform multi-dimensional analysis statistics based on 1-3 tags and support multiple data chart analysis methods.
-
Quick Filter: Supports editing quick filters, adding new filter fields.
-
Filter History: Guance supports saving the explorer
key:valuesearch condition history in the filter history and applying it to different explorers in the current workspace. -
Custom display columns: In the trace list, the default view is time, trace ID, service, resource, and duration, which can be customized to add, edit, delete, and drag display columns.
Chart Statistics¶
In the trace explorer chart statistics, you can check the Requests, Error Requests, Response Time of different statuses of the trace within the selected time range, and you can filter the synchronous display chart statistics.
- Requests/Error Requests: Divide into 60 time points according to the selected time range, and use a histogram to statistically display requests and error requests for the trace.
- Response time: Divide into 60 time points according to the selected time range, and use a line graph to statistically display four response metrics, namely the average response time per second, P75 response time, P90 response time and P99 response time.
Data Export¶
In the trace explorer, after filtering out the desired Trace data for viewing and analysis, you can export it to a CSV file or scenario dashboard and notes.
If you need to export a piece of data, open the details page of this piece of data, and click the icon in the upper right corner.
Save as a Snapshot¶
Guance supports viewing historical snapshots to directly save the snapshot data of the current explorer. Through the snapshot function, you can quickly reproduce instant copies of data and restore data to a certain point in time and a certain data display logic.
Trace Details¶
In the trace explorer, you can view the corresponding trace details by clicking on any trace, including the time, duration, HTTP method, HTTP URL, HTTP status code, TraceId, Flame, Span list, service call relationship and associated logs, hosts, metrics, networks, etc.
If the current trace belongs to a front-end application (such as: browser), you can view the request time distribution in the trace details, including the request time proportions of Queueing (queue), First Byte (first packet), Download (download).
Warning
The RUM SDK must be 2.2.10 and above to see this part of the data display. If there is a cross-domain situation, the header configuration needs to be adjusted.
For more details, see Web Application Access.
Flame¶
The flame graph can clearly show the flow and execution time of each Span in the entire trace. You can view the corresponding service list and response time on the right side of the flame graph. Click on the Span in the flame graph, in the Trace Details Page you can view the corresponding Json content, you can view specific Span information by zooming in and out with the mouse wheel.
For more details on the application of the flame graph, see Use Flame Graph to Analyze Trace Performance.
Span List¶
Display the total Span quantity and its list in this trace, including Resource, Span Quantity, Duration, Execution Time and Proportion.
You can search for Span. Click on any Span. In Trace Details, you can view the corresponding JSON content. Switch to the flame graph to synchronously display Span. If there are errors, error prompts will be displayed before Span.
Waterfall Chart¶
In the Span list, click to view the parent-child relationship between resources.
The waterfall chart displays Span data in order of start time. The left side list displays Span data and shows the execution time(%) of each resource. The right side displays the waterfall chart in order of time.
You can also search for Span in the 🔍 bar. The fuzzy search results of the resource (resource) field will be highlighted.
Service Map¶
The service map is used to view the relationship between various "services-resources", and supports viewing related service map through the service, resource field search and filter.
Options¶
| Options | Description |
|---|---|
| Full screen/Restore default size | Click the full-screen view icon in the upper right corner of the trace detail to expand and view the trace flame graph horizontally; click the restore default size icon to restore the detail page. |
| Expand/Collapse Minimap | Click the expand/collapse minimap icon on the left side of the trace detail to quickly view the flame graph by selecting the interval, dragging, and scrolling on the minimap. |
| View Global Trace | Click the view global Trace icon on the left side of the trace detail to view the global trace in the flame graph. |
| Double-click Span | In the flame graph, enlarge the Span in the middle to quickly locate and view its associated Span in the context. |
| Click on the service name | Highlight the corresponding Span, click the service name again, and restore the default full selection Span. You can filter and view the Span corresponding to the service by clicking the service name. |
Attributes¶
In the search bar, you can quickly search and locate by entering the field name or value;
After checking the field alias, you can view it after the field name; you can choose as needed.
You can view the related fields of the current trace in Extended Attributes:
| Field | Attribute |
|---|---|
| Filter | Add this field to the explorer to view all data related to this field. You can filter and view the trace list related to this field in the trace explorer. See Figure 1. |
| Reverse filter | Add this field to the explorer to view other data except this field. |
| Add to display column | Add this field to the explorer list for viewing. |
| Copy | Copy this field to the clipboard. |
Some fields do not support filter aggregation and related logic
Guance has some fields that use full-text indexing. These fields do not support you to do filter aggregation and related logic. The range of full-text index fields is as follows:
| Category | Field |
|---|---|
| Infrastructure, Custom Infrastructure Type | message |
| Logs, Backup Logs | message |
| Security Check | message / title |
| Network | message |
| Traces | error_message / error_stack |
| Events | message / title / df_message / df_title |
| RUM Error | error_message / error_stack |
| RUM Long Task | long_task_message / long_task_stack |
Figure one
Associated Analysis¶
You can view the logs associated with the current trace (associated field: trace_id) through Logs. If you need to view more detailed log content, you can click on the log content to jump to the log details page, or click the jump button to open on the log page.
If you are an administrator or above, you can customize the associated fields. Click the column button and select the fields you need to associate.
Warning
The associated log custom field and service list association analysis configuration custom field affect each other. If a custom field is configured in the service list, it will be synchronized here.
For more details, see Service List Association.
After the application is using the ddtrace collector to turn on APM traces and Profile performance tracking data collection at the same time, Guance provides Span level associated viewing analysis. On the trace details page, you can click on Code Hotspots under the flame graph to view the code hotspots associated with the current trace, including execution time consumption, methods, and execution time(%).
Clicking View Profile Details can jump to the Profile details page to view more associated code.
In the trace details page, you can view the metric view and attribute view of the related host (associated field: host) through Host.
- Metric View: You can view the performance metric status of the related host within 30 minutes before the end of the trace to 30 minutes after the end of the trace, including the performance metric view of the related host's CPU, memory, etc.
- Attribute View: Helps you to trace back the real situation of the host when the trace is generated, support to view the latest data generated within the corresponding time of the related host, including the basic information of the host, integrated operating situation. If you turn on the collection of cloud hosts, you can also view the information of the cloud manufacturer.
Note: Guance defaults to save the host's recent 48 hours of historical data. If the host's historical data corresponding to the current trace time is not found, you will not be able to view the attribute view of the associated host.
In the trace details page, you can view the metric view and attribute view of the related container (associated field: container_name) through Container.
-
Metric View: Support viewing the performance metric status of the related container within 30 minutes before the end of the trace to 30 minutes after the end of the trace, including the performance metric view of the container CPU, memory, etc.
-
Attribute View: Help you to trace back the real situation of the container object when the trace is generated, supports viewing the latest object data generated within the corresponding time of the related container, including the basic information of the container, attribute information.
In the trace details page, you can view the attribute view and metric view of the related Pod (associated field: pod_name) through Pod.
-
Metric View: Support viewing the performance metric status of the related container Pod within 30 minutes before the end of the trace to 30 minutes after the end of the trace, including the performance metric view of the container CPU, memory, etc.
-
Attribute View: Help you trace back the real situation of the container Pod object when the trace is generated, supports viewing the latest object data generated within the corresponding time of the related container Pod, including the container's basic information, attribute information.
Guance enables you to view network map and overview data within 48 hours from dimensions of Host, Pod, Deployment and Service.
Matching Fields:
To view the related network in the details page, you need to match the corresponding associated fields, that is, you need to configure the corresponding field tags when collecting data, otherwise you can not match and view the associated network view in the details page.
-
Host: Match field
host. -
Pod:
| Priority of Matching Fields |
|---|
namespace, pod_name |
namespace, pod |
pod_name |
pod |
- Deployment:
| Priority of Matching Fields |
|---|
namespace, deployment_name |
namespace, deployment |
deployment_name |
deployment |
- Service:
| Priority of Matching Fields |
|---|
namespace, service_name |
namespace, service |
Notes:
- If the associated fields of Host, Pod, Deployment, Service are queried at the same time, the network data is displayed in this order when entering the details page;
- If the associated field is not queried, it is displayed in gray at the end, clicking prompts No matching network view.