Trace Details¶
In the Trace Explorer, click any trace to view its details, including relative time, duration, HTTP method, URL, status code, TraceId, Flame Graph, Span list, service call relationships, and associated logs, hosts, metrics, and network information. For frontend applications (e.g., browsers), you can also view the request time distribution, including queue time, time to first byte, and download time.
When opening the trace details, the system displays the waterfall chart or flame graph first based on the "Trace Details Default View" setting in Preferences.
Note
- The RUM SDK must be version 2.2.10 or later to display this data. If cross-origin requests are involved, adjust the header configuration accordingly.
For more details, see Web Application Integration.
- The Flame Graph/Span list/Waterfall Chart displays up to 10,000 spans. Use the Offset setting to view spans that are not displayed:
Flame Graph¶
The Flame Graph clearly shows the flow and execution time of each span. On the right, you can view the service list and response times. Click a span to view its JSON content in the trace details; use the mouse scroll wheel to zoom in for more details.
For more details, see Using the Flame Graph to Analyze Trace Performance.
The flame graph above shows that this trace involves two services: CloudCare and Mysql. The trace starts with a POST request to the CloudCare service, then executes ActionResource.executeAction, and finally executes MySQL statements. During the entire execution of ActionResource.executeAction, MySQL statements are executed multiple times. The execution time calculation for CloudCare and Mysql is as follows:
- CloudCare service execution time = D1+D2+D3+D4+D5+D6+D7+D8+D9+D10+D11
- Mysql service execution time = span2+span3+......+span11
For specific executed statements and execution time details, refer to the Span list.
The service execution time percentage in the flame graph indicates the proportion of each service's total time in the trace. Taking the example below, this trace includes two services: CloudCare and Mysql, with execution time percentages of 42.37% and 57.63% respectively. CloudCare has 2 spans and Mysql has 10 spans.
- Mysql service execution time percentage = sum of all span execution times / total trace duration.
Instructions: In the figure below, the Mysql service has 10 spans. Click each span to get its execution time. As shown, the execution time of this span is 5.08ms. Repeat for the remaining 9 spans and sum them.
- CloudCare service execution time percentage = (total trace duration - Mysql execution time) / total trace duration.
In the figure below, the CloudCare service spans the entire trace. Excluding the Mysql execution time, the remaining time is the CloudCare execution time (see the red-highlighted part). The execution time percentage can also be viewed directly in the Span list for each span.
Span List¶
- Displays the resource name, count, duration, execution time, and percentage of all spans in the trace.
- You can search by entering a resource name or Span ID.
- Click any span to view its JSON content in the trace details; the flame graph updates synchronously.
- If there is an error, an error indicator is displayed.
- Click Error Spans to directly display the filtered results.
Waterfall Chart¶
View the parent-child relationships between resources.
The waterfall chart displays span data in chronological order of start time. The left panel lists span data showing the execution time percentage of each resource. The right panel shows the waterfall chart in chronological order.
- Enter the resource name or Span ID to search.
- Collapse or expand the left resource list with one click.
- Click to toggle the execution time format.
- Click Error Spans to directly display the filtered results.
Service Call Relationships¶
Shows the call relationships and call counts between different services, as well as the execution time, average latency, and call count for each service.
Click any service node to view its details:
- Service Operations and Resources: Lists the specific operations (e.g., API endpoints, methods) and related resources for the service.
- Error Status Tracking:
- If the service has errors, error details are shown directly.
- Click to view the service's parent span to trace upstream call sources.
Note
The system determines the color of the service based on the error result for the service in the trace details > Flame Graph.
Quick Actions¶
Action |
Description |
|---|---|
| Fullscreen/Default Size | Click the fullscreen icon in the upper right of the trace details to expand the flame graph horizontally; click the restore default size icon to restore the detail page. |
| Locate Current Span | Click to zoom in and locate the current span. |
| Expand/Collapse Mini Map | Click the expand/collapse mini map icon on the left side of the trace details to quickly view the flame graph by selecting a range, dragging, or scrolling on the mini map. |
| View Global Trace | Click the view global trace icon on the left side of the trace details to view the full trace in the flame graph. |
| Double-click Span | In the flame graph, double-click a span to zoom in and display it in the center, allowing you to quickly locate and view its context spans. |
| Click Service Name | Highlights the corresponding spans. Click the service name again to restore the default selection of all spans. You can quickly filter and view spans for a service by clicking the service name. |
Extended Attributes¶
- In the search bar, enter a field name or value to quickly search and locate.
-
After selecting the field alias, you can view it after the field name. Choose as needed.
-
On the trace details page, you can view the related field attributes of the current trace in Extended Attributes:
Field |
Attribute |
|---|---|
| Filter Field Value | Add this field to the explorer to view all data related to this field. You can filter the trace list in the Trace Explorer. See Figure 1 |
| Inverse Filter Field Value | Add this field to the explorer to view data excluding this field. |
| Add to Display Columns | Add this field to the explorer list for viewing. |
| Copy | Copy this field to the clipboard. |
Some fields do not support filtering, aggregation, and related logic
Guance uses full-text indexing for some fields. These fields do not support filtering, aggregation, or related logic. The full-text index fields are as follows:
| Category | Field |
|---|---|
| Objects, Resource Catalog | message |
| Logs, Backup Logs | message |
| Security | message / title |
| Network | message |
| Traces | error_message / error_stack |
| Events | message / title / df_message / df_title |
| RUM Errors | error_message / error_stack |
| RUM Long Tasks | long_task_message / long_task_stack |
Figure 1
Error Details¶
On the trace details page, if the current trace contains errors, select the error span filter in the sidebar. The system will highlight all error spans. Click any highlighted span to view its associated error stack, logs, and other details.
For more details, see Error Tracking.
Service Context¶
By retrieving object categories from the infrastructure resource catalog and selecting the latest object by create_time, you can quickly view the runtime information, service dependencies, and integration information of the current service.
Correlated Analysis¶
You can view log data associated with all services in the entire trace through Logs (correlation field: trace_id). You can customize the display columns. To view more detailed log content, click the log content to go to the log details page, or click the jump button to open the Logs page.
The system matches the log index mapping based on fields such as service, env, and version of the current trace, and automatically selects the corresponding log index. The original index "Match Service" configuration continues to take effect based on the service field mapping.
If you have Admin or higher permissions, you can customize the correlation fields. Click the settings button on the right of the correlation field, select the fields to correlate in the dialog, and support manual input, drag-and-drop ordering, etc. Confirm to complete the configuration.
Note: Custom fields in correlated logs and the service list correlation analysis configuration affect each other. If custom fields are configured in the service list, they are displayed here synchronously.
When the application uses the ddtrace collector with both APM distributed tracing and Profile performance tracing data collection enabled, the system provides span-level correlation to view code hotspots, including execution time, methods, and execution time percentage.
Click View Profile Details to jump to the Profile details page to view more correlated code.
On the trace details page, you can view the metric view and attribute view of the associated host through Hosts (correlation field: host).
- Metric View: View the performance metrics of the associated host from 30 minutes before the trace ends to 30 minutes after the trace ends, including CPU, memory, and other performance metrics.
- Attribute View: Helps you trace back the actual state of the host object at the time the trace was generated. You can view the latest object data generated by the associated host within the corresponding time period, including host basic information and integration running status. If cloud host collection is enabled, cloud provider information is also available.
Note: Guance retains the last 48 hours of host object history data by default. If the host history data corresponding to the current trace time is not found, you will not be able to view the attribute view of the associated host.
On the trace details page, you can view the metric view and attribute view of the associated container through Containers (correlation field: container_name).
-
Metric View: View the performance metrics of the associated container from 30 minutes before the trace ends to 30 minutes after the trace ends, including container CPU, memory, and other performance metrics.
-
Attribute View: Helps you trace back the actual state of the container object at the time the trace was generated. You can view the latest object data generated by the associated container within the corresponding time period, including container basic information and attributes.
On the trace details page, you can view the metric view and attribute view of the associated Pod through Pods (correlation field: pod_name).
-
Metric View: View the performance metrics of the associated Pod from 30 minutes before the trace ends to 30 minutes after the trace ends, including Pod CPU, memory, and other performance metrics.
-
Attribute View: Helps you trace back the actual state of the Pod object at the time the trace was generated. You can view the latest object data generated by the associated Pod within the corresponding time period, including Pod basic information and attributes.
Guance supports viewing network topology and overview data for multiple dimensions including Host, Pod, Deployment, and Service under Network.
Matching Fields:
To view the related network on the details page, the corresponding correlation fields must be matched. That is, the corresponding field tags must be configured during data collection; otherwise, the associated network view cannot be matched on the details page.
-
Host: Match field
host. -
Pod:
| Match Field Priority |
|---|
| namespace, pod_name |
| namespace, pod |
| pod_name |
| pod |
- Deployment:
| Match Field Priority |
|---|
| namespace, deployment_name |
| namespace, deployment |
| deployment_name |
| deployment |
- Service:
| Match Field Priority |
|---|
| namespace, service_name |
| namespace, service |
Note:
- If correlation fields for Host, Pod, Deployment, and Service are all found, the network data is displayed in this order when entering the details page.
- If no correlation fields are found, the item is displayed in gray at the end, and clicking shows No network view matched.
















