Data Observability Jobs¶
Go to Data Observability > Jobs to view the job list, run status distribution, and duration trends. Click a job row to access the Job Details.
Search and Filter¶
You can search for jobs using the search box at the top and the quick filters on the left.
Job List¶
| Field | Description |
|---|---|
| Job name | Name of the data processing job. |
| Integration | The integration or execution engine that has been collected, such as Spark, Flink, or dbt. |
| Status | Status of the most recent run in the selected scope. |
| Run count | Number of runs in the selected scope. |
| Last run | Time of the most recent run. |
| 7-day success rate | Success rate of batch jobs over the last 7 days, measured up to the query end time. |
| Duration | Duration of the most recent completed run. |
The 7-day success rate is the ratio of successful runs to all completed runs and applies to batch jobs. This metric is unavailable when there are no completed runs or when it is not applicable.
Run Analytics¶
Run Count¶
The stacked bar chart shows the distribution of run statuses over time, including succeeded, failed, aborted, running, and unknown.
You can use the chart to compare run results across different time periods. The Jobs page includes unfinished runs, while the Overview only counts completed runs, so the run counts may differ between the two views.
Run Duration¶
Shows the average duration (Avg) along with P95, P90, and P75 curves for observing overall duration and changes in slower runs.
The chart unit is displayed in seconds or minutes depending on the sample duration. Refer to the unit shown on the axis and tooltip.
Status Descriptions¶
| Status | Description |
|---|---|
Succeeded (COMPLETE) |
The job run completed successfully. |
Failed (FAIL) |
The job run failed. |
Aborted (ABORT) |
The job run was aborted. |
| Running | The final status of this run has not been obtained yet. |
| Unknown | The status of this run cannot be confirmed at the moment. |
The job status in the list reflects the most recent run result. To view the status of other runs, go to the run history in the job details.
Job Details¶
Click a job row to open the details, where you can view run history, inputs and outputs, configuration and changes, and attributes.
Header Summary¶
The header shows the job name and available integration information, and provides a View Lineage entry. The summary includes last run, duration, 7-day success rate, inputs/outputs, and downstream impact.
- Last run and duration: View the time of the most recent run and the duration of the most recent completed run.
- 7-day success rate: View the run success rate and run count over the last 7 days.
- Inputs / Outputs: View the data assets read and produced by the relevant runs.
- Downstream impact: View related downstream dependent objects.
Run History¶
The run list is shown on the left, and the details of the selected run are shown on the right.
Find a Run¶
- Search by Run ID, or filter by status.
- Click a run record on the left to view its details on the right; the list supports pagination.
| List Field | Description |
|---|---|
| Start time | Time when the run started; sorted by start time in descending order by default. |
| Status | Known status of this run. |
| Duration | Time from start to end of this run. |
| Data processed | Number of rows, data size, or number of output assets processed by this run. |
| Delay | Difference between the actual start time and the scheduled start time. |
| Trigger | How this run was triggered. |
Data processed, delay, and trigger require the corresponding information collection to be enabled. When no data is available, "Not reported" is displayed.
View Run Details¶
The right side shows the Run ID, status, start and end times, duration, inputs/outputs, and runtime environment information. Failed runs may also show error type, error summary, failure stage, or retry information, depending on what has been collected.
Continue analysis using the actions in the details:
- View inputs and outputs: Switch to the Inputs & Outputs tab and select the same run.
- View downstream impact: Use the current job as the anchor to view two levels of downstream relationships.
Inputs & Outputs¶
This tab shows the data assets read and produced by a single run. The top displays the run time, Run ID, and status. You can switch runs using Select Run.
| Section | Content |
|---|---|
| Input data | Data assets read by this run, along with the number of rows or size read. |
| Output data | Data assets produced by this run, along with the number of rows or size written. |
Click a data asset to open the Data Asset Details. When there is no input, output, or processed-volume information, the corresponding section indicates that it has not been reported.
Click View Lineage for This Run to see the direct input-output relationships of the selected run. In this case, the direction is fixed to upstream/downstream and the level is fixed to 1.
Different runs may read or produce different data assets. The row count and size of the inputs and outputs indicate the read/write volume of this run.
Configuration & Changes¶
View the execution engine, version, execution parameters, and adapter information, as well as configuration changes between adjacent runs.
Change records include time, change type, configuration item, value before and after the change, and source. Click a record to view details on the right; click View Current Run to return to the run history and locate the corresponding run.
When troubleshooting failures, you can analyze the situation using configuration changes, run results, and error information.
Attributes¶
View job attributes by basic information, scheduling information, and collection information, including namespace, job type, processing type, integration, scheduler, and schedule interval. The specific content displayed depends on what has been collected.