Data Catalog¶
Go to Data Observability > Data Catalog to view all collected data assets in one place. You can search and filter data assets, then open the details to view field structures and upstream/downstream relationships.
Each row in the Data Catalog represents a data asset. Jobs and their run history can be viewed in Jobs.
Search and Filter¶
You can search for data assets using the search box at the top, or filter by selecting fields and values as prompted on the page. For search syntax, see Search.
You can also use the Quick Filters on the left to locate data assets.
List Fields¶
| Field | Description |
|---|---|
| Data Asset | The name of the data asset. Click a row to enter asset details. |
| Type | The recognized asset type; if the specific type cannot be determined, Dataset is displayed. |
| Data Platform | The platform to which the data asset belongs. |
| Status | The status of the most recent associated run. |
| Last Observed | The most recent time information about this data asset was collected. |
| Direct Downstream | The number of directly downstream objects collected within the current scope. |
Use Display Columns to adjust the list contents, including Namespace, latest associated run, lifecycle, Schema fields, and more.
Asset types include tables, views, materialized views, Topics, Streams, files, and generic Datasets.
The status in the list reflects the run results of associated jobs, not data quality check results.
If no results match the query, clear the filters first. If data still does not appear, check the collection configuration of the data asset.
Data Asset Details¶
Click a data asset row to enter its details, and view the Overview, Schema, Data Lineage, Related Jobs, and Extended Attributes.
The page header displays the name, type, and association status. Click Refresh to re-query the current details; click View Full Lineage to enter Data Lineage anchored on the current asset.
Summary Information¶
| Information | Description |
|---|---|
| Last Observed | The most recent time asset information was collected within the selected scope. |
| Latest Associated Run | The status of the most recent associated run. |
| Input/Output Relationships | The read/write relationships directly related to the current asset. |
| Schema Fields | The number of fields in the reported Schema. |
| Output Rows This Run | The number of rows output by the associated run. |
Statuses such as "Association Normal", "Association Abnormal", or "Association Running" reflect the result of the most recent associated run. The field count and output row count require the corresponding information collection to be enabled.
Overview¶
Run Records¶
Displays the most recent associated runs for the current asset, including start time, job, relationship, status, duration, and input/output counts.
The relationship describes how the asset participates in the run:
- Input (INPUT): The job reads the current asset.
- Output (OUTPUT): The job produces the current asset.
Click a run record to go to the corresponding job and view run details. Click View All Runs to open the Related Runs page for the current asset.
Direct Relationships¶
Shows the relationships between the current asset and producer jobs, consumer jobs, and directly related data assets. Click an asset or job to continue viewing its details; to expand the scope of relationships, click View Full Lineage.
Collected Information¶
Shows the collection status of data platform, asset type, Schema, field lineage, statistics, and quality information.
- Reported: The corresponding information has been obtained.
- Not Reported: The corresponding information has not yet been obtained.
- Incomplete Parsing: Some information has been obtained, but the details are incomplete.
Schema¶
The Schema tab displays field names, types, descriptions, and field lineage.
When field lineage is marked as Reported, you can expand it to view upstream fields, source assets, transformation information, and masking markers.
If the page indicates "Schema Not Reported" or "Schema Details Unavailable", check the collection configuration of the field structure. To view field sources, you also need to enable field lineage collection.
Data Lineage¶
In the current asset details, view the upstream and downstream lineage preview, adjust the direction and depth, and view relationship details. If you need to continue searching for other anchors or expand the investigation scope, click View Full Lineage.
For example, current data asset → consumer job → output data asset is a two-hop relationship.
Related Jobs¶
Shows jobs related to the current asset, along with read/write relationships, latest run time, status, and last successful time. Click a job to go to Job Details.
To view each execution of a job, go to the run history.
Extended Attributes¶
View attributes such as asset name, Namespace, type, data platform, and collection source. You can copy available values in the attribute rows. The displayed content depends on the collected information.
Related Runs¶
In the Overview, click View All Runs to enter the related runs page for the current asset.
- Search at the top by job name or Run ID, or filter by run status.
- Select a run record from the list on the left; the run details are displayed on the right.
- View the job, read/write relationships, start/end times, duration, input/output, and error information.
- Click View Downstream Impact to enter downstream lineage analysis anchored on the current asset.
- Click Back to return to the asset details.
The input row count and output row count indicate the amount of data read and written in a single run. When comparing statistics, also confirm the run records, read/write direction, and unit of measurement.