Metering Data Structure and Usage
Overview¶
When data is written to a specific workspace, Guance will monitor and count the data volume in real-time. It records and stores the statistical information in the database according to the preset time cycle.
By combining DQL query statements, users can easily build a usage analysis dashboard. This dashboard provides intuitive data usage analysis, helping users gain insights into data flow trends, optimize resource allocation, and monitor data usage.
Data Structure¶
{
"time": 1720584000000,
"__docid": "fb4d3b817fdc08a266bfefe85049d279",
"count": "0",
"create_time": "1720591166343",
"date": "1720584000000",
"hour_count": "0",
"project": "logging",
"sub_project": "default",
"workspaceUUID": "wksp_3c5cc6626cb64550b401347931fcf467"
}
Field Descriptions¶
| Field | Type | Description | Example |
|---|---|---|---|
| time | int64 | Metric time, in ms, e.g., 1720584000000 is equivalent to 2024-07-10 12:00:00, indicating the metric time range from 2024-07-10 12:00:00 to 2024-07-10 13:00:00 (left-closed, right-open) | 1720584000000 |
| date | int64 | Same as time | |
| __docid | string | Unique identifier for a database record | fb4d3b817fdc08a266bfefe85049d279 |
| workspaceUUID | string | Workspace ID | wksp_3c5cc6626cb64550b401347931fcf467 |
| project | string | Metric project, detailed description below | logging |
| sub_project | string | Metric sub-project, detailed description below | default |
| count | int64 | Full metric count | 2345 |
| hour_count | int64 | Hourly metric data | 1234 |
| create_time | int64 | Actual write time to the database, in ms | 1720591166343 |
Metric Project (project) Descriptions¶
Note⚠️: Full statistics use count for counting, while incremental statistics use hour_count for counting.
| Metric | project | sub_project | Statistic Cycle | Statistic Method | Description |
|---|---|---|---|---|---|
| Datakit Count | datakit | Hourly | Full | Datakit usage in a specific workspace | |
| Total Site DataKit Count | platform_datakit | Hourly | Full | Represents the total datakit usage of the entire site, unrelated to specific workspaces | |
| Synthetic Test Runs | synthetic_test_runs | Hourly | Incremental | ||
| RUM PV Count | rum_pv | Hourly | Full | ||
| RUM Data Rows | rum_data_rows | Hourly | Incremental | Resource, Action, LongTask, Error counts | |
| RUM Raw Write Volume | rum_bytes | Hourly | Incremental | ||
| Trace Count | tracing | Hourly | Incremental | ||
| Tracing Raw Write Volume | tracing_bytes | Hourly | Incremental | ||
| Event Data Rows | keyevent | Hourly | Full | ||
| Data Forwarding to Customer S3 Object Storage | data_forwarding_s3_bytes | Optional values: logging/tracing/rum, representing backup information for corresponding data types | Hourly | Incremental | |
| Data Forwarding to Customer Message Engine | data_forwarding_kafka_bytes | Optional values: logging/tracing/rum, representing backup information for corresponding data types | Hourly | Incremental | |
| Data Forwarding to Customer OSS Object Storage | data_forwarding_oss_bytes | Optional values: logging/tracing/rum, representing backup information for corresponding data types | Hourly | Incremental | |
| Data Forwarding to Customer OBS Object Storage | data_forwarding_obs_bytes | Optional values: logging/tracing/rum, representing backup information for corresponding data types | Hourly | Incremental | |
| Data Forwarding to Default Storage Volume | data_forwarding_default_bytes | Optional values: logging/tracing/rum, representing backup information for corresponding data types | Hourly | Full | |
| Data Forwarding to Default Storage Volume (Incremental) | data_forwarding_delta_bytes | ||||
| Security Check Data Rows | security | Hourly | Incremental | ||
| Report Send Count | report | Every 5 minutes | Incremental | ||
| Infrastructure Object Count | object | Hourly | Full | ||
| Pipeline Processed Volume | pipeline_processed_bytes | Hourly | Incremental | ||
| Sensitive Data Scan Volume | sensitive_scan_bytes | Hourly | Incremental | ||
| Log Raw Write Volume | logging_bytes | Optional values: log multi-index index names | Hourly | Incremental | |
| Log Data Rows | logging | Optional values: log multi-index index names | Hourly | Incremental | |
| Time Series | timeseries | Hourly | Full | ||
| Pipeline Volume Statistics | pipeline_processed_bytes | Hourly | Incremental | ||
| Session Replay Count | session_replay | Hourly | |||
| Span Rows | tracing_span | Hourly | |||
| Profile Count | profile | Hourly | |||
| SIEM Scan Volume | siem_scan_bytes | Hourly | |||
| Job Run Count | job_runs | Hourly | |||
| SMS Send Count | sms | Hourly | |||
| Network Host Count | network | Hourly |