Huawei Cloud DDS
Collect Huawei Cloud DDS Metrics
Configuration¶
Install Func¶
It is recommended to activate Guance Integration - Extensions - DataFlux Func (Automata): All prerequisites are automatically installed. Please proceed with script installation.
If you deploy Func manually, refer to Manual Func Deployment
Install Script¶
Note: Please prepare Huawei Cloud AK in advance (for simplicity, you can directly grant global read-only permission
Tenant Guest)
Automata Script Activation¶
- Log in to the Guance console
- Click the 【Integration】 menu and select 【Cloud Account Management】
- Click 【Add Cloud Account】, select 【Huawei Cloud】, and fill in the required information on the interface. If you have previously configured cloud account information, ignore this step
- Click 【Test】, and after successful testing, click 【Save】. If the test fails, please check if the relevant configuration information is correct and retest
- Click 【Cloud Account Management】, and you can see the added cloud account in the list. Click the corresponding cloud account to enter the details page
- Click the 【Integration】 button on the cloud account details page, find
Huawei Cloud DDSunder theUninstalledlist, and click the 【Install】 button to pop up the installation interface and install it.
Manual Script Activation¶
-
Log in to the Func console, click 【Script Market】, enter the Guance script market, search for
integration_huaweicloud_dds: Collect Huawei Cloud DDS Metricsintegration_huaweicloud_dds_slowlog: Collect Huawei Cloud DDS Slow Log Data -
Click 【Install】, then enter the corresponding parameters: Huawei Cloud AK, SK, and account name
-
Click 【Deploy Startup Script】, the system will automatically create the
Startupscript set and automatically configure the corresponding startup script -
After enabling, you can see the corresponding automatic trigger configuration in 「Management / Automatic Trigger Configuration」. Click 【Execute】 to execute it immediately without waiting for the scheduled time. After a while, you can view the execution task records and corresponding logs
Verification¶
- In 「Management / Automatic Trigger Configuration」, confirm whether the corresponding task has the corresponding automatic trigger configuration, and you can also view the corresponding task records and logs to check for any exceptions
- In Guance, 「Infrastructure - Resource Catalog」, check if there is asset information
- In Guance, 「Metrics」, check if there is corresponding monitoring data
- In Guance, 「Logs」, check if there is corresponding slow log data
Metrics¶
Configure Huawei Cloud DDS Metrics. More metrics can be collected through configuration Huawei Cloud DDS Metrics Details
| Metric ID | Metric Name | Metric Description | Value Range | Measurement Object | Monitoring Period (Raw Metric) |
|---|---|---|---|---|---|
mongo001_command_ps |
Command Execution Rate | This metric is used to count the average number of command statements executed per second on the node, in executions per second. Unit: Executions/s | ≥ 0 Executions/s | Document Database Instance Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute 5 seconds |
mongo002_delete_ps |
Delete Statement Execution Rate | This metric is used to count the average number of delete statements executed per second on the node. Unit: Executions/s | ≥ 0 Executions/s | Document Database Instance Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute 5 seconds |
mongo003_insert_ps |
Insert Statement Execution Rate | This metric is used to count the average number of insert statements executed per second on the node, in executions per second. Unit: Executions/s | ≥ 0 Executions/s | Document Database Instance Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute 5 seconds |
mongo004_query_ps |
Query Statement Execution Rate | This metric is used to count the average number of query statements executed per second on the node. Unit: Executions/s | ≥ 0 Executions/s | Document Database Instance Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute 5 seconds |
mongo006_getmore_ps |
Update Statement Execution Rate | This metric is used to count the average number of update statements executed per second on the node. Unit: Executions/s | 0 Executions/s | Document Database Instance Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute 5 seconds |
mongo007_chunk_num1 |
Chunk Number of Shard One | This metric is used to count the number of chunks in shard one. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num2 |
Chunk Number of Shard Two | This metric is used to count the number of chunks in shard two. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num3 |
Chunk Number of Shard Three | This metric is used to count the number of chunks in shard three. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num4 |
Chunk Number of Shard Four | This metric is used to count the number of chunks in shard four. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num5 |
Chunk Number of Shard Five | This metric is used to count the number of chunks in shard five. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num6 |
Chunk Number of Shard Six | This metric is used to count the number of chunks in shard six. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num7 |
Chunk Number of Shard Seven | This metric is used to count the number of chunks in shard seven. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num8 |
Chunk Number of Shard Eight | This metric is used to count the number of chunks in shard eight. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num9 |
Chunk Number of Shard Nine | This metric is used to count the number of chunks in shard nine. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num10 |
Chunk Number of Shard Ten | This metric is used to count the number of chunks in shard ten. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num11 |
Chunk Number of Shard Eleven | This metric is used to count the number of chunks in shard eleven. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_chunk_num12 |
Chunk Number of Shard Twelve | This metric is used to count the number of chunks in shard twelve. Unit: counts | 0~64 Counts | Document Database Cluster Instance | 1 minute 5 seconds |
mongo008_connections |
Current Active Connections | This metric is used to count the total number of connections attempting to connect to the DDS instance. Unit: Counts | 0~200 Counts | Document Database Instance | 1 minute 5 seconds |
mongo009_migFail_num |
Number of Failed Chunk Migrations in the Past Day | This metric is used to count the number of failed chunk migrations in the past day. Unit: Counts/s | ≥ 0 Counts/s | Document Database Cluster Instance | 1 minute 5 seconds |
mongo007_connections |
Current Active Connections | This metric is used to count the total number of connections attempting to connect to the DDS instance node. Unit: Counts | 0~200 Counts | Document Database Instance Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute 5 seconds |
mongo007_connections_usage |
Current Active Connection Percentage | This metric is used to count the percentage of connections attempting to connect to the instance node out of the available connections. Unit: % | 0~100% | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute 5 seconds |
mongo008_mem_resident |
Resident Memory | This metric is used to count the current size of resident memory. Unit: MB | ≥ 0 MB | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo009_mem_virtual |
Virtual Memory | This metric is used to count the current size of virtual memory. Unit: MB | ≥ 0 MB | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo010_regular_asserts_ps |
Regular Assertion Rate | This metric is used to count the regular assertion rate. Unit: Executions/s | ≥ 0 Executions/s | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo011_warning_asserts_ps |
Warning Rate | This metric is used to count the warning rate. Unit: Executions/s | ≥ 0 Executions/s | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo012_msg_asserts_ps |
Message Assertion Rate | This metric is used to count the message assertion rate. Unit: Executions/s | ≥ 0 Executions/s | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo013_user_asserts_ps |
User Assertion Rate | This metric is used to count the user assertion rate. Unit: Executions/s | ≥ 0 Executions/s | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo014_queues_total |
Operations Waiting for Locks | This metric is used to count the current number of operations waiting for locks. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo015_queues_readers |
Operations Waiting for Read Locks | This metric is used to count the current number of operations waiting for read locks. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo016_queues_writers |
Operations Waiting for Write Locks | This metric is used to count the current number of operations waiting for write locks. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo017_page_faults |
Page Faults | This metric is used to count the current number of page faults on the node. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo018_porfling_num |
Slow Query Count | This metric is used to count the total number of slow queries on the node from the previous 5 minutes to the current time point. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo019_cursors_open |
Current Open Cursors | This metric is used to count the current number of open cursors on the node. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo020_cursors_timeOut |
Service Timeout Cursors | This metric is used to count the current number of service timeout cursors on the node. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo021_wt_cahe_usage |
Data in Memory (WiredTiger Engine) | This metric is used to count the current amount of data in memory (WiredTiger engine). Unit: MB | ≥ 0 MB | Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo022_wt_cahe_dirty |
Dirty Data in Memory (WiredTiger Engine) | This metric is used to count the current amount of dirty data in memory (WiredTiger engine). Unit: MB | ≥ 0 MB | Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo023_wInto_wtCache |
Write Frequency to WiredTiger Memory | This metric is used to count the current write frequency to memory (WiredTiger engine). Unit: ≥ Bytes/s | ≥ 0 Bytes/s | Document Database Instance Primary Node Document Database Instance Secondary Node Node | 1 minute |
mongo024_wFrom_wtCache |
Write Frequency from WiredTiger Memory to Disk | This metric is used to count the current write frequency from memory to disk (WiredTiger engine). Unit: Bytes/s | ≥ 0 Bytes/s | Document Database Instance Primary Node | 1 minute |
mongo025_repl_oplog_win |
Available Time in Primary Node's Oplog | This metric is used to count the available time in the primary node's Oplog under the current instance. Unit: Hours | ≥ 0 Hours | Document Database Instance Secondary Node Node | 1 minute |
mongo025_repl_headroom |
Primary and Secondary Oplog Overlap Duration | This metric is used to count the Oplog overlap duration between the primary node and the secondary node under the instance. Unit: Seconds | ≥ 0 Seconds | Document Database Instance Secondary Node | 1 minute |
mongo026_repl_lag |
Primary and Secondary Replication Delay | This metric is used to count the replication delay between the primary node and the secondary node under the instance. Unit: Seconds | ≥ 0 Seconds | Document Database Instance Secondary Node | 1 minute |
mongo027_repl_command_ps |
Secondary Node Replicated Command Execution Rate | This metric is used to count the average number of command statements executed per second on the secondary node. Unit: Executions/s | ≥ 0 Executions/s | Document Database Instance Secondary Node | 1 minute |
mongo028_repl_update_ps |
Secondary Node Replicated Update Statement Execution Rate | This metric is used to count the average number of update statements executed per second on the secondary node. Unit: Executions/s | ≥ 0 Executions/s | Document Database Instance Secondary Node | 1 minute |
mongo029_repl_delete_ps |
Secondary Node Replicated Delete Statement Execution Rate | This metric is used to count the average number of delete statements executed per second on the secondary node. Unit: Executions/s | ≥ 0 Executions/s | Document Database Instance Secondary Node | 1 minute |
mongo030_repl_insert_ps |
Secondary Node Replicated Insert Statement Execution Rate | This metric is used to count the average number of insert statements executed per second on the secondary node. Unit: Executions/s | ≥ 0 Executions/s | Document Database Instance Secondary Node | 1 minute |
mongo031_cpu_usage |
CPU Usage | This metric is used to count the CPU utilization of the measurement object. Unit: % | 0~100% | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo032_mem_usage |
Memory Usage | This metric is used to count the memory utilization of the measurement object. Unit: % | 0~100% | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo033_bytes_out |
Network Output Throughput | This metric is used to count the average number of bytes output per second from all network adapters of the measurement object. Unit: Bytes/s | ≥ 0 Bytes/s | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo034_bytes_in |
Network Input Throughput | This metric is used to count the average number of bytes input per second from all network adapters of the measurement object. Unit: Bytes/s | ≥ 0 Bytes/s | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo035_disk_usage |
Disk Utilization | This metric is used to count the disk utilization of the measurement object. Unit: % | 0~100% | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo036_iops |
IOPS | This metric is used to count the average number of I/O requests processed by the system per second on the current instance node. Unit: Counts | ≥ 0 Counts/s | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo037_read_throughput |
Disk Read Throughput | Average number of bytes read per second from the disk. Unit: Bytes/s | ≥ 0 Bytes/s | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo038_write_throughput |
Disk Write Throughput | Average number of bytes written per second to the disk. Unit: Bytes/s | ≥ 0 Bytes/s | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo039_avg_disk_sec_per_read |
Disk Read Latency | This metric is used to count the average time spent per disk read operation during a certain period. Unit: Seconds | ≥ 0 Seconds | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo040_avg_disk_sec_per_write |
Disk Write Latency | This metric is used to count the average time spent per disk write operation during a certain period. Unit: Seconds | ≥ 0 Seconds | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo042_disk_total_size |
Total Disk Size | This metric is used to count the total disk size of the measurement object. Unit: GB | 0~1000 GB | Document Database Cluster Instance dds mongos Node Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo043_disk_used_size |
Disk Usage | This metric is used to count the total used disk size of the measurement object. Unit: GB | 0~1000 GB | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo044_swap_usage |
SWAP Utilization | Swap memory SWAP usage percentage. Unit: % | 0~100% | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo050_top_total_time |
Total Time Spent on Collections | Mongotop-total time metric, total time spent on collection operations. Unit: Milliseconds | ≥ 0 Milliseconds | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo051_top_read_time |
Total Time Spent on Collection Reads | Mongotop-read time metric, total time spent on collection read operations. Unit: Milliseconds | ≥ 0 Milliseconds | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo052_top_write_time |
Total Time Spent on Collection Writes | Mongotop-write time metric, total time spent on collection write operations. Unit: Milliseconds | ≥ 0 Milliseconds | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo053_wt_flushes_status |
Number of Checkpoint Triggers per Cycle | Number of checkpoints triggered during a polling interval of WiredTiger, recorded as the number of occurrences during the cycle. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo054_wt_cache_used_percent |
Wiredtiger Cache Usage Percentage | Wiredtiger cache usage percentage. Unit: % | 0~100% | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo055_wt_cache_dirty_percent |
Wiredtiger Dirty Cache Percentage | Wiredtiger dirty cache percentage. Unit: % | 0~100% | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo070_rocks_active_memtable |
Data Size in Active Memtable | Collect the current data size in the active memtable. Unit: GB | 0~100 GB | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo071_rocks_oplogcf_active_memtable |
Data Size in Active Memtable on oplogcf | Collect the current data size in the active memtable on oplogcf. Unit: GB | 0~100GB | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo072_rocks_all_memtable |
Total Data Size in Memtable and Immutable-mem | Collect the current total data size in memtable and immutable-mem. Unit: GB | 0~100GB | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo073_rocks_oplogcf_all_memtable |
Total Data Size in Memtable and Immutable-mem on oplogcf | Collect the current total data size in memtable and immutable-mem on oplogcf. Unit: GB | 0~100GB | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo074_rocks_snapshots |
Number of Unreleased Snapshots | Collect the current number of unreleased snapshots. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo075_rocks_oplogcf_snapshots |
Number of Unreleased Snapshots on oplogcf | Collect the current number of unreleased snapshots on oplogcf. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo076_rocks_live_versions |
Number of Active Versions | Collect the current number of active versions. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo077_rocks_oplogcf_live_versions |
Number of Active Versions on oplogcf | Collect the current number of active versions on oplogcf. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo078_rocks_block_cache |
Data Size in Blockcache | Collect the current data size in blockcache. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo079_rocks_background_errors |
Number of Background Accumulated Errors | Collect the number of background accumulated errors. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo080_rocks_oplogcf_background_errors |
Number of Background Accumulated Errors on oplogcf | Collect the number of background accumulated errors on oplogcf. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo081_rocks_conflict_bytes_usage |
Transaction Write-Write Conflict Buffer Usage | Collect the transaction write-write conflict buffer usage. Unit: % | 0~100% | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo082_rocks_uncommitted_keys |
Number of Uncommitted Keys | Collect the current number of uncommitted keys. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo083_rocks_committed_keys |
Number of Committed Keys | Collect the current number of committed keys. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo084_rocks_alive_txn |
Length of Active Transaction List | Collect the length of the active transaction list Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo085_rocks_read_queue |
Length of Read Queue | Collect the current length of the read queue. Unit: Counts | ≥ 0 Counts | Document Database Instance Primary Node Document Database Instance Secondary Node | 1 minute |
mongo086_rocks_commit_queue |
Length of Commit Queue | Collect the current length of the commit queue. |