Huawei Cloud DCS
Collect Huawei Cloud DCS Metrics data
Configuration¶
Install Func¶
It is recommended to enable the Guance integration - extension - hosted Func: all prerequisites are automatically installed. Please continue with the script installation.
If you deploy Func on your own, refer to Self-deployed Func
Install Script¶
Note: Please prepare a qualified Huawei Cloud AK in advance (for simplicity, you can directly grant global read-only permission
ReadOnlyAccess
)
To synchronize Huawei Cloud DCS monitoring data, we install the corresponding collection script:
- guance_huaweicloud_dcs: Collect Huawei Cloud DCS Metrics data
- guance_huaweicloud_dcs_slowlog: Collect Huawei Cloud DCS slow log data
After clicking 【Install】, input the corresponding parameters: Huawei Cloud AK and Huawei Cloud account name.
Click 【Deploy Startup Script】, and the system will automatically create a Startup
script set and configure the corresponding startup script automatically.
Once the script is installed, find the script "Guance Integration (Huawei Cloud - DCS Collection)" / "Guance Integration (Huawei Cloud - DCS Slow Query Log Collection)" under "Development" in Func, unfold and modify the script. Find and edit the contents of collector_configs
and monitor_configs
under region_projects
, changing the region and Project ID to the actual region and Project ID, then click Save and Publish.
In addition, you can see the corresponding automatic trigger configuration under "Management / Automatic Trigger Configuration". Click 【Execute】 to run it immediately without waiting for the scheduled time. After a short wait, you can view the execution task records and corresponding logs.
Verification¶
- Under "Management / Automatic Trigger Configuration", confirm whether the corresponding tasks have the corresponding automatic trigger configurations. You can also check the corresponding task records and logs for any anomalies.
- On the Guance platform, under "Infrastructure - Resource Catalog", check if there is any asset information.
- On the Guance platform, under "Metrics", check if there is any corresponding monitoring data.
- On the Guance platform, under "Logs", check if there is any corresponding log data.
Metrics¶
Configure Huawei Cloud DCS monitoring metrics, which can collect more metrics through configuration Huawei Cloud DCS Metrics Details
Redis 3.0 Instance Monitoring Metrics¶
- DCS Redis 3.0 has been discontinued and is no longer available for purchase. It is recommended to use Redis 4.0 or higher versions.
- For the dimensions of the monitoring metrics, please refer to Dimensions.
Redis 4.0, Redis 5.0, and Redis 6.0 Instance Monitoring Metrics¶
Redis Server Metrics of DCS Redis Instances¶
-
For Proxy Cluster instances, the monitoring covers Redis Servers and proxies. For Redis Cluster DCS Redis 4.0/5.0/6.0 instances and master/standby instances, the monitoring only covers Redis Servers.
-
Dimensions lists the metric dimensions.
Proxy Metrics¶
Dimensions lists the metric dimensions.
Metric ID | Metric Name | Metric Description | Value Range | Monitored Object | Monitoring Period (Raw Data) |
---|---|---|---|---|---|
cpu_usage |
CPU Usage | The monitored object's maximum CPU usage among multiple sampling values in a monitoring periodUnit: % | 0–100% | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
memory_usage |
Memory Usage | Memory consumed by the monitored objectUnit: % | 0–100% | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
p_connected_clients |
Connected Clients | Number of connected clients | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
max_rxpck_per_sec |
Max. NIC Data Packet Receive Rate | Maximum number of data packets received by the proxy NIC per second during the monitoring periodUnit: packages/second | 0–10,000,000 | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
max_txpck_per_sec |
Max. NIC Data Packet Transmit Rate | Maximum number of data packets transmitted by the proxy NIC per second during the monitoring periodUnit: packages/second | 0–10,000,000 | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
max_rxkB_per_sec |
Maximum Inbound Bandwidth | Largest volume of data received by the proxy NIC per secondUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
max_txkB_per_sec |
Maximum Outbound Bandwidth | Largest volume of data transmitted by the proxy NIC per secondUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
avg_rxpck_per_sec |
Average NIC Data Packet Receive Rate | Average number of data packets received by the proxy NIC per second during the monitoring periodUnit: packages/second | 0–10,000,000 | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
avg_txpck_per_sec |
Average NIC Data Packet Transmit Rate | Average number of data packets transmitted by the proxy NIC per second during the monitoring periodUnit: packages/second | 0–10,000,000 | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
avg_rxkB_per_sec |
Average Inbound Bandwidth | Average volume of data received by the proxy NIC per secondUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
avg_txkB_per_sec |
Average Outbound Bandwidth | Average volume of data transmitted by the proxy NIC per secondUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
Metric ID | Metric Name | Metric Description | Value Range | Monitored Object | Monitoring Period (Raw Data) |
---|---|---|---|---|---|
node_status |
Proxy Status | Indication of whether the proxy is normal. | 0: Normal1: Abnormal | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
cpu_usage |
CPU Usage | The monitored object's maximum CPU usage among multiple sampling values in a monitoring periodUnit: % | 0–100% | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
memory_usage |
Memory Usage | Memory consumed by the monitored objectUnit: % | 0–100% | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
connected_clients |
Connected Clients | Number of connected clients | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
instantaneous_ops |
Ops per Second | Number of commands processed per second | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
instantaneous_input_kbps |
Input Flow | Instantaneous input trafficUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
instantaneous_output_kbps |
Output Flow | Instantaneous output trafficUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
total_net_input_bytes |
Network Input Bytes | Number of bytes received during the monitoring periodUnit: KB, MB, or byte (configurable on the console) | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
total_net_output_bytes |
Network Output Bytes | Number of bytes sent during the monitoring periodUnit: KB, MB, or byte (configurable on the console) | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
connections_usage |
Connection Usage | Percentage of the current number of connections to the maximum allowed number of connections Unit: % | 0–100% | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
command_max_rt |
Maximum Latency | Maximum delay from when the node receives commands to when it respondsUnit: us | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
command_avg_rt |
Average Latency | Average delay from when the node receives commands to when it respondsUnit: us | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
DCS Memcached Instance Metrics¶
Dimensions lists the metric dimensions.
Dimensions¶
Key | Value |
---|---|
dcs_instance_id |
DCS Redis instance |
dcs_cluster_redis_node |
Redis Server |
dcs_cluster_proxy_node |
Proxy in a Proxy Cluster DCS Redis 3.0 instance |
dcs_cluster_proxy2_node |
Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance |
dcs_memcached_instance_id |
DCS Memcached instance |
Object¶
The collected Huawei Cloud DCS object data structure can be viewed in the 「Infrastructure - Resource Catalog」 for object data.
{
"measurement": "huaweicloud_redis",
"tags": {
"RegionId" : "cn-north-4",
"project_id" : "c631f04625xxxxxxxxxxf253c62d48585",
"enterprise_project_id" : "71be0037-xxxx-xxxx-xxxx-b6b91f134066",
"instance_id" : "71be0037-xxxx-xxxx-xxxx-b6b91f134066",
"instance_name" : "dcs-iash",
"engine" : "Redis",
},
"fields": {
"engine_version" : "5.0",
"status" : "RUNNING",
"port" : "6379",
"ip" : "192.xxx.x.144",
"charging_mode" : "0",
"enable_publicip" : "False",
"spec_code" : "xxxx",
"az_codes" : "xxxxx",
"created_at" : "2022-07-12T07:29:56.875Z",
"max_memory" : "128",
"used_memory" : "2",
"capacity" : "0",
"description" : "",
}
}
Some field descriptions are as follows:
Field | Type | Description |
---|---|---|
ip |
String | The IP address for connecting to the cache instance. If it's a cluster instance, it returns multiple IP addresses separated by commas. For example: 192.168.0.1, 192.168.0.2. |
charging_mode |
String | Billing mode, 0 means pay-as-you-go, 1 means annual/monthly subscription billing. |
no_password_access |
String | Whether password-free access to the cache instance is allowed: true: this instance can be accessed without a password. false: this instance must be authenticated with a password to access. |
enable_publicip |
String | Whether the Redis cache instance has public network access enabled True: enabled False: not enabled |
max_memory |
Integer | Total memory, unit: MB. |
used_memory |
Integer | Used memory, unit: MB. |
capacity |
Integer | Cache capacity (G Byte). |
status |
String | CREATING: After applying for a cache instance, before the cache instance enters the running state. CREATEFAILED: The cache instance is in a creation failure state. RUNNING: The cache instance is in a normal operating state. RESTARTING: The cache instance is undergoing a restart operation. FROZEN: The cache instance is in a frozen state, and users can renew the frozen cache instance in "My Orders". EXTENDING: The cache instance is in an expansion state. RESTORING: The cache instance data recovery state. FLUSHING: The cache instance data clearing state. |
Note: Fields in
tags
andfields
may change after subsequent updates.Tip 1: The value of
tags.instance_id
is the instance ID, which serves as a unique identifier.Tip 2: The following fields are JSON serialized string -
fields.message
-tags.az_codes