HUAWEI DCS
Collect Huawei Cloud DCS metric data.
Config¶
Install Func¶
Recommend opening 「Integrations - Extension - DataFlux Func (Automata)」: All preconditions are installed automatically, Please continue with the script installation
If you deploy Func yourself,Refer to Self-Deployment of Func
Installation script¶
Tip:Please prepare HUAWEI CLOUD AK that meets the requirements in advance(For simplicity's sake,,You can directly grant the global read-only permission
ReadOnlyAccess
)
To synchronize the monitoring data of HUAWEI CLOUD DCS cloud resources, we install the corresponding collection script:
- guance_huaweicloud_dcs: Collect Huawei Cloud DCS indicator data
- guance_huaweicloud_dcs_slowlog:Collect slow log data from Huawei Cloud DCS
Click 【Install】 and enter the corresponding parameters: HUAWEI CLOUD AK, HUAWEI CLOUD account name.
Tap【Deploy startup Script】, the system automatically creates Startup
script sets, and automatically configure the corresponding startup script.
After installing the script, find the script 「Guance Cloud Integration (Huawei Cloud DCS data collection)」/「Guance Cloud Integration (Huawei Cloud DCS slow logs collection)」 in the 「Development」 section of Func. Expand and modify the script, find collector_configs and monitor_configs, and edit the content in region_projects below. Change the region and Project ID to the actual region and Project ID, and then click save and publish.
In addition, in「Management / Automatic Trigger Configuration」 you can see the corresponding automatic trigger configuration. Click 【Execute】 to run it immediately, without waiting for the scheduled time. After a short moment, you can check the execution task records and corresponding logs.
Verify¶
- In「Management / Crontab Config」check whether the automatic triggering configuration exists for the corresponding task,In addition, you can view task records and logs to check whether exceptions exist
- On the Guance platform, click 「Infrastructure / Custom」 to check whether asset information exists
- On the Guance platform, press 「Metrics」 to check whether monitoring data exists
- On the Guance platform, check if there is corresponding log data in the 「logs」 section
Metric¶
Configure HUAWEI CLOUD DCS metric. You can collect more metrics by configuring them HUAWEI CLOUD DCS Metrics Details
Redis 3.0 Instance Monitoring Metrics¶
- DCS Redis 3.0 has been discontinued and is no longer available for purchase. We recommend using Redis 4.0 and above versions.
- For dimensions of the monitoring metrics, please refer to Dimensions.
Redis 4.0, Redis 5.0, and Redis 6.0 Instance Monitoring Metrics¶
- For the dimensions of monitoring metrics, please refer to Dimensions.
- Instance monitoring aggregates data from primary nodes.
- Some instance monitoring metrics are aggregated from both primary and secondary nodes. Please refer to "Meaning of Metrics" in Table 3.
Redis Server Metrics of DCS Redis Instances¶
-
For Proxy Cluster instances, the monitoring covers Redis Servers and proxies. For Redis Cluster DCS Redis 4.0/5.0/6.0 instances and master/standby instances, the monitoring only covers Redis Servers.
-
Dimensions lists the metric dimensions.
Proxy Metrics¶
Dimensions lists the metric dimensions.
Metric ID | Metric Name | Metric Description | Value Range | Monitored Object | Monitoring Period (Raw Data) |
---|---|---|---|---|---|
cpu_usage |
CPU Usage | The monitored object's maximum CPU usage among multiple sampling values in a monitoring periodUnit: % | 0–100% | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
memory_usage |
Memory Usage | Memory consumed by the monitored objectUnit: % | 0–100% | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
p_connected_clients |
Connected Clients | Number of connected clients | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
max_rxpck_per_sec |
Max. NIC Data Packet Receive Rate | Maximum number of data packets received by the proxy NIC per second during the monitoring periodUnit: packages/second | 0–10,000,000 | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
max_txpck_per_sec |
Max. NIC Data Packet Transmit Rate | Maximum number of data packets transmitted by the proxy NIC per second during the monitoring periodUnit: packages/second | 0–10,000,000 | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
max_rxkB_per_sec |
Maximum Inbound Bandwidth | Largest volume of data received by the proxy NIC per secondUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
max_txkB_per_sec |
Maximum Outbound Bandwidth | Largest volume of data transmitted by the proxy NIC per secondUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
avg_rxpck_per_sec |
Average NIC Data Packet Receive Rate | Average number of data packets received by the proxy NIC per second during the monitoring periodUnit: packages/second | 0–10,000,000 | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
avg_txpck_per_sec |
Average NIC Data Packet Transmit Rate | Average number of data packets transmitted by the proxy NIC per second during the monitoring periodUnit: packages/second | 0–10,000,000 | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
avg_rxkB_per_sec |
Average Inbound Bandwidth | Average volume of data received by the proxy NIC per secondUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
avg_txkB_per_sec |
Average Outbound Bandwidth | Average volume of data transmitted by the proxy NIC per secondUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 3.0 instance | 1 minute |
Metric ID | Metric Name | Metric Description | Value Range | Monitored Object | Monitoring Period (Raw Data) |
---|---|---|---|---|---|
node_status |
Proxy Status | Indication of whether the proxy is normal. | 0: Normal1: Abnormal | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
cpu_usage |
CPU Usage | The monitored object's maximum CPU usage among multiple sampling values in a monitoring periodUnit: % | 0–100% | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
memory_usage |
Memory Usage | Memory consumed by the monitored objectUnit: % | 0–100% | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
connected_clients |
Connected Clients | Number of connected clients | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
instantaneous_ops |
Ops per Second | Number of commands processed per second | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
instantaneous_input_kbps |
Input Flow | Instantaneous input trafficUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
instantaneous_output_kbps |
Output Flow | Instantaneous output trafficUnit: KB/s | ≥ 0 KB/s | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
total_net_input_bytes |
Network Input Bytes | Number of bytes received during the monitoring periodUnit: KB, MB, or byte (configurable on the console) | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
total_net_output_bytes |
Network Output Bytes | Number of bytes sent during the monitoring periodUnit: KB, MB, or byte (configurable on the console) | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
connections_usage |
Connection Usage | Percentage of the current number of connections to the maximum allowed number of connections Unit: % | 0–100% | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
command_max_rt |
Maximum Latency | Maximum delay from when the node receives commands to when it respondsUnit: us | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
command_avg_rt |
Average Latency | Average delay from when the node receives commands to when it respondsUnit: us | ≥ 0 | Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance | 1 minute |
DCS Memcached Instance Metrics¶
Dimensions lists the metric dimensions.
Dimensions¶
Key | Value |
---|---|
dcs_instance_id |
DCS Redis instance |
dcs_cluster_redis_node |
Redis Server |
dcs_cluster_proxy_node |
Proxy in a Proxy Cluster DCS Redis 3.0 instance |
dcs_cluster_proxy2_node |
Proxy in a Proxy Cluster DCS Redis 4.0 or 5.0 instance |
dcs_memcached_instance_id |
DCS Memcached instance |
Object¶
{
"measurement": "huaweicloud_redis",
"tags": {
"name" : "71be0037-xxxx-xxxx-xxxx-b6b91f134066",
"instance_id" : "71be0037-xxxx-xxxx-xxxx-b6b91f134066",
"instance_name" : "dcs-iash",
"RegionId" : "cn-north-4",
"project_id" : "c631f04625xxxxxxxxxxf253c62d48585",
"engine" : "Redis",
"engine_version" : "5.0",
"status" : "RUNNING",
"az_codes" : "[\"cn-north-4c\", \"cn-north-4a\"]",
"port" : "6379",
"ip" : "192.xxx.x.144",
"charging_mode" : "0",
"no_password_access": "true",
"enable_publicip" : "False"
},
"fields": {
"created_at" : "2022-07-12T07:29:56.875Z",
"max_memory" : 128,
"used_memory": 2,
"capacity" : 0,
"description": "",
"message" : "{Instance JSON data}"
}
}
Here is the translation of the provided field descriptions:
Field | Type | Description |
---|---|---|
ip |
String | IP address used to connect to the cache instance. If it is a cluster instance, multiple IP addresses are returned, separated by commas. For example: 192.168.0.1, 192.168.0.2. |
charging_mode |
String | Billing mode, where 0 indicates pay-as-you-go, and 1 indicates subscription. |
no_password_access |
String | Indicates whether no password is required to access the cache instance: true: the instance does not require a password for access. false: the instance requires password authentication for access. |
enable_publicip |
String | Specifies whether Redis cache instance allows public network access. True: enabled; False: not enabled. |
max_memory |
Integer | Total memory of the instance, measured in MB. |
used_memory |
Integer | Memory currently in use, measured in MB. |
capacity |
Integer | Cache capacity in GigaBytes (GB). |
status |
String | CREATING: The cache instance is being created and is not yet in the running state. CREATEFAILED: The cache instance creation has failed. RUNNING: The cache instance is in normal running state. RESTARTING: The cache instance is undergoing a restart operation. FROZEN: The cache instance is in a frozen state. Users can renew the frozen cache instance in "My Orders". EXTENDING: The cache instance is in the process of being extended. RESTORING: The cache instance is currently restoring data. FLUSHING: The cache instance is currently clearing data. |
Note: Fields
tags
andfields
might be subject to changes in future updates.Tip 1: The value of
tags.name
is the instance ID, which serves as the unique identifier.Tip 2: All the following fields are JSON serialized strings -
fields.message
-tags.az_codes