Huawei Cloud DCS (Redis)
Collect Huawei Cloud DCS Metrics data
Configuration¶
Install Func¶
It is recommended to activate Guance Integration - Extensions - DataFlux Func (Automata): all prerequisites are automatically installed, please proceed with the script installation.
If you deploy Func manually, refer to Manual Func Deployment
Install Script¶
Note: Please prepare the Huawei Cloud AK that meets the requirements in advance (for simplicity, you can directly grant the global read-only permission
Tenant Guest)
Automata Version Script Activation¶
- Log in to the Guance console.
- Click the [Integration] menu and select [Cloud Account Management].
- Click [Add Cloud Account], select [Huawei Cloud], and fill in the required information on the interface. If the cloud account information has been configured before, ignore this step.
- Click [Test], and after the test is successful, click [Save]. If the test fails, please check whether the relevant configuration information is correct and test again.
- Click [Cloud Account Management] to see the added cloud account in the list. Click the corresponding cloud account to enter the details page.
- Click the [Integration] button on the cloud account details page. In the
Not Installedlist, findHuawei Cloud DCSand click the [Install] button. A pop-up installation interface will appear for installation.
Manual Script Activation¶
-
Log in to the Func console, click [Script Market], enter the Guance script market, and search for
integration_huaweicloud_dcs: Huawei Cloud DCS Metrics Collection.integration_huaweicloud_dcs_slowlog: Huawei Cloud DCS Slow Log Collection. -
Click [Install], then enter the corresponding parameters: Huawei Cloud AK, SK, and account name.
-
Click [Deploy Startup Script], the system will automatically create the
Startupscript set and automatically configure the corresponding startup script. -
After enabling, you can see the corresponding automatic trigger configuration in "Management / Automatic Trigger Configuration". Click [Execute] to execute it immediately without waiting for the scheduled time. After a while, you can check the execution task records and corresponding logs.
Verification¶
- In "Management / Automatic Trigger Configuration", confirm whether the corresponding task has the corresponding automatic trigger configuration, and check the corresponding task records and logs to see if there are any exceptions.
- In Guance, check whether asset information exists in "Infrastructure - Resource Catalog".
- In Guance, check whether there is corresponding monitoring data in "Metrics".
- In Guance, check whether there is corresponding log data in "Logs".
Metrics¶
Configure Huawei Cloud DCS monitoring metrics. More metrics can be collected through configuration Huawei Cloud DCS Metrics Details
Redis 3.0 Instance Monitoring Metrics¶
- DCS Redis 3.0 has been discontinued and is no longer available for sale. It is recommended to use Redis 4.0 and above.
- For the dimensions of monitoring metrics, please refer to Dimensions.
Redis 4.0, Redis 5.0, and Redis 6.0 Instance Monitoring Metrics¶
- For the dimensions of monitoring metrics, please refer to Dimensions.
- Instance monitoring is the monitoring of data aggregated from the primary node.
- Some instance monitoring metrics are aggregated from both primary and slave nodes. Please refer to the description in "Metric Description" in Table 3.
Redis Instance Data Node Monitoring Metrics¶
- Redis primary-standby, read-write separation, and cluster instances support data node monitoring.
- For the dimensions of monitoring metrics, please refer to Dimensions.
Proxy Node Monitoring Metrics¶
- Proxy cluster and read-write separation instances support Proxy node monitoring metrics.
- For the dimensions of monitoring metrics, please refer to Dimensions.
| Metric ID | Metric Name | Metric Description | Value Range | Measurement Object | Monitoring Period (Original Metric) |
|---|---|---|---|---|---|
| cpu_usage | CPU Utilization | This metric samples the CPU usage of the measurement object multiple times within the statistical period, representing the highest value of multiple samples. Unit: %. | 0-100% | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| memory_usage | Memory Utilization | This metric is used to count the memory utilization of the measurement object. Unit: %. | 0-100% | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| p_connected_clients | Active Client Count | This metric is used to count the number of connected clients. | >=0 | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| max_rxpck_per_sec | Network Packet Receive Maximum Rate | This metric is used to count the maximum number of data packets received per second by the network card of the measurement object within the statistical period. Unit: packets/second | 0-10000000 packets/second | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| max_txpck_per_sec | Network Packet Send Maximum Rate | This metric is used to count the maximum number of data packets sent per second by the network card of the measurement object within the statistical period. Unit: packets/second | 0-10000000 packets/second | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| max_rxkB_per_sec | Network Input Maximum Bandwidth | This metric is used to count the maximum amount of data received per second by the network card of the measurement object. Unit: KB/s. | >= 0KB/s | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| max_txkB_per_sec | Network Output Maximum Bandwidth | This metric is used to count the maximum amount of data sent per second by the network card of the measurement object. Unit: KB/s. | >= 0KB/s | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| avg_rxpck_per_sec | Network Packet Receive Average Rate | This metric is used to count the average number of data packets received per second by the network card of the measurement object within the statistical period. Unit: packets/second | 0-10000000 packets/second | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| avg_txpck_per_sec | Network Packet Send Average Rate | This metric is used to count the average number of data packets sent per second by the network card of the measurement object within the statistical period. Unit: packets/second | 0-10000000 packets/second | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| avg_rxkB_per_sec | Network Input Average Bandwidth | This metric is used to count the average amount of data received per second by the network card of the measurement object. Unit: KB/s. | >= 0KB/s | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| avg_txkB_per_sec | Network Output Average Bandwidth | This metric is used to count the average amount of data sent per second by the network card of the measurement object. Unit: KB/s. | >= 0KB/s | Redis 3.0 Proxy Cluster Instance Proxy Node | 1 minute |
| Metric ID | Metric Name | Metric Description | Value Range | Measurement Object | Monitoring Period (Original Metric) |
|---|---|---|---|---|---|
node_status |
Instance Node Status | This metric is used to display whether the Proxy node status is normal. | 0: Indicates normal. 1: Indicates abnormal. | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
cpu_usage |
CPU Utilization | This metric samples the CPU usage of the measurement object multiple times within the statistical period, representing the highest value of multiple samples. Unit: %. | 0-100% | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
cpu_avg_usage |
CPU Average Utilization | This metric samples the CPU usage of the measurement object multiple times within the statistical period, representing the average value of multiple samples. Unit: %. | 0-100% | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
memory_usage |
Memory Utilization | This metric is used to count the memory utilization of the measurement object. Unit: %. | 0-100% | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
connected_clients |
Active Client Count | This metric is used to count the number of connected clients, including system monitoring, configuration synchronization, and business-related connections, excluding connections from slave nodes. | >=0 | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
instantaneous_ops |
Instantaneous Operations Per Second | This metric is used to count the number of commands processed per second. | >=0 | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
instantaneous_input_kbps |
Instantaneous Network Input Traffic | This metric is used to count the instantaneous input traffic. Unit: KB/s. | >=0KB/s | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
instantaneous_output_kbps |
Instantaneous Network Output Traffic | This metric is used to count the instantaneous output traffic. Unit: KB/s. | >=0KB/s | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
total_net_input_bytes |
Network Received Bytes | This metric is used to count the number of bytes received within the statistical period. Unit: Can be selected in the console, such as KB, MB, byte, etc. | >=0 | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
total_net_output_bytes |
Network Sent Bytes | This metric is used to count the number of bytes sent within the statistical period. Unit: Can be selected in the console, such as KB, MB, byte, etc. | >=0 | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
connections_usage |
Connection Utilization | This metric is used to count the percentage of current connections to the maximum connection limit. Unit: %. | 0-100% | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
command_max_rt |
Maximum Latency | This metric is used to count the maximum latency from receiving a command to sending a response. Unit: us. | >=0us | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
command_avg_rt |
Average Latency | This metric is used to count the average latency from receiving a command to sending a response. Unit: us. | >=0us | Proxy Cluster, Read-write Separation Instance Proxy Node | 1 minute |
Memcached Instance Monitoring Metrics¶
For the dimensions of monitoring metrics, please refer to Dimensions.
Object¶
The collected Huawei Cloud DCS object data structure can be seen in "Infrastructure - Resource Catalog".
{
"measurement": "huaweicloud_redis",
"tags": {
"RegionId" : "cn-north-4",
"project_id" : "c631f04625xxxxxxxxxxf253c62d48585",
"enterprise_project_id" : "71be0037-xxxx-xxxx-xxxx-b6b91f134066",
"instance_id" : "71be0037-xxxx-xxxx-xxxx-b6b91f134066",
"instance_name" : "dcs-iash",
"engine" : "Redis",
},
"fields": {
"engine_version" : "5.0",
"status" : "RUNNING",
"port" : "6379",
"ip" : "192.xxx.x.144",
"charging_mode" : "0",
"enable_publicip" : "False",
"spec_code" : "xxxx",
"az_codes" : "xxxxx",
"created_at" : "2022-07-12T07:29:56.875Z",
"max_memory" : "128",
"used_memory" : "2",
"capacity" : "0",
"description" : "",
}
}
Partial field descriptions are as follows:
| Field | Type | Description |
|---|---|---|
ip |
String | The IP address to connect to the cache instance. If it is a cluster instance, multiple IP addresses are returned, separated by commas. For example: 192.168.0.1, 192.168.0.2. |
charging_mode |
String | Billing mode, 0 indicates pay-as-you-go, 1 indicates subscription. |
no_password_access |
String | Whether to allow password-free access to the cache instance: true: The instance can be accessed without a password. false: The instance must be authenticated with a password to access. |
enable_publicip |
String | Whether the Redis cache instance has public network access enabled. True: Enabled. False: Not enabled. |
max_memory |
Integer | Total memory, unit: MB. |
used_memory |
Integer | Used memory, unit: MB. |
capacity |
Integer | Cache capacity (G Byte). |
status |
String | CREATING : The state after applying for a cache instance and before the cache instance state enters the running state. CREATEFAILED: The cache instance is in the creation failed state. RUNNING: The cache instance is in the normal running state. RESTARTING: The cache instance is performing a restart operation. FROZEN: The cache instance is in the frozen state, and users can renew the frozen cache instance in "My Orders". EXTENDING: The cache instance is in the expanding state. RESTORING: The cache instance is in the data recovery state. FLUSHING: The cache instance is in the data clearing state. |
Note: The fields in
tagsandfieldsmay change with subsequent updates.Tip 1: The value of
tags.instance_idis the instance ID, which is used as a unique identifier.Tip 2: The following fields are JSON serialized strings -
fields.message-tags.az_codes
