Skip to content

Huawei Cloud DMS RocketMQ

Collect Huawei Cloud DMS RocketMQ Metrics

Configuration

Install Func

It is recommended to activate the Guance Integration - Extensions - DataFlux Func (Automata): all prerequisites are automatically installed. Please proceed with the script installation.

If you are deploying Func yourself, refer to Self-deploying Func

Install Script

Note: Please prepare the Huawei Cloud AK that meets the requirements in advance (for simplicity, you can directly grant the global read-only permission Tenant Guest)

Automata Installation Script

  1. Log in to the Guance console.
  2. Click the [Integration] menu and select [Cloud Account Management].
  3. Click [Add Cloud Account], select [Huawei Cloud], and fill in the required information on the interface. If you have already configured the cloud account information, ignore this step.
  4. Click [Test]. After the test is successful, click [Save]. If the test fails, please check if the relevant configuration information is correct and retest.
  5. Click [Cloud Account Management]. You can see the added cloud account in the list. Click the corresponding cloud account to enter the details page.
  6. Click the [Integration] button on the cloud account details page. Under the Not Installed list, find Huawei Cloud DMS RocketMQ and click the [Install] button. The installation interface will pop up for installation.

Manual Installation Script

  1. Log in to the Func console, click [Script Market], and enter the Guance script market. Search for integration_huaweicloud_rocketmq.

  2. Click [Install] and enter the corresponding parameters: Huawei Cloud AK, SK, and account name.

  3. Click [Deploy Startup Script]. The system will automatically create the Startup script set and configure the corresponding startup script.

  4. After enabling, you can see the corresponding automatic trigger configuration in "Manage / Automatic Trigger Configuration". Click [Execute] to execute it immediately without waiting for the scheduled time. Wait a moment, and you can view the execution task records and corresponding logs.

Verification

  1. In "Manage / Automatic Trigger Configuration", confirm whether the corresponding task has the automatic trigger configuration. You can also check the corresponding task records and logs for any exceptions.
  2. In Guance, check if asset information exists in "Infrastructure - Resource Catalog".
  3. In Guance, check if there are corresponding monitoring data in "Metrics".

Metrics

Configure Huawei Cloud DMS RocketMQ Metrics. You can collect more metrics by configuration Huawei Cloud DMS RocketMQ Metrics Details

Metric ID Metric Name Metric Description Value Range Measurement Object Monitoring Period (Original Metric)
instance_produce_msg Message Production Count The number of messages received by the instance in one minute. Unit: Count >0 RocketMQ Instance 1 minute
instance_consume_msg Message Consumption Count The number of messages consumed by the instance in one minute. Unit: Count >0 RocketMQ Instance 1 minute
current_topics Topic Count The number of topics in the instance. Unit: CountimgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance 1 minute
current_queues Queue Count The number of queues in the instance. Unit: CountimgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance 1 minute
instance_accumulation Accumulated Message Count The sum of accumulated messages for all consumer groups in the instance. Unit: CountimgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance 1 minute
broker_produce_msg Message Production Count The number of messages received by the node in one minute. Unit: Count >0 RocketMQ Instance Node 1 minute
broker_consume_msg Message Consumption Count The number of messages consumed by the node in one minute. Unit: Count >0 RocketMQ Instance Node 1 minute
broker_produce_rate Message Production Rate The number of messages received by the node per second. Unit: Count/s >0 RocketMQ Instance Node 1 minute
broker_consume_rate Message Consumption Rate The number of messages consumed by the node per second. Unit: Count/s >0 RocketMQ Instance Node 1 minute
broker_total_bytes_in_rate Network Inbound Traffic The inbound network traffic of the node per second. Unit: Byte/s >0 RocketMQ Instance Node 1 minute
broker_total_bytes_out_rate Network Outbound Traffic The outbound network traffic of the node per second. Unit: Byte/s >0 RocketMQ Instance Node 1 minute
broker_cpu_core_load CPU Core Load This metric is used to count the average load of each CPU core of the node virtual machine. >0 RocketMQ Instance Node 1 minute
broker_disk_usage Disk Capacity Usage This metric is used to count the disk capacity usage of the node virtual machine. Unit: % 0~100 RocketMQ Instance Node 1 minute
broker_memory_usage Memory Usage This metric is used to count the memory usage of the node virtual machine. Unit: % 0~100 RocketMQ Instance Node 1 minute
broker_alive Node Alive Status Node alive statusimgNote: Instances purchased on or after May 16, 2022 support this monitoring item. 1: Alive0: Offline RocketMQ Instance Node 1 minute
broker_connections Connection Count The number of connections used by the virtual machine. Unit: CountimgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Node 1 minute
broker_cpu_usage CPU Usage The CPU usage of the virtual machine. Unit: %imgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Node 1 minute
broker_disk_read_rate Disk Read Traffic Disk read operation traffic. Unit: Byte/simgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Node 1 minute
broker_disk_write_rate Disk Write Traffic Disk write operation traffic. Unit: Byte/simgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Node 1 minute
topic_produce_msg Message Production Count The number of messages received by the Topic in one minute. Unit: Count >0 RocketMQ Instance Queue 1 minute
topic_consume_msg Message Consumption Count The number of messages consumed by the Topic in one minute. Unit: Count >0 RocketMQ Instance Queue 1 minute
topic_produce_rate Message Production Rate The number of messages received by the Topic per second. Unit: Count/s >0 RocketMQ Instance Queue 1 minute
topic_consume_rate Message Consumption Rate The number of messages consumed by the Topic per second. Unit: Count/s >0 RocketMQ Instance Queue 1 minute
topic_bytes_in_rate Production Traffic The production traffic of the current topic. Unit: Byte/simgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Queue 1 minute
topic_bytes_out_rate Consumption Traffic The consumption traffic of the current topic. Unit: Byte/simgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Queue 1 minute

Object

After the data is synchronized normally, you can view the data in Guance's "Infrastructure - Resource Catalog".

{
  "measurement": "huaweicloud_rocketmq",
  "tags": {      
    "RegionId"              : "cn-north-4",
    "project_id"            : "756ada1aa17e4049b2a16ea41912e52d",
    "enterprise_project_id" : "o78hhbss-xxxx-xxxx-xxxx-cba3d38cf2f9",
    "instance_id"           : "c0b0ea90-xxxx-xxxx-xxxx-cba3d38cf2f9",
    "instance_name"         : "rocketmq-xxxxx",
    "engine"                : "reliability",
    "status"                : "RUNNING"  
  },
  "fields": {
    "charging_mode"      : "1",
    "type"               : "cluster.small",
    "engine_version"     : "4.8.0",
    "description"        : "",
    "specification"      : "rocketmq.4u8g.cluster.small * 1 broker",
    "storage_space"      : 250,
    "used_storage_space" : 0,
    "resource_spec_code" : "xxxx",
    "created_at"         : "1687158517888",
    "maintain_begin"     : "02:00:00",
    "maintain_end"       : "06:00:00",
    "enable_publicip"    : false,
    "publicip_address"   : "12.xx.xx.32",
    "publicip_id"        : "xxxxxxxxxxxxxxxxxxxss",
    "total_storage_space": 300,
    "available_zones"    : "xxxxxx"
  }
}

Partial field descriptions are as follows:

Field Type Description
specification String Instance specification.
charging_mode String Billing mode, 1 indicates pay-as-you-go, 0 indicates subscription.
created_at String Creation completion time. Format is a timestamp, which refers to the total milliseconds from Greenwich Mean Time 1970-01-01 00:00:00 to the specified time.
resource_spec_code String Resource specification
maintain_begin String Maintenance window start time, format is HH🇲🇲ss
maintain_end String Maintenance window end time, format is HH🇲🇲ss

Note: The fields in tags and fields may change with subsequent updates.

Note 1: The value of tags.instance_id is the instance ID, used as a unique identifier.

Feedback

Is this page helpful? ×