Skip to content

Volcengine MESSAGE QUEUES RocketMQ

Collecting RocketMQ MESSAGE QUEUES metrics data from Volcengine

Configuration¶

Installing Func¶

It is recommended to enable Guance Integration - Expansion - DataFlux Func (Automata): All prerequisites will be automatically installed. Please continue with the script installation.

If you deploy Func on your own, refer to Self-deployed Func

Installing Script¶

Note: Please prepare a Volcengine AK that meets the requirements in advance (for simplicity, you can directly grant global read-only permission ReadOnlyAccess)

To synchronize monitoring data for RocketMQ MESSAGE QUEUES resources, we install the corresponding collection script: 「Guance Integration (Volcengine-RocketMQ Collection)」(ID: guance_volcengine_rocketmq)

After clicking 【Install】, input the corresponding parameters: Volcengine AK, Volcengine account name, and Regions.

Click 【Deploy Startup Script】, and the system will automatically create a Startup script set and automatically configure the corresponding startup scripts.

Once enabled, you can see the corresponding automatic trigger configuration under 「Manage / Automatic Trigger Configuration」. Click 【Execute】 to run it immediately without waiting for the scheduled time. After a short wait, you can view the execution task records and corresponding logs.

Verification¶

In 「Manage / Automatic Trigger Configuration」, confirm whether the corresponding tasks have the corresponding automatic trigger configurations. You can also view the corresponding task records and logs to check for any abnormalities.
In Guance, 「Infrastructure - Resource Catalog」, check if asset information exists.
In Guance, 「Metrics」, check if there are corresponding monitoring data.

Metrics¶

Configure Volcengine MESSAGE QUEUES RocketMQ monitoring metrics, more metrics can be collected through configuration Volcengine MESSAGE QUEUES RocketMQ Metric Details

Volcengine MESSAGE QUEUES RocketMQ Monitoring Metrics¶

RocketMQ MESSAGE QUEUES metrics are located under the volcengine_VCM_RocketMQ metric set. Here, we introduce relevant metric descriptions.

`MetricName`	`Subnamespace`	Metric Name	MetricUnit	Dimension
`CapUtil`	`Instance`	Instance Disk Utilization	Percent	ResourceID
`ConsumerConnectionCount`	`Instance`	Consumer Connection Count	Count	ResourceID
`CpuUtil`	`Instance`	CPU Utilization	Percent	ResourceID
`InstanceBigMsgCount`	`Instance`	Large Message Count	Count	ResourceID
`InstanceConnectionRate`	`Instance`	Instance Connection Rate Utilization	Percent	ResourceID
`InstanceSendFailedMsgNum`	`Instance`	Failed Write Message Count	Count	ResourceID
`InstanceTPSUsedRatio`	`Instance`	Instance TPS Utilization	Percent	ResourceID
`InstanceTopicNum`	`Instance`	Topic Count	Count	ResourceID
`MaxDiskCapUtil`	`BalanceStatus`	Maximum Disk Utilization	Percent	ResourceID
`MemUtil`	`BalanceStatus`	Memory Utilization	Percent	ResourceID
`MinDiskCapUtil`	`BalanceStatus`	Minimum Disk Utilization	Percent	ResourceID
`MsgProductionRate`	`Instance`	Message Production Rate	Count/Second	ResourceID
`MsgPutLatencyP99`	`Instance`	Message Production P99 Latency	Millisecond	ResourceID
`MsgPutTime`	`Instance`	Average Message Production Time	Millisecond	ResourceID
`NodeMaxConnectionRate`	`BalanceStatus`	Node Maximum Connection Rate Utilization	Percent	ResourceID
`NodeMaxConsumeRate`	`BalanceStatus`	Node Maximum Consumption Rate	Count/Second	ResourceID
`NodeMaxProduceRate`	`BalanceStatus`	Node Maximum Production Rate	Count/Second	ResourceID
`NodeMaxQueueCount`	`BalanceStatus`	Node Maximum Queue Count	Count	ResourceID
`ProduceConnectionCount`	`BalanceStatus`	Producer Connection Count	Count	ResourceID
`QueueCountSkew`	`BalanceStatus`	Queue Count Skew Rate	Percent	ResourceID
`TopicProductionSizeRate`	`Topic`	Message Production Traffic Rate	Bytes/Second(IEC)	ResourceID

Objects¶

The structure of the collected Volcengine RocketMQ objects data can be viewed in 「Infrastructure - Resource Catalog」

  {
    "measurement": "volcengine_rocketmq",
    "tags": {
    "RegionId"        : "cn-beijing",
    "ComputeSpec"     : "rocketmq.n1.x2.micro",
    "ChargeDetail.ChargeType" : "PostPaid",
    "InstanceName"    : "test",
    "InstanceStatus"  : "Running",
    "SubnetId"        : "subnet-13fpvlahzboxsxxxxxxxxxx",
    "Version"         : "x.x.x",
    "StorageType"     : "300",
    "VpcId"           : "vpc-13fpvlahzboxsxxxxxxxxxx",
    "ZoneId"          : "cn-beijing-a",
    "EipId"           : "eip-2ze1j9xxxxxxxxxxxxxxxx",
    "ProjectName"     : "default",
    },
    "fileds": {
      "InstanceDescription": "cn-beijing-a",
      "AvailableQueueNumber": "333",
      "CreateTime": "2025-04-22T04:01:52Z",
      "FileReservedTime": "72",
      "StorageSpace": "300",
      "UsedGroupNumber": "0",
      "UsedTopicNumber": "0",
      "UsedStorageSpace": "1",
      "Tags": "[]"
    }
  }

Note: The fields in tags and fields may change with subsequent updates.