Skip to content

Alibaba Cloud RocketMQ5

The displayed metrics of Alibaba Cloud RocketMQ 5.0 include message throughput, latency, reliability, and horizontal scalability.

Configuration

Install Func

It is recommended to activate the Guance integration - extension - hosted Func.

If you deploy Func by yourself, refer to Self-deployed Func

Activation Script

Note: Please prepare an Alibaba Cloud AK in advance that meets the requirements (for simplicity, you can directly grant global read-only permissions ReadOnlyAccess).

Hosted Activation Script

  1. Log in to the Guance console.
  2. Click on the 【Integration】 menu and select 【Cloud Account Management】.
  3. Click 【Add Cloud Account】, choose 【Alibaba Cloud】, and fill in the required information on the interface. If you have already configured cloud account information before, ignore this step.
  4. Click 【Test】. After a successful test, click 【Save】. If the test fails, check whether the relevant configuration information is correct and retest.
  5. In the 【Cloud Account Management】 list, you can see the added cloud accounts. Click on the corresponding cloud account to enter the details page.
  6. Click the 【Integration】 button on the cloud account details page. Under the Not Installed list, find Alibaba Cloud RocketMQ5, click the 【Install】 button, and follow the installation interface to complete the installation.

Manual Activation Script

  1. Log in to the Func console, click 【Script Market】, enter the official script market, and search for guance_aliyun_rocketmq5.

  2. After clicking 【Install】, input the corresponding parameters: Alibaba Cloud AK ID, AK Secret, and account name.

  3. Click 【Deploy Startup Script】, and the system will automatically create a Startup script set and configure the corresponding startup script automatically.

  4. After enabling, you can see the corresponding automatic trigger configuration under "Management / Automatic Trigger Configuration". Click 【Execute】 to immediately execute once without waiting for the scheduled time. Wait a moment, then you can view the execution task records and corresponding logs.

We collect some configurations by default; for more details, see the Metrics section.

Configure custom cloud object metrics

We collect some configurations by default; for more details, see the Metrics section.

Metrics

After configuring Alibaba Cloud - Cloud Monitoring, the default metric sets are as follows. You can collect more metrics through configuration. Alibaba Cloud Cloud Monitoring Metric Details

MetricName MetricCategory MetricDescribe Dimensions Statistics Unit MinPeriods
ConsumerLag rocketmq Message backlog quantity (Group) userId,instanceId,groupId Sum count 60 s
ConsumerLagLatencyPerGid rocketmq Message processing delay time (GroupId) userId,instanceId,groupId Maximum milliseconds 60 s
ConsumerLagLatencyPerGidTopic rocketmq Message processing delay time (GroupId&Topic) userId,instanceId,topic,groupId Maximum milliseconds 60 s
ConsumerLagPerGidTopic rocketmq Message backlog quantity (Group&Topic) userId,instanceId,groupId,topic Sum count 60 s
InstanceApiCallTps rocketmq Instance API call frequency (Instance) userId,instanceId Sum countSecond 60 s
InstanceInternetFlowoutBandwidth rocketmq Public network downlink bandwidth for 5.0 series instances userId,instanceId Sum bytes/Second 60 s
InstanceReceiveApiCallTps rocketmq Consumption API call TPS peak for 5.0 series instances userId,instanceId Maximum countSecond 60 s
InstanceSendApiCallTps rocketmq Sending API call TPS peak for 5.0 series instances userId,instanceId Maximum countSecond 60 s
InstanceStorageSize rocketmq Storage size for 5.0 series instances userId,instanceId Sum Bytes 60 s
ReadyMessageQueueTime rocketmq Ready message queueing time (Group) userId,instanceId,groupId Maximum milliseconds 60 s
ReadyMessageQueueTimePerGidTopic rocketmq Ready message queueing time (Group&Topic) userId,instanceId,groupId,topic Maximum milliseconds 60 s
ReadyMessages rocketmq Ready messages quantity (Group) userId,instanceId,groupId Sum count 60 s
ReadyMessagesPerGidTopic rocketmq Ready messages quantity (Group&Topic) userId,instanceId,groupId,topic Sum count 60 s
ReceiveMessageCountPerGid rocketmq Number of messages received per minute by consumers (Group) userId,instanceId,groupId Sum count/min 60 s
ReceiveMessageCountPerGidTopic rocketmq Number of messages received per minute by consumers (Group&Topic) userId,instanceId,topic,groupId Sum count/min 60 s
ReceiveMessageCountPerInstance rocketmq Number of messages received per minute by consumers (Instance) userId,instanceId Sum count/min 60 s
ReceiveMessageCountPerTopic rocketmq Number of messages received per minute by consumers (Topic) userId,instanceId,topic Sum count/min 60 s
SendDLQMessageCountPerGid rocketmq Number of dead-letter messages generated per minute (Group) userId,instanceId,groupId Sum count/min 60 s
SendDLQMessageCountPerGidTopic rocketmq Number of dead-letter messages generated per minute (Group&Topic) userId,instanceId,groupId,topic Sum count/min 60 s
SendMessageCountPerInstance rocketmq Number of messages sent per minute by producers (Instance) userId,instanceId Sum count/min 60 s
SendMessageCountPerTopic rocketmq Number of messages sent per minute by producers (Topic) userId,instanceId,topic Sum count/min 60 s
ThrottledReceiveRequestsPerGid rocketmq Number of throttled consumption requests per minute (GroupId) userId,instanceId,groupId Sum counts/min 60 s
ThrottledReceiveRequestsPerGidTopic rocketmq Number of throttled consumption requests per minute (GroupId&Topic) userId,instanceId,topic,groupId Sum counts/min 60 s
ThrottledReceiveRequestsPerInstance rocketmq Number of throttled consumption requests per minute (Instance) userId,instanceId Sum counts/min 60 s
ThrottledSendRequestsPerInstance rocketmq Number of throttled sending requests per minute (Instance) userId,instanceId Sum counts/min 60 s
ThrottledSendRequestsPerTopic rocketmq Number of throttled sending requests per minute (Topic) userId,instanceId,topic Sum counts/min 60 s

Objects

The collected data structure of Alibaba Cloud RocketMQ5 objects can be seen from the "Infrastructure - Custom" section.

{
  "serviceCode": "rmq",
  "__namespace": "custom_object",
  "createTime": "2023-08-21 10:54:25",
  "expireTime": "2123-08-22 00:00:00",
  "time": 1692600804692,
  "topicCount": "1",
  "userId": "1067807587588864",
  "__docid": "CO_d3bed3ab447566645796455f37fcb66c",
  "message": "{\"accountInfo\": {\"username\": \"If02i2f3f4nYtUsA\"}, \"aclInfo\": {\"aclType\": \"default\"}, \"bid\": \"26842\", \"commodityCode\": \"ons_rmqpost_public_cn\", \"createTime\": \"2023-08-21 10:54:25\", \"expireTime\": \"2123-08-22 00:00:00\", \"extConfig\": {\"aclType\": \"default\", \"autoScaling\": false, \"flowOutBandwidth\": 1, \"flowOutType\": \"payByBandwidth\", \"internetSpec\": \"enable\", \"messageRetentionTime\": 72, \"msgProcessSpec\": \"rmq.s1.micro\", \"sendReceiveRatio\": 0.5, \"supportAutoScaling\": false}, \"groupCount\": 1, \"instanceId\": \"rmq-cn-wwo3cwoyn0b\", \"instanceName\": \"rmq-cn-wwo3cwoyn0b\", \"instanceQuotas\": [{\"quotaName\": \"MAX_TPS\", \"totalCount\": 500}, {\"quotaName\": \"SCALING_TPS_MAX\", \"totalCount\": 0}, {\"quotaName\": \"STORAGE_SIZE\", \"usedCount\": 0.109}, {\"quotaName\": \"TOPIC_COUNT\", \"totalCount\": 100, \"usedCount\": 1}, {\"quotaName\": \"CONSUMER_GROUP_COUNT\", \"totalCount\": 1000, \"usedCount\": 1}], \"networkInfo\": {\"endpoints\": [{\"endpointType\": \"TCP_VPC\", \"endpointUrl\": \"rmq-cn-wwo3cwoyn0b-vpc.cn-hangzhou.rmq.aliyuncs.com:8080\"}, {\"endpointType\": \"TCP_INTERNET\", \"endpointUrl\": \"rmq-cn-wwo3cwoyn0b.cn-hangzhou.rmq.aliyuncs.com:8080\"}], \"internetInfo\": {\"flowOutBandwidth\": 1, \"flowOutType\": \"payByBandwidth\", \"internetSpec\": \"enable\"}, \"vpcInfo\": {\"vSwitchId\": \"vsw-bp1qzepqz845moheet831\", \"vpcId\": \"vpc-bp1pftfpllxna4t75e73v\"}}, \"paymentType\": \"PayAsYouGo\", \"productInfo\": {\"autoScaling\": false, \"messageRetentionTime\": 72, \"msgProcessSpec\": \"rmq.s1.micro\", \"sendReceiveRatio\": 0.5, \"supportAutoScaling\": false}, \"regionId\": \"cn-hangzhou\", \"releaseTime\": \"2123-08-29 00:00:00\", \"resourceGroupId\": \"rg-acfmv3ro3xnfwaa\", \"seriesCode\": \"standard\", \"serviceCode\": \"rmq\", \"software\": {\"maintainTime\": \"02:00-06:00\", \"softwareVersion\": \"5.0-rmq-20230818-2\"}, \"startTime\": \"2023-08-21 10:54:24\", \"status\": \"RUNNING\", \"subSeriesCode\": \"single_node\", \"tags\": [{\"key\": \"acs:rm:rgId\", \"value\": \"rg-acfmv3ro3xnfwaa\"}], \"topicCount\": 1, \"updateTime\": \"2023-08-21 10:57:31\", \"userId\": \"1067807587588864\"}",
  "paymentType": "PayAsYouGo",
  "regionId": "cn-hangzhou",
  "startTime": "2023-08-21 10:54:24",
  "accountInfo": "{\"username\": \"If02i2f3f4nYtUsA\"}",
  "class": "aliyun_rocketmq",
  "instanceQuotas": "[{\"quotaName\": \"MAX_TPS\", \"totalCount\": 500}, {\"quotaName\": \"SCALING_TPS_MAX\", \"totalCount\": 0}, {\"quotaName\": \"STORAGE_SIZE\", \"usedCount\": 0.109}, {\"quotaName\": \"TOPIC_COUNT\", \"totalCount\": 100, \"usedCount\": 1}, {\"quotaName\": \"CONSUMER_GROUP_COUNT\", \"totalCount\": 1000, \"usedCount\": 1}]",
  "releaseTime": "2123-08-29 00:00:00",
  "create_time": 1692600804719,
  "groupCount": "1",
  "networkInfo": "{\"endpoints\": [{\"endpointType\": \"TCP_VPC\", \"endpointUrl\": \"rmq-cn-wwo3cwoyn0b-vpc.cn-hangzhou.rmq.aliyuncs.com:8080\"}, {\"endpointType\": \"TCP_INTERNET\", \"endpointUrl\": \"rmq-cn-wwo3cwoyn0b.cn-hangzhou.rmq.aliyuncs.com:8080\"}], \"internetInfo\": {\"flowOutBandwidth\": 1, \"flowOutType\": \"payByBandwidth\", \"internetSpec\": \"enable\"}, \"vpcInfo\": {\"vSwitchId\": \"vsw-bp1qzepqz845moheet831\", \"vpcId\": \"vpc-bp1pftfpllxna4t75e73v\"}}",
  "instanceName": "rmq-cn-wwo3cwoyn0b",
  "resourceGroupId": "rg-acfmv3ro3xnfwaa",
  "commodityCode": "ons_rmqpost_public_cn",
  "seriesCode": "standard",
  "subSeriesCode": "single_node",
  "status": "RUNNING",
  "updateTime": "2023-08-21 10:57:31",
  "account_name": "guance",
  "bid": "26842",
  "date": 1692600804000,
  "name": "rmq-cn-wwo3cwoyn0b",
  "cloud_provider": "aliyun",
  "date_ns": 0,
  "instanceId": "rmq-cn-wwo3cwoyn0b",
  "productInfo": "{\"autoScaling\": false, \"messageRetentionTime\": 72, \"msgProcessSpec\": \"rmq.s1.micro\", \"sendReceiveRatio\": 0.5, \"supportAutoScaling\": false}"
}

Feedback

Is this page helpful? ×