Skip to content

Tencent Cloud CKafka

The displayed Metrics of Tencent Cloud CKafka include message throughput, latency, concurrent connections, and reliability. These Metrics reflect the performance and reliability guarantees of CKafka when handling large-scale message delivery and real-time data streams.

Configuration

Install Func

It is recommended to enable Guance Integration - Extensions - DataFlux Func (Automata): All prerequisites are automatically installed, please proceed with the script installation.

For self-deployment of Func, refer to Self-deploy Func

Install CKafka Collection Script

Note: Please prepare the required Tencent Cloud AK in advance (for simplicity, you can directly grant the global read-only permission ReadOnlyAccess)

To synchronize CKafka monitoring data, we install the corresponding collection script: 「Guance Integration (Tencent Cloud-CKafka)」(ID: integration_tencentcloud_ckafka)

After clicking 【Install】, enter the corresponding parameters: Tencent Cloud AK, Tencent Cloud account name.

Click 【Deploy Startup Script】, the system will automatically create the Startup script set and configure the corresponding startup script.

After enabling, you can see the corresponding automatic trigger configuration in 「Manage / Automatic Trigger Configuration」. Click 【Execute】 to immediately execute it once without waiting for the scheduled time. Wait a moment, and you can view the execution task records and corresponding logs.

Verification

  1. In 「Manage / Automatic Trigger Configuration」, confirm whether the corresponding task has the automatic trigger configuration, and check the task records and logs for any exceptions.
  2. In Guance, check if asset information exists in 「Infrastructure / Custom」.
  3. In Guance, check if there is corresponding monitoring data in 「Metrics」.

Metrics

After configuring Tencent Cloud Cloud Monitoring, the default Measurement is as follows. More Metrics can be collected through configuration Tencent Cloud Cloud Monitoring Metrics Details

Performance Metrics

Metric Name Metric Description Metric Meaning Unit Dimension
InstanceProCount Instance Production Message Count Instance production message count, summed over the selected time granularity Count instanceId
InstanceConCount Instance Consumption Message Count Instance consumption message count, summed over the selected time granularity Count instanceId
InstanceConReqCount Instance Consumption Request Count Instance-level consumption request count, summed over the selected time granularity Times instanceId
InstanceProReqCount Instance Production Request Count Instance-level production request count, summed over the selected time granularity Times instanceId

System Metrics

Metric Name Metric Description Metric Meaning Unit Dimension
InstanceDiskUsage Disk Usage Percentage Current disk usage as a percentage of the total disk capacity of the instance specification % instanceId

Cumulative Usage Metrics

Metric Name Metric Description Metric Meaning Unit Dimension
InstanceConnectCount Instance Connection Count Number of connections between client and server Count instanceId
InstanceConFlow Instance Consumption Flow Instance consumption flow (excluding traffic generated by replicas), summed over the selected time granularity MB instanceId
InstanceMaxConFlow Instance Consumption Message Peak Bandwidth Instance consumption message peak bandwidth (no concept of replicas during consumption) MB/s instanceId
InstanceMaxProFlow Instance Production Message Peak Bandwidth Instance production message peak bandwidth (excluding bandwidth produced by replicas) MB/s instanceId
InstanceMsgCount Instance Disk Message Total Count Instance disk message total count (excluding replicas), latest value over the selected time granularity Count instanceId
InstanceMsgHeap Instance Disk Usage Instance disk usage (including replicas), latest value over the selected time granularity MB instanceId
InstanceProFlow Instance Production Bandwidth Instance production flow (excluding traffic generated by replicas), summed over the selected time granularity MB instanceId
InstanceConnectPercentage Instance Connection Percentage Instance connection percentage (percentage of client and server connections relative to quota) % instanceId
InstanceConsumeBandwidthPercentage Instance Consumption Bandwidth Percentage Instance consumption bandwidth percentage (percentage of instance consumption bandwidth relative to quota) % instanceId
InstanceConsumeGroupNum Instance Consumption Group Count Instance consumption group count Count instanceId
InstanceConsumeGroupPercentage Instance Consumption Group Percentage Instance consumption group percentage (percentage of instance consumption group count relative to quota) % instanceId
InstanceConsumeThrottle Instance Consumption Throttle Count Instance consumption throttle count Times instanceId
InstancePartitionNum Instance Partition Count Instance partition count Count instanceId
InstancePartitionPercentage Instance Partition Percentage (Quota Usage Percentage） Instance partition percentage (quota usage percentage) % instanceId
InstanceProduceBandwidthPercentage Instance Production Bandwidth Percentage Instance production bandwidth percentage (quota usage percentage) % instanceId
InstanceProduceThrottle Instance Production Throttle Count Instance production throttle count Times instanceId
InstanceReplicaProduceFlow Instance Production Message Peak Bandwidth Instance production message peak bandwidth (including bandwidth produced by replicas) MB/s instanceId
InstanceTopicNum Instance Topic Count Instance Topic count Count instanceId
InstanceTopicPercentage Instance Topic Percentage Instance Topic percentage (quota usage) % instanceId

Object

The collected Tencent Cloud CKafka object data structure can be viewed in 「Infrastructure - Custom」

{
  "Healthy": "1",
  "account_name": "xxxx",
  "InstanceType": "profession",
  "RenewFlag": "0",
  "SubnetId": "subnet-bp2jqhcj",
  "Vip": "172.17.32.16",
  "Bandwidth": "160",
  "ZoneId": "200002",
  "message": "{\"AllowDowngrade\": true, \"Bandwidth\": 160, \"ClusterType\": \"CLOUD_EKS_TSE\", \"CreateTime\": 1692066710, \"Cvm\": 1, \"DiskSize\": 200, \"DiskType\": \"CLOUD_BASIC\", \"ExpireTime\": -62170009580, \"Features\": [], \"Healthy\": 1, \"HealthyMessage\": \"\", \"InstanceId\": \"ckafka-jamo82wo\", \"InstanceName\": \"\\u672a\\u547d\\u540d\", \"InstanceType\": \"profession\", \"IsInternal\": 0, \"MaxPartitionNumber\": 400, \"MaxTopicNumber\": 200, \"PartitionNumber\": 3, \"PublicNetwork\": 3, \"PublicNetworkChargeType\": \"BANDWIDTH_POSTPAID_BY_HOUR\", \"RebalanceDeadLineTimeStamp\": \"0000-00-00 00:00:00\", \"RebalanceTime\": \"0000-00-00 00:00:00\", \"RegionId\": \"ap-shanghai\", \"RenewFlag\": 0, \"Status\": 1, \"SubnetId\": \"subnet-bp2jqhcj\", \"Tags\": [], \"TopicNum\": 1, \"Version\": \"2.4.1\", \"Vip\": \"172.17.32.16\", \"VipList\": [{\"Vip\": \"172.17.32.16\", \"Vport\": \"9092\"}], \"VpcId\": \"vpc-kcphyzty\", \"Vport\": \"9092\", \"ZoneId\": 200002, \"ZoneIds\": [200002, 200003]}",
  "__docid": "CO_31e0187c3c5c2842b60f88a87c11eca0",
  "InstanceId": "ckafka-jamo82wo",
  "InstanceName": "未命名",
  "Status": "1",
  "VpcId": "vpc-kcphyzty",
  "Cvm": "1",
  "__namespace": "custom_object",
  "cloud_provider": "tencentcloud",
  "create_time": 1692089426315,
  "DiskType": "CLOUD_BASIC",
  "ExpireTime": "-62170009580",
  "TopicNum": "1",
  "VipList": "[{\"Vip\": \"172.17.32.16\", \"Vport\": \"9092\"}]",
  "time": 1692089425851,
  "IsInternal": "0",
  "Vport": "9092",
  "class": "tencentcloud_ckafka",
  "date": 1692089425000,
  "date_ns": 0,
  "name": "ckafka-jamo82wo",
  "CreateTime": "1692066710",
  "DiskSize": "200",
  "RegionId": "ap-shanghai",
  "Version": "2.4.1"
}

Note: Fields in tags and fields may change with subsequent updates

Appendix

TencentCloud-CKafka「Regions and Availability」

Please refer to the official Tencent documentation:

Feedback

Is this page helpful? ×