Tencent Cloud CKafka¶

The displayed Metrics of Tencent Cloud CKafka include message throughput, latency, concurrent connections, and reliability. These Metrics reflect the performance and reliability guarantees of CKafka in handling large-scale message delivery and real-time data streams.

Configuration¶

Install Func¶

It is recommended to activate the Guance Integration - Extensions - DataFlux Func (Automata): All prerequisites are automatically installed. Please proceed with the script installation.

If you need to deploy Func manually, refer to Manual Deployment of Func

Activate Script¶

Note: Please prepare the required Tencent Cloud AK in advance (for simplicity, you can directly grant the global read-only permission ReadOnlyAccess)

Activate Script for DataFlux Func (Automata)¶

1. Log in to the Guance console.
2. Click the 【Integration】 menu and select 【Cloud Account Management】.
3. Click 【Add Cloud Account】, select 【Tencent Cloud】, and fill in the required information on the interface. If you have already configured the cloud account information, you can skip this step.
4. Click 【Test】. After the test is successful, click 【Save】. If the test fails, please check if the relevant configuration information is correct and test again.
5. Click 【Cloud Account Management】. You can see the added cloud account in the list. Click the corresponding cloud account to enter the details page.
6. Click the 【Integration】 button on the cloud account details page. In the Not Installed list, find Tencent Cloud CKafka and click the 【Install】 button. The installation interface will pop up for installation.

Activate Script Manually¶

1. Log in to the Func console, click 【Script Market】, and enter the Guance script market. Search for integration_tencentcloud_ckafka.

2. Click 【Install】, then enter the corresponding parameters: Tencent Cloud AK, SK, and account name.

3. Click 【Deploy Startup Script】. The system will automatically create the Startup script set and configure the corresponding startup scripts.

4. After activation, you can see the corresponding automatic trigger configuration in 「Manage / Automatic Trigger Configuration」. Click 【Execute】 to execute it immediately without waiting for the scheduled time. After a while, you can view the execution task records and corresponding logs.

Verification¶

1. In 「Manage / Automatic Trigger Configuration」, confirm whether the corresponding task has the corresponding automatic trigger configuration. You can also check the corresponding task records and logs to see if there are any exceptions.
2. In Guance, check if the asset information exists in 「Infrastructure / Custom」.
3. In Guance, check if there is corresponding monitoring data in 「Metrics」.

Metrics¶

After configuring Tencent Cloud Cloud Monitoring, the default Measurement is as follows. You can collect more Metrics through configuration. Tencent Cloud Cloud Monitoring Metrics Details

Performance Metrics¶

System Metrics¶

Cumulative Usage Metrics¶

Object¶

The collected Tencent Cloud CKafka object data structure can be seen in 「Infrastructure - Custom」.

{
  "Healthy": "1",
  "account_name": "xxxx",
  "InstanceType": "profession",
  "RenewFlag": "0",
  "SubnetId": "subnet-bp2jqhcj",
  "Vip": "172.17.32.16",
  "Bandwidth": "160",
  "ZoneId": "200002",
  "message": "{\"AllowDowngrade\": true, \"Bandwidth\": 160, \"ClusterType\": \"CLOUD_EKS_TSE\", \"CreateTime\": 1692066710, \"Cvm\": 1, \"DiskSize\": 200, \"DiskType\": \"CLOUD_BASIC\", \"ExpireTime\": -62170009580, \"Features\": [], \"Healthy\": 1, \"HealthyMessage\": \"\", \"InstanceId\": \"ckafka-jamo82wo\", \"InstanceName\": \"\\u672a\\u547d\\u540d\", \"InstanceType\": \"profession\", \"IsInternal\": 0, \"MaxPartitionNumber\": 400, \"MaxTopicNumber\": 200, \"PartitionNumber\": 3, \"PublicNetwork\": 3, \"PublicNetworkChargeType\": \"BANDWIDTH_POSTPAID_BY_HOUR\", \"RebalanceDeadLineTimeStamp\": \"0000-00-00 00:00:00\", \"RebalanceTime\": \"0000-00-00 00:00:00\", \"RegionId\": \"ap-shanghai\", \"RenewFlag\": 0, \"Status\": 1, \"SubnetId\": \"subnet-bp2jqhcj\", \"Tags\": [], \"TopicNum\": 1, \"Version\": \"2.4.1\", \"Vip\": \"172.17.32.16\", \"VipList\": [{\"Vip\": \"172.17.32.16\", \"Vport\": \"9092\"}], \"VpcId\": \"vpc-kcphyzty\", \"Vport\": \"9092\", \"ZoneId\": 200002, \"ZoneIds\": [200002, 200003]}",
  "__docid": "CO_31e0187c3c5c2842b60f88a87c11eca0",
  "InstanceId": "ckafka-jamo82wo",
  "InstanceName": "未命名",
  "Status": "1",
  "VpcId": "vpc-kcphyzty",
  "Cvm": "1",
  "__namespace": "custom_object",
  "cloud_provider": "tencentcloud",
  "create_time": 1692089426315,
  "DiskType": "CLOUD_BASIC",
  "ExpireTime": "-62170009580",
  "TopicNum": "1",
  "VipList": "[{\"Vip\": \"172.17.32.16\", \"Vport\": \"9092\"}]",
  "time": 1692089425851,
  "IsInternal": "0",
  "Vport": "9092",
  "class": "tencentcloud_ckafka",
  "date": 1692089425000,
  "date_ns": 0,
  "name": "ckafka-jamo82wo",
  "CreateTime": "1692066710",
  "DiskSize": "200",
  "RegionId": "ap-shanghai",
  "Version": "2.4.1"
}

Note: The fields in tags and fields may change with subsequent updates.

Appendix¶

TencentCloud-CKafka「Regions and Availability」¶

Please refer to the official Tencent documentation:

• TencentCloud-CKafka Region List