Huawei Cloud DIS

Collect Huawei Cloud DIS Metrics data

Configuration¶

Install Func¶

It is recommended to enable the Guance integration - extension - DataFlux Func (Automata): all prerequisites are automatically installed, please continue with the script installation.

If you deploy Func on your own, refer to Self-deploy Func

Install Script¶

Note: Please prepare a Huawei Cloud AK that meets the requirements in advance (for simplicity, you can directly grant global read-only permission ReadOnlyAccess)

To synchronize the monitoring data of Huawei Cloud DIS, we install the corresponding collection script: "Guance Integration (Huawei Cloud-DIS Collection)" (ID: guance_huaweicloud_dis)

After clicking 【Install】, enter the corresponding parameters: Huawei Cloud AK, Huawei Cloud account name.

Click 【Deploy Startup Script】, and the system will automatically create a Startup script set and automatically configure the corresponding startup script.

After the script is installed, find the script "Guance Integration (Huawei Cloud-DIS Collection)" under "Development" in Func, expand and modify this script, find collector_configs and monitor_configs respectively, and edit the content of region_projects. Change the region and Project ID to the actual region and Project ID, then click Save and Publish.

In addition, you can see the corresponding automatic trigger configuration in "Management / Automatic Trigger Configuration". Click 【Execute】 to run it immediately without waiting for the scheduled time. After a while, you can view the execution task records and corresponding logs.

Verification¶

1. In "Management / Automatic Trigger Configuration", confirm whether the corresponding automatic trigger configuration exists for the task, and you can also check the corresponding task records and logs to see if there are any abnormalities.
2. On the Guance platform, check whether there is asset information in "Infrastructure - Resource Catalog".
3. On the Guance platform, check whether there are corresponding monitoring data in "Metrics".

Metrics¶

Configure Huawei Cloud DIS Metrics, you can collect more Metrics through configuration Huawei Cloud DIS Metrics Details

Objects¶

The collected Huawei Cloud DIS object data structure can be seen in "Infrastructure -"

{
  "measurement": "huaweicloud_dis",
  "tags": {
    "RegionId"    : "cn-north-4",
    "data_type"   : "BLOB",
    "name"        : "dis-YoME",
    "project_id"  : "c631f04625xxxxexxxxxx253c62d48585",
    "status"      : "RUNNING",
    "stream_name" : "dis-YoME",
    "stream_type" : "COMMON"
  },
  "fields": {
    "partition_count"    : 1,
    "retention_period"   : 24,
    "auto_scale_enabled" : false,
    "create_time"        : 1691484876645,
    "message"            : "{Instance JSON data}"
  }
}

Some parameter descriptions are as follows:

Note: Fields in tags and fields may change with subsequent updates.

Tip 1: The value of tags.name is the instance ID, which serves as a unique identifier.

Tip 2: The following fields are all JSON serialized strings.

• fields.message