Skip to content

Huawei Cloud Data Migration CDM

Collect Huawei Cloud CDM monitoring metrics

Configuration

Install Func

It is recommended to activate the Guance Integration - Extensions - DataFlux Func (Automata): All prerequisites are automatically installed, please proceed with the script installation.

If you need to deploy Func manually, refer to Manual Func Deployment

Install Script

Note: Please prepare the Huawei Cloud AK with the required permissions in advance (for simplicity, you can grant the global read-only permission Tenant Guest)

Automated Script Activation

  1. Log in to the Guance console.
  2. Click the [Integration] menu, select [Cloud Account Management].
  3. Click [Add Cloud Account], select [Huawei Cloud], and fill in the required information on the interface. If you have already configured the cloud account information before, you can skip this step.
  4. Click [Test]. After the test is successful, click [Save]. If the test fails, please check the relevant configuration information and test again.
  5. Click [Cloud Account Management]. You can see the added cloud account in the list. Click the corresponding cloud account to enter the details page.
  6. Click the [Integration] button on the cloud account details page. Under the Not Installed list, find Huawei Cloud APIG, and click the [Install] button. The installation interface will pop up for installation.

Manual Script Activation

  1. Log in to the Func console, click [Script Market], enter the Guance script market, and search for integration_huaweicloud_cdm.

  2. Click [Install], then enter the corresponding parameters: Huawei Cloud AK, SK, and account name.

  3. Click [Deploy Startup Script]. The system will automatically create the Startup script set and configure the corresponding startup scripts.

  4. After activation, you can see the corresponding automatic trigger configuration in "Management / Automatic Trigger Configuration". Click [Execute] to immediately execute it once without waiting for the scheduled time. After a while, you can check the execution task records and corresponding logs.

Verification

  1. In "Management / Automatic Trigger Configuration", confirm whether the corresponding task has the automatic trigger configuration. At the same time, you can check the corresponding task records and logs to see if there are any exceptions.
  2. In Guance, go to "Infrastructure - Resource Catalog" to see if there is asset information.
  3. In Guance, go to "Metrics" to see if there is corresponding monitoring data.

Metrics

Collect Huawei Cloud Data Migration CDM metrics. More metrics can be collected through configuration. Huawei Cloud CDM Metrics Details

Huawei Cloud CDM metrics are under the huaweicloud_SYS.CDM measurement. Below are the descriptions of CDM-related metrics.

Metric ID Metric Name Metric Meaning Value Range Unit Measurement Object (Dimension) Monitoring Period (Original Metric)
bytes_in Network Inbound Rate This metric is used to count the network traffic per second flowing into the measurement object. ≥ 0 bytes/s bytes/s CDM Cluster Instance 1 minute
bytes_out Network Outbound Rate This metric is used to count the network traffic per second flowing out of the measurement object. ≥ 0 bytes/s bytes/s CDM Cluster Instance 1 minute
cpu_usage CPU Usage This metric is used to count the CPU usage of the measurement object. 0%~100% % CDM Cluster Instance 1 minute
mem_usage Memory Usage This metric is used to count the memory usage of the measurement object. 0%~100% % CDM Cluster Instance 1 minute
pg_pending_job Queued Jobs This metric is used to count the number of jobs in the PENDING state in this CDM instance. >=0 Count CDM Cluster Instance 1 minute
pending_threads Queued Extraction Concurrency This metric is used to count the number of extraction concurrency threads in the Waiting state in this CDM instance. ≥ 0 Count CDM Cluster Instance 1 minute
disk_usage Disk Utilization This metric is collected from the physical machine level for disk usage rate. The data accuracy is lower than that collected from within the Elastic Cloud Server. 0.001%~90% % CDM Cluster Instance 1 minute
disk_io Disk IO This metric is collected from the physical machine level for the number of bytes read and written per second by the disk. The data accuracy is lower than that collected from within the Elastic Cloud Server. ≥ 0 byte/s byte/s CDM Cluster Instance 1 minute
tomcat_heap_usage Heap Memory Usage This metric is collected from the physical machine level for heap memory usage rate. The data accuracy is lower than that collected from within the Elastic Cloud Server. 0.001%~90% % CDM Cluster Instance 1 minute
tomcat_connect Tomcat Concurrent Connections This metric is collected from the physical machine level for Tomcat concurrent connections. 0~2147483647 Count CDM Cluster Instance 1 minute
tomcat_thread_count Tomcat Threads This metric is collected from the physical machine level for the number of threads occupied by Tomcat. 0~2147483647 Count CDM Cluster Instance 1 minute
pg_connect Database Connections This metric is collected from the physical machine level for PostgreSQL database connections. 0~2147483647 Count CDM Cluster Instance 1 minute
pg_submission_row History Table Rows This metric is collected from the physical machine level for the number of rows in the PostgreSQL submission table. 0~2147483647 Count CDM Cluster Instance 1 minute
pg_failed_job_rate Failed Job Rate This metric is collected from the sqoop process at the physical machine level for the failed job rate. 0.001%~100% % CDM Cluster Instance 1 minute
inodes_usage Inodes Utilization This metric is collected from the physical machine level for disk inodes usage rate. The data accuracy is lower than that collected from within the Elastic Cloud Server. 0.001%~100% % CDM Cluster Instance 1 minute

Object

After the data is synchronized normally, you can view the data in the "Infrastructure - Resource Catalog" of Guance.

{
  "measurement": "huaweicloud_cdm",
  "tags": {
    "RegionId"                : "cn-south-4",
    "project_id"              : "756ada1aa17e4049b2a16ea41912e52d",
    "enterprise_project_id"   : "0824ss-xxxx-xxxx-xxxx-12334fedffg",
    "cluster_id"              : "xxxxxx",
    "cluster_name"            : "test",
    "instance_name"           : "test-xxxx",
    "instance_id"             : "xxxxxxxxxx",
    "status"                  : "AVAILABLE"
  },
  "fields": {
    "azName"                        : "xszxxxxxx",
    "dbuser"                        : "root",
    "flavorName"                    : "xxxx",
    "clusterMode"                   : "xxxxx",
    "publicEndpoint"                : "cn-south-4a",
    "statusDetail"                  : "cdmk2-xxx-xxx",
    "create_time"                   : "2024-11-11T08:15:58Z",
    "update_time"                   : "2024-11-11T08:15:58Z",
    "recentEvent"                   : "xxxxx",
    "datastore"                     : "xxx",
    "isAutoOff"                     : "xxx",
    "task"                          : "xxx",
    "actionProgress"                : "xxx"
  }
}

Note: The fields in tags and fields may change with subsequent updates.

Feedback

Is this page helpful? ×