Skip to content

AWS DMS

The displayed Metrics for AWS DMS include data migration speed, latency, data consistency, and migration success rate. These Metrics reflect the performance and reliability of DMS during database migration and replication.

Configuration

Install Func

It is recommended to enable the Guance integration - extension - DataFlux Func (Automata): all prerequisites are automatically installed. Please continue with script installation.

If you deploy Func on your own, refer to Self-deploy Func

Install Script

Note: Please prepare an Amazon AK that meets the requirements in advance (for simplicity, you can directly grant global read-only permission ReadOnlyAccess).

To synchronize monitoring data of AWS DMS cloud resources, we install the corresponding collection script: "Guance Integration (AWS-DMS Collection)" (ID: guance_aws_dms)

After clicking 【Install】, input the corresponding parameters: Amazon AK, Amazon account name.

Click 【Deploy Startup Script】, and the system will automatically create a Startup script set and automatically configure the corresponding startup script.

Then, in the collection script, change the regions in collector_configs and cloudwatch_configs to the actual regions.

In addition, you can see the corresponding automatic trigger configuration in "Manage / Automatic Trigger Configuration". Click 【Execute】 to immediately execute it once without waiting for the scheduled time. After a while, you can view the execution task records and corresponding logs.

We default to collecting some configurations. For details, see the Metrics section Customize Cloud Object Metrics

Verification

  1. In "Manage / Automatic Trigger Configuration", confirm whether the corresponding task has the corresponding automatic trigger configuration, and you can check the corresponding task records and logs for any abnormalities.
  2. On the Guance platform, under "Infrastructure / Custom", check if there is asset information.
  3. On the Guance platform, under "Metrics", check if there is corresponding monitoring data.

Metrics

After configuring Amazon CloudWatch, the default Measurement set is as follows. You can collect more Metrics through configuration Amazon CloudWatch Metrics Details

Instance Metrics

The AWS/DMS namespace includes the following instance Metrics.

Metrics Description
CPUUtilization The percentage of allocated vCPUs (virtual CPUs) currently in use on the instance. Unit: Percentage
FreeMemory The amount of physical memory available for applications, page cache, and kernel data structures. For more information, see the MemFree value in the Linux manual page /proc/memInfo. Unit: Bytes
FreeStorageSpace The size of available storage space. Unit: Bytes
WriteIOPS The average number of disk write I/O operations per second. Unit: Count/Second
ReadIOPS The average number of disk read I/O operations per second. Unit: Count/Second
WriteThroughput The average number of bytes written to disk per second. Unit: Bytes/Second
ReadThroughput The average number of bytes read from disk per second. Unit: Bytes/Second
NetworkTransmitThroughput Outbound (transmit) network traffic on the replication instance, including customer database AWS DMS traffic and traffic used for monitoring and replication. Unit: Bytes/Second
NetworkReceiveThroughput Inbound (receive) network traffic on the replication instance, including customer database AWS DMS traffic and traffic used for monitoring and replication. Unit: Bytes/Second
CDCChangesMemorySource The number of rows accumulated in memory and waiting to be committed from the source. You can view this metric together with CDC ChangesDiskSource.
CDCChangesMemoryTarget The number of rows accumulated in memory and waiting to be committed to the target. You can view this metric together with CDC ChangesDiskTarget.
CDCChangesDiskSource The number of rows accumulated on disk and waiting to be committed from the source. You can view this metric together with CDC ChangesMemorySource.
CDCChangesDiskTarget The number of rows accumulated on disk and waiting to be committed to the target. You can view this metric together with CDC ChangesMemoryTarget.
CDCThroughputBandwidthTarget Outbound data transmitted for the target, in KB per second. CDC ThroughputBandwidth records outbound data transmitted at sampling points. If task network traffic is not found, this value is zero. Due to CDC not publishing long-running transactions, network traffic may not be recorded.
CDCThroughputRowsSource Incoming task changes for the source, in rows per second.
CDCThroughputRowsTarget Outgoing task changes for the target, in rows per second.

Objects

The collected AWS DMS object data structure can be viewed under "Infrastructure - Custom".

{
  "measurement": "aws_dms",
  "tags": {
    "AvailabilityZone"              :"cn-northwest-1b",
    "class"                         :"aws_dms",
    "cloud_provider"                :"aws",
    "KmsKeyId:arn"                  :"aws-cn:kms:cn-northwest-1:294654068288:key/531cd79a-5a86-47d6-b216-0d63e2e32b3a",
    "name"                          :"hn-test",
    "ReplicationInstanceClass"      :"dms.t3.micro",
    "ReplicationInstanceIdentifier" :"hn-test"
  }
}

Note: The fields in tags may change with subsequent updates.

Note 1: The name value is the instance ID, used as a unique identifier. ```

Feedback

Is this page helpful? ×