Alibaba Cloud¶
Alibaba Cloud MongoDB replica set Metrics display, including CPU usage, memory usage, disk usage, data occupied disk space, log occupied disk space, statements executed per second, request count, connection count, network traffic, replication delay, QPS, etc.
Alibaba Cloud MongoDB sharding cluster Metrics display, including CPU usage, memory usage, disk usage, data occupied disk space, log occupied disk space, statements executed per second, request count, connection count, network traffic, replication delay, QPS, etc.
Alibaba Cloud MongoDB single-node instance Metrics display, including CPU usage, memory usage, disk usage, data occupied disk space, statements executed per second, request count, connection count, network traffic, QPS, etc.
Configuration¶
Install Func¶
It is recommended to enable the Guance integration - extension - DataFlux Func (Automata)
If you deploy Func yourself, refer to Self-deployed Func
Enable Script¶
Note: Please prepare an Alibaba Cloud AK that meets the requirements in advance (for simplicity, you can directly grant global read-only permission
ReadOnlyAccess
).
Managed Version Enable Script¶
- Log in to the Guance console.
- Click on the 【Manage】 menu and select 【Cloud Account Management】.
- Click 【Add Cloud Account】, select 【Alibaba Cloud】, and fill in the required information on the interface. If you have already configured cloud account information, skip this step.
- Click 【Test】, if the test is successful, click 【Save】. If the test fails, check whether the related configuration information is correct and retest.
- In the 【Cloud Account Management】 list, you can see the added cloud account. Click the corresponding cloud account to enter the details page.
- Click the 【Integration】 button on the cloud account details page. Under the
Not Installed
list, findAlibaba Cloud MongoDB
, click the 【Install】 button, and install it in the pop-up installation interface.
Manual Enable Script¶
- Log in to the Func console, click 【Script Market】, enter the official script market, and search for
guance_aliyun_mongodb
. - After clicking 【Install】, input the corresponding parameters: Alibaba Cloud AK ID, AK Secret, and account name.
- Click 【Deploy Start Script】, the system will automatically create a
Startup
script set and automatically configure the corresponding start script. - After enabling, you can see the corresponding automatic trigger configuration in 「Management / Automatic Trigger Configuration」. Click 【Execute】 to immediately execute once without waiting for the scheduled time. Wait a moment, and you can view the execution task records and corresponding logs.
We default collect some configurations, see Metrics section for details.
Customize cloud object Metrics
Verification¶
- In 「Management / Automatic Trigger Configuration」, confirm whether the corresponding tasks have been configured with automatic triggers. You can also check the corresponding task records and logs to ensure there are no abnormalities.
- In Guance, 「Infrastructure / Custom」, check if asset information exists.
- In Guance, 「Metrics」, check if corresponding monitoring data exists.
Metrics¶
After configuring Alibaba Cloud - Cloud Monitor, the default collected Metrics are as follows. More Metrics can be collected through configuration. For more Metrics, please refer to: Alibaba Cloud Cloud Monitor Metrics Details
Cloud Database MongoDB Edition - Replica Set¶
Metric Id | MetricCategory | Metric Name | Dimensions | Statistics | Unit | Min Periods |
---|---|---|---|---|---|---|
CPUUtilization |
mongodb_replicaset |
CPU usage | userId,instanceId,role | Average,Minimum,Maximum | % | 60 s |
ConnectionAmount |
mongodb_replicaset |
Connection usage | userId,instanceId,role | Average,Minimum,Maximum | Count | 60 s |
ConnectionUtilization |
mongodb_replicaset |
Connection usage rate | userId,instanceId,role | Average,Minimum,Maximum | % | 60 s |
DataDiskAmount |
mongodb_replicaset |
Data occupied disk space | userId,instanceId,role | Average,Minimum,Maximum | bytes | 60 s |
DiskUtilization |
mongodb_replicaset |
Disk usage rate | userId,instanceId,role | Average,Minimum,Maximum | % | 60 s |
IOPSUtilization |
mongodb_replicaset |
IOPS usage rate | userId,instanceId,role | Average,Minimum,Maximum | % | 60 s |
InstanceDiskAmount |
mongodb_replicaset |
Instance occupied disk space | userId,instanceId,role | Average,Minimum,Maximum | bytes | 60 s |
IntranetIn |
mongodb_replicaset |
Internal network inbound traffic | userId,instanceId,role | Average,Minimum,Maximum | bytes | 60 s |
IntranetOut |
mongodb_replicaset |
Internal network outbound traffic | userId,instanceId,role | Average,Minimum,Maximum | bytes | 60 s |
LogDiskAmount |
mongodb_replicaset |
Log occupied disk space | userId,instanceId,role | Average,Minimum,Maximum | bytes | 60 s |
MemoryUtilization |
mongodb_replicaset |
Memory usage rate | userId,instanceId,role | Average,Minimum,Maximum | % | 60 s |
NumberRequests |
mongodb_replicaset |
Request count | userId,instanceId,role | Average,Minimum,Maximum | Count | 60 s |
OpCommand |
mongodb_replicaset |
Command operation count | userId,instanceId,role | Average,Minimum,Maximum | Frequency | 60 s |
OpDelete |
mongodb_replicaset |
Delete operation count | userId,instanceId,role | Average,Minimum,Maximum | Frequency | 60 s |
OpGetmore |
mongodb_replicaset |
Getmore operation count | userId,instanceId,role | Average,Minimum,Maximum | Frequency | 60 s |
OpInsert |
mongodb_replicaset |
Insert operation count | userId,instanceId,role | Average,Minimum,Maximum | Count | 60 s |
OpQuery |
mongodb_replicaset |
Query operation count | userId,instanceId,role | Average,Minimum,Maximum | Frequency | 60 s |
OpUpdate |
mongodb_replicaset |
Update operation count | userId,instanceId,role | Average,Minimum,Maximum | Frequency | 60 s |
QPS |
mongodb_replicaset |
Average SQL queries per second | userId,instanceId,role | Average,Minimum,Maximum | Count | 60 s |
ReplicationLag |
mongodb_replicaset |
Replication delay | userId,instanceId,role | Average,Maximum,Minimum,cms_null | seconds | 60 s |
Cloud Database MongoDB Edition - Sharding Cluster¶
Metric Id | MetricCategory | Metric Name | Dimensions | Statistics | Unit | Min Periods |
---|---|---|---|---|---|---|
ShardingCPUUtilization |
mongodb_sharding |
CPU usage | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | % | 60 s |
ShardingConnectionAmount |
mongodb_sharding |
Connection usage | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
ShardingConnectionUtilization |
mongodb_sharding |
Connection usage rate | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | % | 60 s |
ShardingDataDiskAmount |
mongodb_sharding |
Data occupied disk space | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Bytes | 60 s |
ShardingDataDiskAmountOriginal |
mongodb_sharding |
ShardingDataDiskAmountOriginal | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | - | 60 s |
ShardingDiskUtilization |
mongodb_sharding |
Disk usage rate | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | % | 60 s |
ShardingIOPSUtilization |
mongodb_sharding |
IOPS usage rate | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | % | 60 s |
ShardingInstanceDiskAmount |
mongodb_sharding |
Occupied disk space | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Bytes | 60 s |
ShardingIntranetIn |
mongodb_sharding |
Internal network inbound traffic | userId,instanceId,subinstanceId,role |
Average | Bytes | 60 s |
ShardingIntranetOut |
mongodb_sharding |
Internal network outbound traffic | userId,instanceId,subinstanceId,role |
Average | Bytes | 60 s |
ShardingLogDiskAmount |
mongodb_sharding |
Log occupied disk space capacity | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Bytes | 60 s |
ShardingMemoryUtilization |
mongodb_sharding |
Memory usage rate | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | % | 60 s |
ShardingNumberRequests |
mongodb_sharding |
Request count | userId,instanceId,subinstanceId,role |
Average | Count | 60 s |
ShardingOpCommand |
mongodb_sharding |
Command operation count | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
ShardingOpDelete |
mongodb_sharding |
Delete operation count | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
ShardingOpGetmore |
mongodb_sharding |
Getmore operation count | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
ShardingOpInsert |
mongodb_sharding |
Insert operation count | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
ShardingOpQuery |
mongodb_sharding |
Query operation count | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
Cloud Database MongoDB Edition - Single Node Instance¶
Metric Id | MetricCategory | Metric Name | Dimensions | Statistics | Unit | Min Periods |
---|---|---|---|---|---|---|
SingleNodeCPUUtilization |
mongodb_singlenode |
CPU usage | userId,instanceId | Average,Minimum,Maximum | % | 60 s |
SingleNodeConnectionAmount |
mongodb_singlenode |
Connection usage | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeConnectionUtilization |
mongodb_singlenode |
Connection usage rate | userId,instanceId | Average,Minimum,Maximum | % | 60 s |
SingleNodeDataDiskAmount |
mongodb_singlenode |
Data occupied disk space | userId,instanceId | Average,Minimum,Maximum | bytes | 60 s |
SingleNodeDiskUtilization |
mongodb_singlenode |
Disk usage rate | userId,instanceId | Average,Minimum,Maximum | % | 60 s |
SingleNodeIntranetIn |
mongodb_singlenode |
Internal network inbound traffic | userId,instanceId | Average,Minimum,Maximum | bytes | 60 s |
SingleNodeIntranetOut |
mongodb_singlenode |
Internal network outbound traffic | userId,instanceId | Average,Minimum,Maximum | bytes | 60 s |
SingleNodeMemoryUtilization |
mongodb_singlenode |
Memory usage rate | userId,instanceId | Average,Minimum,Maximum | % | 60 s |
SingleNodeNumberRequests |
mongodb_singlenode |
Request count | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpCommand |
mongodb_singlenode |
Command operation count | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpDelete |
mongodb_singlenode |
Delete operation count | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpGetmore |
mongodb_singlenode |
Getmore operation count | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpInsert |
mongodb_singlenode |
Insert operation count | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpQuery |
mongodb_singlenode |
Query operation count | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpUpdate |
mongodb_singlenode |
Update operation count | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeQPS |
mongodb_singlenode |
QPS | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
Objects¶
Collected Alibaba Cloud MongoDB object data structure, which can be seen from 「Infrastructure - Custom」.
{
"measurement": "aliyun_mongodb",
"tags": {
"name" : "dds-bpxxxxxxxx",
"DBInstanceType" : "replicate",
"ChargeType" : "PrePaid",
"Engine" : "MongoDB",
"DBInstanceClass" : "dds.xxxxxxxx",
"DBInstanceId" : "dds-bpxxxxxxx",
"ZoneId" : "cn-hangzhou",
"RegionId" : "cn-hangzhou-h",
"VPCId" : "vpc-bpxxxxxxxx",
"EngineVersion" : "4.2",
"CurrentKernelVersion" : "mongodb_20210204_4.0.14",
"StorageEngine" : "WiredTiger",
"DBInstanceDescription": "Business System",
"LockMode" : "Unlock",
},
"fields": {
"ExpireTime" : "2020-11-18T08:47:11Z",
"DBInstanceStorage": "20",
"ReplicaSets" : "{Connection address JSON data}",
"message" : "{Instance JSON data}",
}
}
Logs¶
Slow Query Logs¶
Prerequisites¶
Note: The code execution of this script depends on the collection of MongoDB instance objects. If MongoDB custom object collection has not been configured, the slow log script will not be able to collect slow log data.
Install the Slow Query Collection Script¶
On top of the previous setup, you need to install another script corresponding to MongoDB slow query collection.
In the 「Script Market - Official Script Market」, go to 「Details」, and click to install the corresponding script package:
- 「Guance Integration (Alibaba Cloud - MongoDB Slow Query Log Collection)」(ID:
guance_aliyun_mongodb
)
After the data synchronizes normally, you can view the data in the 「Logs」 section of Guance.
An example of the reported data is as follows:
{
"measurement": "aliyun_mongodb_slowlog",
"tags": {
"name" : "dds-bpxxxxxxxx",
"DBInstanceType" : "replicate",
"ChargeType" : "PrePaid",
"Engine" : "MongoDB",
"DBInstanceClass" : "dds.xxxxxxxx",
"DBInstanceId" : "dds-bpxxxxxxx",
"ZoneId" : "cn-hangzhou",
"RegionId" : "cn-hangzhou-h",
"VPCId" : "vpc-bpxxxxxxxx",
"EngineVersion" : "4.2",
"CurrentKernelVersion" : "mongodb_20210204_4.0.14",
"StorageEngine" : "WiredTiger",
"DBInstanceDescription": "Business System",
"DBName" : "local",
"AccountName" : "AliCloud Account for Script Development",
"HostAddress" : "11.xxx.xxx.xx",
"TableName" : "oplog",
},
"fields": {
"SQLText" : "{SQL Statement}",
"ExecutionStartTime": "1",
"QueryTimes" : "1",
"ReturnRowCounts" : "1",
"KeysExamined" : "1",
"DocsExamined" : "1",
}
}
Descriptions of some parameters are as follows:
Field | Type | Description |
---|---|---|
QueryTimes |
Int | Execution duration, unit in milliseconds |
ExecutionStartTime |
Str | Execution start time, UTC time |
Note: Fields in
tags
andfields
may change with subsequent updates.Note:
fields.message
is a string after JSON serialization.