AWS EMR¶

Use the "Guance Cloud Sync" series script packages in the script market to synchronize cloud monitoring and cloud assets data to Guance

Configuration¶

Install Func¶

It is recommended to enable Guance Integration - Extension - Managed Func: All prerequisites will be automatically installed. Please continue with the script installation.

If you deploy Func yourself, refer to Self-deployed Func

Install Script¶

Note: Please prepare an Amazon AK that meets the requirements in advance (for simplicity, you can directly grant global read-only permission ReadOnlyAccess)

Managed Version Activation Script¶

1. Log in to Guance Console
2. Click on the 【Manage】 menu and select 【Cloud Account Management】
3. Click 【Add Cloud Account】, choose 【AWS】, and fill in the required information on the interface; if you have already configured cloud account information before, skip this step
4. Click 【Test】, after a successful test, click 【Save】; if the test fails, check whether the relevant configuration information is correct and retest
5. In the 【Cloud Account Management】 list, you can see the added cloud account. Click the corresponding cloud account and go to the details page
6. Click the 【Integration】 button on the cloud account detail page. Under the Not Installed list, find AWS EMR, click the 【Install】 button, and install it by following the installation interface.

Manual Activation Script¶

1. Log in to the Func console, click 【Script Market】, enter the official script market, and search for: guance_aws_emr

2. After clicking 【Install】, input the corresponding parameters: AWS AK ID, AK Secret, and account name.

3. Click 【Deploy Startup Script】, the system will automatically create a Startup script set and automatically configure the corresponding startup script.

4. After enabling, you can see the corresponding automatic trigger configuration under 「Management / Automatic Trigger Configuration」. Click 【Execute】, and you can immediately execute once without waiting for the regular time. After a while, you can view the execution task records and corresponding logs.

Verification¶

1. Confirm in 「Management / Automatic Trigger Configuration」 whether the corresponding tasks have the corresponding automatic trigger configurations, and at the same time, you can check the corresponding task records and logs for any anomalies.
2. In Guance, 「Infrastructure / Custom」, check if there is asset information.
3. In Guance, 「Metrics」 check if there are corresponding monitoring data.

Metrics¶

After configuring Amazon-CloudWatch, the default metric set is as follows. You can collect more metrics through configuration. Amazon Cloud Monitoring Metric Details

Objects¶

The structure of collected AWS EMR object data can be viewed under 「Infrastructure - Custom」

{
  "measurement": "aws_emr",
  "tags": {
    "Id"                 : "xxxxx",
    "ClusterName"        : "xxxxx",
    "ClusterArn"         : "xxxx",
    "RegionId"           : "cn-north-1",
    "OutpostArn"         : "xxxx",
  },
  "fields": {
    "Status"               : "{Instance status JSON data}",
    "message"              : "{Instance JSON data}"
  }
}

Note: Fields in tags and fields may change with subsequent updates