AWS Athena
Collect AWS Athena Metrics
Configuration¶
Install Func¶
It is recommended to activate Guance Integration - Extensions - DataFlux Func (Automata): all prerequisites are automatically installed. Please proceed with the script installation.
If you deploy Func manually, refer to Manual Func Deployment
Install Script¶
Note: Please prepare an Amazon AK with the required permissions in advance (for simplicity, you can directly grant the global read-only permission
ReadOnlyAccess).
Activate Script on Automata¶
- Log in to the Guance console.
- Click the [Integration] menu and select [Cloud Account Management].
- Click [Add Cloud Account], select [AWS], and fill in the required information on the interface. If you have already configured the cloud account information before, ignore this step.
- Click [Test]. After the test is successful, click [Save]. If the test fails, please check if the relevant configuration information is correct and retest.
- Click [Cloud Account Management]. You can see the added cloud account in the list. Click the corresponding cloud account to enter the details page.
- Click the [Integration] button on the cloud account details page. Under the
Not Installedlist, findAWS Athenaand click the [Install] button. The installation interface will pop up for installation.
Manual Script Activation¶
-
Log in to the Func console, click [Script Market], and enter the Guance script market. Search for
integration_aws_athena. -
Click [Install], then enter the corresponding parameters: AWS AK ID, AK Secret, and account name.
-
Click [Deploy Startup Script]. The system will automatically create a
Startupscript set and configure the corresponding startup scripts. -
After activation, you can see the corresponding automatic trigger configuration in "Manage / Automatic Trigger Configuration". Click [Execute] to immediately execute it once without waiting for the scheduled time. After a while, you can check the execution task records and corresponding logs.
Verification¶
- In "Manage / Automatic Trigger Configuration", confirm whether the corresponding task has the automatic trigger configuration. You can also check the corresponding task records and logs for any exceptions.
- In Guance, check if asset information exists in "Infrastructure - Resource Catalog".
- In Guance, check if there are corresponding monitoring data in "Metrics".
Metrics¶
AWS Athena Metrics are under the aws_athena collection. Below are descriptions of some metrics along with their units and statistical data.
| Metric | Description | Unit |
|---|---|---|
DPUAllocated |
Total number of DPUs (Data Processing Units) provisioned in capacity reservations for running queries | count |
DPUConsumed |
Number of DPUs actively consumed by queries in the RUNNING state within the given reservation time | count |
DPUCount |
Maximum number of DPUs consumed by a query, published only once when the query completes | count |
EngineExecutionTime |
Milliseconds spent running the query | ms |
ProcessedBytes |
Number of bytes scanned by Athena for each DML query | Bytes |
QueryPlanningTime |
Milliseconds spent by Athena planning the query processing flow | ms |
QueryQueueTime |
Milliseconds spent by the query waiting for resources in the query queue | ms |
ServicePreProcessingTime |
Milliseconds spent by Athena preprocessing the query before submitting it to the query engine | ms |
ServiceProcessingTime |
Milliseconds spent by Athena processing the query results after the query engine completes the query | ms |
TotalExecutionTime |
Milliseconds spent by Athena running a DDL or DML query | ms |