Skip to content

AWS Bedrock

Collect monitoring data from AWS Bedrock.

Configuration

Install Func

We recommend enabling the hosted Func service under Guance Integrations - Extensions. All prerequisites are installed automatically. Then proceed to install the script.

To deploy Func yourself, see Self-hosted Func.

Enable the Script

Tip: Prepare the required AWS access key in advance. For simplicity, you can grant the global read-only permission ReadOnlyAccess.

Enable the Script in Hosted Func

  1. Sign in to the Guance console.
  2. Open the Integrations menu and select Cloud Account Management.
  3. Click Add Cloud Account, select AWS, and enter the required information. Skip this step if the cloud account is already configured.
  4. Click Test. If the test succeeds, click Save. If it fails, verify the configuration and test again.
  5. In Cloud Account Management, find the added cloud account and click it to open its details.
  6. Click Integrations on the cloud account details page. Find AWS Bedrock in the Not Installed list, click Install, and complete installation in the dialog.

Enable the Script Manually

  1. Sign in to the Func console, click Script Market to open the Guance script market, and search for integration_aws_cloudwatch
  2. Click Install, then enter the parameters: AWS AK ID, AK Secret, and account name.
  3. Click Deploy Startup Script. The system automatically creates the Startup script set and configures the startup script. In collector_configs, set regions to the actual regions and change targets to the metric configuration for AWS/Bedrock. Then publish and enable automatic triggers.
  4. Once enabled, the automatic trigger appears under Management / Automatic Trigger Configuration. Click Execute to run it immediately without waiting for the next scheduled time. After a short wait, check the task execution records and logs.

Verification

  1. Under Management / Automatic Trigger Configuration, confirm that the task has a corresponding automatic trigger. Check its task records and logs for errors.
  2. In Guance, open Metrics and check for the monitoring data.

Metrics

After configuring AWS cloud monitoring, the default metrics are listed below. You can configure collection of additional metrics. The measurement is aws_bedrock. AWS Bedrock Metric Details

MetricName MetricDescribe Dimensions Unit
input_token_count_sum Total input tokens region_id, model_id, context_window count
invocation_latency_average Average latency from sending the request to receiving the last token region_id, model_id, context_window ms
invocation_server_errors_sum Invocations with AWS server errors region_id, model_id count
invocation_throttles_sum Throttled invocations region_id, model_id count
invocations_sum Requests accepted for processing region_id, model_id, context_window count
output_token_count_sum Total output tokens region_id, model_id, context_window count

Feedback

Is this page helpful?