Configure Deployment Plan Data Forwarding¶

Introduction¶

This article will demonstrate how to configure Guance Deployment Plan data forwarding.

Prerequisites¶

• Guance has been fully initialized.
• You have an account with the necessary permissions for configuring users and storage buckets on the corresponding cloud provider.

Configuration Steps¶

Step One: Configure Storage Bucket and Account¶

Huawei Cloud¶

• Create a storage user
• Save the AK and SK, which will be configured in the service later.
• Create a parallel file system
• Configure file system access control

Alibaba Cloud¶

• Create a storage user
• Save the AK and SK, which will be configured in the service later.
• Create an OSS bucket
• Grant OSS bucket permissions to the created user

AWS¶

• Create an S3 bucket
• Create a user permission policy

  {
      "Version": "2012-10-17",
      "Statement": [
          {
              "Sid": "VisualEditor0",
              "Effect": "Allow",
              "Action": "s3:*",
              "Resource": [
                  "arn:aws:s3:::bucket-name",
                  "arn:aws:s3:::bucket-name/*"
              ]
          }
      ]
  }
  

  
• Create a storage user
• Attach the policy to the newly created user
• Create and save the AK and SK, which will be configured in the service later.

MinIO¶

• Create a storage bucket
• Create a policy

  {
      "Version": "2012-10-17",
      "Statement": [
          {
              "Effect": "Allow",
              "Action": [
                  "s3:*"
              ],
              "Resource": [
                  "arn:aws:s3:::bucketname",
                  "arn:aws:s3:::bucketname/*"
              ]
          }
      ]
  }
  

• Create a user and save the AK and SK, which will be configured in the service later.

Step Two: Modify Service Configuration¶

Modify the configuration of services like kodo, kodo-x to enable the dump configuration.

• Modify the ConfigMap resources named kodo, kodo-x, and kodo-inner under the forethought-kodo namespace. Add the following content:

Public cloud storage bucket configuration

backup_log:
  ${store_type}:
    ak: "LTAI5tMxxxxxxxxFroj"
    sk: "6MpS1gxxxxxxxxxxxxxxxxUoH6"
    region: "cn-northwest-1"
    bucket: "guance-backuplog"
  guance:
    store_type: "obs" 

1. ${store_type} can be chosen from oss, s3, or obs, corresponding to Alibaba Cloud, AWS, and Huawei Cloud storage bucket services respectively.
2. guance.store_type determines which cloud provider's storage service is actually used, and this value should match ${store_type}.
3. When ${store_type} is s3, there is an additional configuration item: partition. For AWS China, this value is aws-cn; for international AWS, it is aws.

backup_log:
  ${store_type}:
    ak: "LTAI5tMxxxxxxxxFroj"
    sk: "6MpS1gxxxxxxxxxxxxxxxxUoH6"
    endpoint: "xx.xx.com"
    bucket: "guance-backuplog"
  guance:
    store_type: "obs"

1. ${store_type} can be chosen from oss, s3, obs, or minio, corresponding to Alibaba Cloud, AWS, Huawei Cloud storage bucket services, and MinIO storage service respectively.
2. guance.store_type determines which cloud provider's storage service is actually used, and this value should match ${store_type}.
3. **endpoint**: In private cloud storage or dedicated cloud scenarios, an endpoint configuration needs to be added, with the value being the endpoint information for the storage bucket service. Do not include http:// or https://.

• After making changes, restart the kodo, kodo-x, kodo-inner, and kodo-x-backuplog services.

Step Three: Data Forwarding Configuration¶

After completing the above steps, log in to Guance to configure data forwarding. Once the configuration is complete, you can refer to Data Forwarding for verification.