跳转至

金山云 Elasticsearch

采集金山云 Elasticsearch 集群监控数据。

配置

前置条件

请提前准备好符合要求的金山云 AK ID、AK Secret，并授予采集所需服务的只读权限。

安装 Func

推荐开通 观测云集成 - 扩展 - 托管版 Func: 一切前置条件都自动安装好, 请继续脚本安装

如果自行部署 Func 参考自行部署 Func

安装脚本

  1. 登陆 Func 控制台，点击【脚本市场】，进入观测云脚本市场，搜索 integration_kingsoftcloud_elasticsearch
  2. 点击【安装】后，输入相应的参数：金山云 AK ID、AK Secret 及账户名
  3. 点击【部署启动脚本】，系统会自动创建 Startup 脚本集，并自动配置相应的启动脚本
  4. 开启后可以在「管理 / 自动触发配置」里看到对应的自动触发配置。点击【执行】，即可立即执行一次，无需等待定期时间。稍等片刻，可以查看执行任务记录以及对应日志

验证

  1. 在「管理 / 自动触发配置」确认对应的任务是否已存在对应的自动触发配置，同时可以查看对应任务记录及日志检查是否有异常
  2. 在观测云，「基础设施 - 资源目录」中查看是否存在资产信息
  3. 在观测云，「指标」查看是否有对应监控数据

指标

配置好金山云云监控后，默认的指标集如下，可以通过配置的方式采集更多指标。金山云 Elasticsearch 监控指标位于 kingsoftcloud_kes 指标集。

MetricName MetricDescribe Dimensions Unit
elasticsearch_cluster_health_active_primary_shards_average 平均活跃主分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_active_primary_shards_max 最大活跃主分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_active_primary_shards_min 最小活跃主分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_active_shards_average 平均活跃分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_active_shards_max 最大活跃分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_active_shards_min 最小活跃分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_initializing_shards_average 平均初始化中分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_initializing_shards_max 最大初始化中分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_initializing_shards_min 最小初始化中分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_number_of_data_nodes_average 平均数据节点数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_number_of_data_nodes_max 最大数据节点数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_number_of_data_nodes_min 最小数据节点数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_number_of_nodes_average 平均总节点数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_number_of_nodes_max 最大总节点数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_number_of_nodes_min 最小总节点数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_number_of_pending_tasks_average 平均待处理任务数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_number_of_pending_tasks_max 最大待处理任务数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_number_of_pending_tasks_min 最小待处理任务数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_relocating_shards_average 平均迁移中分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_relocating_shards_max 最大迁移中分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_relocating_shards_min 最小迁移中分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_status_average 平均集群健康状态 region_id, account_name, cluster_id, cloud_provider, cluster_name -
elasticsearch_cluster_health_status_max 最大集群健康状态 region_id, account_name, cluster_id, cloud_provider, cluster_name -
elasticsearch_cluster_health_status_min 最小集群健康状态 region_id, account_name, cluster_id, cloud_provider, cluster_name -
elasticsearch_cluster_health_unassigned_shards_average 平均未分配分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_unassigned_shards_max 最大未分配分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_cluster_health_unassigned_shards_min 最小未分配分片数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_filesystem_data_available_bytes_average 平均可用磁盘空间 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_filesystem_data_available_bytes_max 最大可用磁盘空间 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_filesystem_data_available_bytes_min 最小可用磁盘空间 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_filesystem_io_stats_device_read_size_kilobytes_sum_average 平均磁盘读取数据量 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_filesystem_io_stats_device_read_size_kilobytes_sum_max 最大磁盘读取数据量 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_filesystem_io_stats_device_read_size_kilobytes_sum_min 最小磁盘读取数据量 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_filesystem_io_stats_device_write_size_kilobytes_sum_average 平均磁盘写入数据量 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_filesystem_io_stats_device_write_size_kilobytes_sum_max 最大磁盘写入数据量 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_filesystem_io_stats_device_write_size_kilobytes_sum_min 最小磁盘写入数据量 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_heap_memtory_usage_average 平均堆内存使用率 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_heap_memtory_usage_max 最大堆内存使用率 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_heap_memtory_usage_min 最小堆内存使用率 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_indices_docs_nums_average 平均文档写入 QPS region_id, account_name, cluster_id, cloud_provider, cluster_name -
elasticsearch_indices_docs_nums_max 最大文档写入 QPS region_id, account_name, cluster_id, cloud_provider, cluster_name -
elasticsearch_indices_docs_nums_min 最小文档写入 QPS region_id, account_name, cluster_id, cloud_provider, cluster_name -
elasticsearch_indices_indexing_index_total_average 平均索引总数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_indices_indexing_index_total_max 最大索引总数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_indices_indexing_index_total_min 最小索引总数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_indices_search_query_total_average 平均索引搜索请求总数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_indices_search_query_total_max 最大索引搜索请求总数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_indices_search_query_total_min 最小索引搜索请求总数 region_id, account_name, cluster_id, cloud_provider, cluster_name count
elasticsearch_jvm_gc_collection_seconds_count_average 平均GC 执行次数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id count
elasticsearch_jvm_gc_collection_seconds_count_max 最大GC 执行次数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id count
elasticsearch_jvm_gc_collection_seconds_count_min 最小GC 执行次数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id count
elasticsearch_jvm_gc_collection_seconds_sum_average 平均GC 总运行时间 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id s
elasticsearch_jvm_gc_collection_seconds_sum_max 最大GC 总运行时间 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id s
elasticsearch_jvm_gc_collection_seconds_sum_min 最小GC 总运行时间 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id s
elasticsearch_jvm_memory_used_bytes_average 平均Elasticsearch 进程内存用量 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_jvm_memory_used_bytes_max 最大Elasticsearch 进程内存用量 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_jvm_memory_used_bytes_min 最小Elasticsearch 进程内存用量 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id B
elasticsearch_os_load_15_average 平均15 分钟系统负载 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_os_load_15_max 最大15 分钟系统负载 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_os_load_15_min 最小15 分钟系统负载 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_os_load_1_average 平均1 分钟系统负载 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_os_load_1_max 最大1 分钟系统负载 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_os_load_1_min 最小1 分钟系统负载 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_os_load_5_average 平均5 分钟系统负载 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_os_load_5_max 最大5 分钟系统负载 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_os_load_5_min 最小5 分钟系统负载 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id percent
elasticsearch_process_cpu_percent_average 平均Elasticsearch 进程 CPU 使用率 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id count
elasticsearch_process_cpu_percent_max 最大Elasticsearch 进程 CPU 使用率 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id count
elasticsearch_process_cpu_percent_min 最小Elasticsearch 进程 CPU 使用率 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id count
elasticsearch_thread_pool_queue_count_read_average 平均读线程池队列数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_queue_count_read_max 最大读线程池队列数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_queue_count_read_min 最小读线程池队列数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_queue_count_write_average 平均写线程池队列数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_queue_count_write_max 最大写线程池队列数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_queue_count_write_min 最小写线程池队列数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_rejected_count_read_average 平均读线程池拒绝数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_rejected_count_read_max 最大读线程池拒绝数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_rejected_count_read_min 最小读线程池拒绝数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_rejected_count_write_average 平均写线程池拒绝数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_rejected_count_write_max 最大写线程池拒绝数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -
elasticsearch_thread_pool_rejected_count_write_min 最小写线程池拒绝数 region_id, account_name, instance_id, internal_ip, instance_name, node_id, cluster_id, domain, cloud_provider, cluster_name, instance_group_id -

对象

采集到的金山云 Elasticsearch 对象数据结构，可以从「基础设施 - 资源目录」里看到对象数据。

{
  "measurement": "kingsoftcloud_kes",
  "tags": {
    "account_name": "example-account",
    "cloud_provider": "kingsoftcloud",
    "region_id": "cn-beijing-6",
    "cluster_id": "xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx",
    "cluster_name": "example-elasticsearch",
    "cluster_status": "RUNNING"
  },
  "fields": {
    "availability_zone": "cn-beijing-6a",
    "charge_type": "Daily",
    "main_version": "OpenSource-7.10.0",
    "enable_eip": true,
    "vpc_domain_id": "xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx",
    "vpc_subnet_id": "xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx",
    "private_links": "{访问地址}",
    "public_links": "{访问地址}",
    "instance_groups": "{实例组配置}",
    "cluster_create_time": "2025-01-14 06:45:39",
    "last_update_time": 1784599020782
  }
}

注意：tags、fields 中的字段可能会随后续更新有所变动。

文档评价

文档内容是否对您有帮助？