跳转至

Solr

·

Solr 采集器，用于采集 Solr Cache 和 Request Times 等的统计信息。

配置

前置条件

  • DataKit 使用 Solr Metrics API 采集指标数据，支持 Solr 7.0 及以上版本。
  • 也可用于 Solr 6.6，但指标数据不完整。

已测试的版本：

  • 8.11.2
  • 7.0.0

采集器配置

进入 DataKit 安装目录下的 conf.d/db 目录，复制 solr.conf.sample 并命名为 solr.conf。示例如下：

[[inputs.solr]]
  ##(optional) collect interval, default is 10 seconds
  interval = '10s'

  ## specify a list of one or more Solr servers
  servers = ["http://localhost:8983"]

  ## Optional HTTP Basic Auth Credentials
  # username = "username"
  # password = "pa$$word"

  ## Set true to enable election
  election = true

  # [inputs.solr.log]
  # files = []
  # #grok pipeline script path
  # pipeline = "solr.p"

  [inputs.solr.tags]
  # some_tag = "some_value"
  # more_tag = "some_other_value"

配置好后，重启 DataKit 即可。

目前可以通过 ConfigMap 方式注入采集器配置来开启采集器。

如需采集 Solr 的日志，可在 solr.conf 中 将 files 打开，并写入 Solr 日志文件的绝对路径。比如：

[inputs.solr.log]
    # 填入绝对路径
    files = ["/path/to/demo.log"]

指标

以下所有数据采集，默认会追加全局选举 tag，也可以在配置中通过 [inputs.solr.tags] 指定其它标签：

 [inputs.solr.tags]
  # some_tag = "some_value"
  # more_tag = "some_other_value"
  # ...

solr_cache

  • 标签
Tag Description
category Category name.
core Solr core.
group Metric group.
host System hostname.
instance Instance name, generated based on server address.
name Cache name.
  • 指标列表
Metric Description
cumulative_evictions Number of cache evictions across all caches since this node has been running.
Type: int
Unit: count
cumulative_hitratio Ratio of cache hits to lookups across all the caches since this node has been running.
Type: float
Unit: percent,percent
cumulative_hits Number of cache hits across all the caches since this node has been running.
Type: int
Unit: count
cumulative_inserts Number of cache insertions across all the caches since this node has been running.
Type: int
Unit: count
cumulative_lookups Number of cache lookups across all the caches since this node has been running.
Type: int
Unit: count
evictions Number of cache evictions for the current index searcher.
Type: int
Unit: count
hitratio Ratio of cache hits to lookups for the current index searcher.
Type: float
Unit: percent,percent
hits Number of hits for the current index searcher.
Type: int
Unit: count
inserts Number of inserts into the cache.
Type: int
Unit: count
lookups Number of lookups against the cache.
Type: int
Unit: count
max_ram Maximum heap that should be used by the cache beyond which keys will be evicted.
Type: int
Unit: digital,MB
ram_bytes_used Actual heap usage of the cache at that particular instance.
Type: int
Unit: digital,B
size Number of entries in the cache at that particular instance.
Type: int
Unit: count
warmup Warm-up time for the registered index searcher. This time is taken in account for the "auto-warming" of caches.
Type: int
Unit: time,ms

solr_request_times

  • 标签
Tag Description
category Category name.
core Solr core.
group Metric group.
handler Request handler.
host System hostname.
instance Instance name, generated based on server address.
  • 指标列表
Metric Description
count Total number of requests made since the Solr process was started.
Type: int
Unit: count
max Max of all the request processing time.
Type: float
Unit: time,ms
mean Mean of all the request processing time.
Type: float
Unit: time,ms
median Median of all the request processing time.
Type: float
Unit: time,ms
min Min of all the request processing time.
Type: float
Unit: time,ms
p75 Request processing time for the request which belongs to the 75th Percentile.
Type: float
Unit: time,ms
p95 Request processing time in milliseconds for the request which belongs to the 95th Percentile.
Type: float
Unit: time,ms
p99 Request processing time in milliseconds for the request which belongs to the 99th Percentile.
Type: float
Unit: time,ms
p999 Request processing time in milliseconds for the request which belongs to the 99.9th Percentile.
Type: float
Unit: time,ms
rate_15min Requests per second received over the past 15 minutes.
Type: float
Unit: throughput,reqps
rate_1min Requests per second received over the past 1 minutes.
Type: float
Unit: throughput,reqps
rate_5min Requests per second received over the past 5 minutes.
Type: float
Unit: throughput,reqps
rate_mean Average number of requests per second received
Type: float
Unit: throughput,reqps
stddev Stddev of all the request processing time.
Type: float
Unit: time,ms

solr_searcher

  • 标签
Tag Description
category Category name.
core Solr core.
group Metric group.
host System hostname.
instance Instance name, generated based on server address.
  • 指标列表
Metric Description
deleted_docs The number of deleted documents.
Type: int
Unit: count
max_docs The largest possible document number.
Type: int
Unit: count
num_docs The total number of indexed documents.
Type: int
Unit: count
warmup The time spent warming up.
Type: int
Unit: time,ms

日志

切割日志示例：

2013-10-01 12:33:08.319 INFO (org.apache.solr.core.SolrCore) [collection1] webapp.reporter

切割后字段：

字段名 字段值
Reporter webapp.reporter
status INFO
thread org.apache.solr.core.SolrCore
time 1380630788319000000

文档评价

文档内容是否对您有帮助？ ×