Skip to content

HBase Region

Collect HBase Region metrics

Configuration

1. HBase Region Configuration

1.1 Download jmx-exporter

Download link: https://github.com/prometheus/jmx_exporter

1.2 Download jmx script

Download link: https://github.com/lrwh/jmx-exporter/blob/main/hbase.yaml

1.3 Adjust HBase Region startup parameters

Add the following to the HBase Region startup parameters:

{JAVA_GC_ARGS} -javaagent:/opt/jmx/jmx_exporter-1.0.1.jar=localhost:9407:/opt/jmx/hbase.yaml

1.4 Restart HBase

2. DataKit Collector Configuration

2.1 Install DataKit

2.2 Configure the collector

Since jmx-exporter directly exposes the metrics URL, it can be collected directly using the prom collector.

Navigate to the conf.d/prom directory under the DataKit installation directory, and copy prom.conf.sample to region.conf.

cp prom.conf.sample region.conf

Adjust the content of region.conf as follows:

  urls = ["http://localhost:9407/metrics"]
  source ="hbase-region"
  [inputs.prom.tags]
    component = "hbase-region" 
  interval = "10s"

Adjust other configurations as needed, parameter description:

  • urls: The jmx-exporter metrics URL, fill in the metrics URL exposed by the corresponding component
  • source: Collector alias, recommended for differentiation
  • keep_exist_metric_name: Keep the metric name
  • interval: Collection interval
  • inputs.prom.tags: Add additional tags

3. Restart DataKit

Restart Datakit

Metrics

Hadoop Measurement

HBase Region metrics are located under the Hadoop Measurement. Here, we mainly introduce the HBase Region related metrics.

Metrics Description Unit
hadoop_hbase_regionCount Number of regions hosted by the region server count
hadoop_hbase_storeFileCount Number of store files on disk currently managed by the regionserver count
hadoop_hbase_storeFileSize Aggregate size of store files on disk byte
hadoop_hbase_hlogFileCount Number of write-ahead logs that have not been archived count
hadoop_hbase_totalRequestCount Total number of requests received count
hadoop_hbase_readRequestCount Number of read requests received count
hadoop_hbase_writeRequestCount Number of write requests received count
hadoop_hbase_numOpenConnections Number of open connections in the RPC layer count
hadoop_hbase_numActiveHandler Number of RPC handlers actively serving requests count
hadoop_hbase_numCallsInGeneralQueue Number of currently queued user requests count
hadoop_hbase_numCallsInReplicationQueue Number of currently queued operations received from replication count
hadoop_hbase_numCallsInPriorityQueue Number of currently queued priority (internal housekeeping) requests count
hadoop_hbase_flushQueueLength Current depth of the memstore flush queue count
hadoop_hbase_updatesBlockedTime Milliseconds updates have been blocked so the memstore can be flushed ms
hadoop_hbase_compactionQueueLength Current depth of the compaction request queue count
hadoop_hbase_blockCacheHitCount Number of block cache hits count
hadoop_hbase_blockCacheMissCount Current depth of the memstore flush queue count
hadoop_hbase_blockCacheExpressHitPercent Percentage of time open cache requests hit the cache count
hadoop_hbase_percentFilesLocal Percentage of store file data that can be read from the local DataNode count
hadoop_hbase_append_99th_percentile 99th percentile value of Append operation time ms
hadoop_hbase_delete_99th_percentile 99th percentile value of Delete operation time ms
hadoop_hbase_get_99th_percentile 99th percentile value of Get operation time ms
hadoop_hbase_checkandput_99th_percentile 99th percentile value of CheckAndPut operation time ms
hadoop_hbase_checkanddelete_99th_percentile 99th percentile value of CheckAndDelete operation time ms
hadoop_hbase_increment_99th_percentile 99th percentile value of Increment operation time ms
hadoop_hbase_hedgedreadwins Number of successful hedged read operations count
hadoop_hbase_hedgedreads Total number of hedged read operations count
hadoop_hbase_hedgedreadopsincurthread Number of hedged read operations in the current thread count
hadoop_hbase_l1cachehitratio Hit ratio of the L1 cache %
hadoop_hbase_l1cachemissratio Miss ratio of the L1 cache %
hadoop_hbase_l2cachehitratio Hit ratio of the L2 cache %
hadoop_hbase_l2cachemissratio Miss ratio of the L2 cache %
hadoop_hbase_logerror Number of logged errors count
hadoop_hbase_logfatal Number of logged fatal errors count
hadoop_hbase_loginfo Number of logged info-level logs count
hadoop_hbase_logwarn Number of logged warnings count
hadoop_hbase_majorcompactiontime_max Maximum time of compaction operations ms
hadoop_hbase_majorcompactiontime_mean Average time of compaction operations ms
hadoop_hbase_majorcompactiontime_median Median time of compaction operations ms
hadoop_hbase_majorcompactiontime_min Minimum time of compaction operations ms
hadoop_hbase_maxstorefileage Maximum store file age count
hadoop_hbase_memheapcommittedm Amount of committed memory in the heap MB
hadoop_hbase_memheapmaxm Maximum amount of heap memory MB
hadoop_hbase_memheapusedm Amount of used memory in the heap MB
hadoop_hbase_memmaxm Maximum amount of total memory MB
hadoop_hbase_memnonheapcommittedm Amount of committed memory in the non-heap MB
hadoop_hbase_memnonheapmaxm Maximum amount of non-heap memory MB
hadoop_hbase_memnonheapusedm Amount of used memory in the non-heap MB
hadoop_hbase_mobfilecachehitpercent Hit ratio percentage of the MOB file cache %
hadoop_hbase_mutationswithoutwalcount Number of mutations without write-ahead log (WAL) count
hadoop_hbase_averageregionsize Average size of regions MB
hadoop_hbase_avgstorefileage Average age of store files ms
hadoop_hbase_blockcachecount Total number of blocks in the block cache count
hadoop_hbase_blockcachecounthitpercent Hit ratio percentage of the block cache %
hadoop_hbase_blockcachedatahitcount Number of data block hits in the block cache count
hadoop_hbase_blockcacheevictioncount Number of evictions in the block cache count
hadoop_hbase_blockcachehitcount Number of hits in the block cache count
hadoop_hbase_blockcachemisscount Number of misses in the block cache count
hadoop_hbase_compactioninputfilecount_99th_percentile 99th percentile value of the number of input files for compaction operations count
hadoop_hbase_compactionoutputfilecount_99th_percentile 99th percentile value of the number of output files for compaction operations count
hadoop_hbase_compactiontime_99th_percentile 99th percentile value of compaction operation time ms
hadoop_hbase_flushedmemstorebytes Number of bytes flushed from MemStore byte
hadoop_hbase_flushedoutputbytes Number of bytes flushed from output byte
hadoop_hbase_flushmemstoresize_99th_percentile 99th percentile value of MemStore flush size byte
hadoop_hbase_flushoutputsize_99th_percentile 99th percentile value of output flush size byte
hadoop_hbase_flushtime_99th_percentile 99th percentile value of flush operation time ms
hadoop_hbase_get_25th_percentile 25th percentile value of Get operation time ms
hadoop_hbase_slowappendcount Number of slow Append operations count
hadoop_hbase_slowdeletecount Number of slow Delete operations count
hadoop_hbase_slowgetcount Number of slow Get operations count
hadoop_hbase_slowincrementcount Number of slow Increment operations count
hadoop_hbase_slowputcount Number of slow Put operations count
hadoop_hbase_snapshotavgtime Average time of snapshot operations ms
hadoop_hbase_snapshotnumops Total number of snapshot operations count
hadoop_hbase_source_logeditsread Number of log edits read by the Source count
hadoop_hbase_source_shippedbytes Number of bytes shipped by the Source byte
hadoop_hbase_source_shippedops Number of operations shipped by the Source count
hadoop_hbase_splitreuestcount Number of split requests count
hadoop_hbase_splitsuccesscount Total number of successful splits count
hadoop_hbase_staticbloomsize Size of the static Bloom filter count
hadoop_hbase_staticindexsize Size of the static index count
hadoop_hbase_storefileindexsize Size of the store file index count
hadoop_hbase_storefilesize Size of the store file count
hadoop_hbase_successfullogrolls Number of successful log rolls count
hadoop_hbase_synctime_99th_percentile 99th percentile value of sync operation time ms
hadoop_hbase_tunerdonothingcounter Number of times the tuner did nothing count
hadoop_hbase_updatesblockedtime Time updates were blocked ms
hadoop_hbase_writereuestcount Total number of write requests count
hadoop_hbase_writtenbytes Total number of bytes written byte
hadoop_hbase_zerocopybytesread Number of bytes read with zero-copy byte

Feedback

Is this page helpful? ×