HBase Region
Collect HBase Region metrics
Configuration¶
1. HBase Region Configuration¶
1.1 Download jmx-exporter¶
Download link: https://github.com/prometheus/jmx_exporter
1.2 Download jmx script¶
Download link: https://github.com/lrwh/jmx-exporter/blob/main/hbase.yaml
1.3 Adjust HBase Region startup parameters¶
Add the following to the HBase Region startup parameters:
{JAVA_GC_ARGS} -javaagent:/opt/jmx/jmx_exporter-1.0.1.jar=localhost:9407:/opt/jmx/hbase.yaml
1.4 Restart HBase¶
2. DataKit Collector Configuration¶
2.1 Install DataKit¶
2.2 Configure the collector¶
Since jmx-exporter directly exposes the metrics
URL, it can be collected directly using the prom collector.
Navigate to the conf.d/prom
directory under the DataKit installation directory, and copy prom.conf.sample
to region.conf
.
cp prom.conf.sample region.conf
Adjust the content of region.conf
as follows:
urls = ["http://localhost:9407/metrics"]
source ="hbase-region"
[inputs.prom.tags]
component = "hbase-region"
interval = "10s"
Adjust other configurations as needed, parameter description:
- urls: The
jmx-exporter
metrics URL, fill in the metrics URL exposed by the corresponding component - source: Collector alias, recommended for differentiation
- keep_exist_metric_name: Keep the metric name
- interval: Collection interval
- inputs.prom.tags: Add additional tags
3. Restart DataKit¶
Metrics¶
Hadoop Measurement¶
HBase Region metrics are located under the Hadoop Measurement. Here, we mainly introduce the HBase Region related metrics.
Metrics | Description | Unit |
---|---|---|
hadoop_hbase_regionCount |
Number of regions hosted by the region server |
count |
hadoop_hbase_storeFileCount |
Number of store files on disk currently managed by the regionserver |
count |
hadoop_hbase_storeFileSize |
Aggregate size of store files on disk |
byte |
hadoop_hbase_hlogFileCount |
Number of write-ahead logs that have not been archived |
count |
hadoop_hbase_totalRequestCount |
Total number of requests received |
count |
hadoop_hbase_readRequestCount |
Number of read requests received |
count |
hadoop_hbase_writeRequestCount |
Number of write requests received |
count |
hadoop_hbase_numOpenConnections |
Number of open connections in the RPC layer |
count |
hadoop_hbase_numActiveHandler |
Number of RPC handlers actively serving requests |
count |
hadoop_hbase_numCallsInGeneralQueue |
Number of currently queued user requests |
count |
hadoop_hbase_numCallsInReplicationQueue |
Number of currently queued operations received from replication |
count |
hadoop_hbase_numCallsInPriorityQueue |
Number of currently queued priority (internal housekeeping) requests |
count |
hadoop_hbase_flushQueueLength |
Current depth of the memstore flush queue |
count |
hadoop_hbase_updatesBlockedTime |
Milliseconds updates have been blocked so the memstore can be flushed |
ms |
hadoop_hbase_compactionQueueLength |
Current depth of the compaction request queue |
count |
hadoop_hbase_blockCacheHitCount |
Number of block cache hits |
count |
hadoop_hbase_blockCacheMissCount |
Current depth of the memstore flush queue |
count |
hadoop_hbase_blockCacheExpressHitPercent |
Percentage of time open cache requests hit the cache |
count |
hadoop_hbase_percentFilesLocal |
Percentage of store file data that can be read from the local DataNode |
count |
hadoop_hbase_append_99th_percentile |
99th percentile value of Append operation time |
ms |
hadoop_hbase_delete_99th_percentile |
99th percentile value of Delete operation time |
ms |
hadoop_hbase_get_99th_percentile |
99th percentile value of Get operation time |
ms |
hadoop_hbase_checkandput_99th_percentile |
99th percentile value of CheckAndPut operation time |
ms |
hadoop_hbase_checkanddelete_99th_percentile |
99th percentile value of CheckAndDelete operation time |
ms |
hadoop_hbase_increment_99th_percentile |
99th percentile value of Increment operation time |
ms |
hadoop_hbase_hedgedreadwins |
Number of successful hedged read operations |
count |
hadoop_hbase_hedgedreads |
Total number of hedged read operations |
count |
hadoop_hbase_hedgedreadopsincurthread |
Number of hedged read operations in the current thread |
count |
hadoop_hbase_l1cachehitratio |
Hit ratio of the L1 cache |
% |
hadoop_hbase_l1cachemissratio |
Miss ratio of the L1 cache |
% |
hadoop_hbase_l2cachehitratio |
Hit ratio of the L2 cache |
% |
hadoop_hbase_l2cachemissratio |
Miss ratio of the L2 cache |
% |
hadoop_hbase_logerror |
Number of logged errors |
count |
hadoop_hbase_logfatal |
Number of logged fatal errors |
count |
hadoop_hbase_loginfo |
Number of logged info-level logs |
count |
hadoop_hbase_logwarn |
Number of logged warnings |
count |
hadoop_hbase_majorcompactiontime_max |
Maximum time of compaction operations |
ms |
hadoop_hbase_majorcompactiontime_mean |
Average time of compaction operations |
ms |
hadoop_hbase_majorcompactiontime_median |
Median time of compaction operations |
ms |
hadoop_hbase_majorcompactiontime_min |
Minimum time of compaction operations |
ms |
hadoop_hbase_maxstorefileage |
Maximum store file age |
count |
hadoop_hbase_memheapcommittedm |
Amount of committed memory in the heap |
MB |
hadoop_hbase_memheapmaxm |
Maximum amount of heap memory |
MB |
hadoop_hbase_memheapusedm |
Amount of used memory in the heap |
MB |
hadoop_hbase_memmaxm |
Maximum amount of total memory |
MB |
hadoop_hbase_memnonheapcommittedm |
Amount of committed memory in the non-heap |
MB |
hadoop_hbase_memnonheapmaxm |
Maximum amount of non-heap memory |
MB |
hadoop_hbase_memnonheapusedm |
Amount of used memory in the non-heap |
MB |
hadoop_hbase_mobfilecachehitpercent |
Hit ratio percentage of the MOB file cache |
% |
hadoop_hbase_mutationswithoutwalcount |
Number of mutations without write-ahead log (WAL) |
count |
hadoop_hbase_averageregionsize |
Average size of regions |
MB |
hadoop_hbase_avgstorefileage |
Average age of store files |
ms |
hadoop_hbase_blockcachecount |
Total number of blocks in the block cache |
count |
hadoop_hbase_blockcachecounthitpercent |
Hit ratio percentage of the block cache |
% |
hadoop_hbase_blockcachedatahitcount |
Number of data block hits in the block cache |
count |
hadoop_hbase_blockcacheevictioncount |
Number of evictions in the block cache |
count |
hadoop_hbase_blockcachehitcount |
Number of hits in the block cache |
count |
hadoop_hbase_blockcachemisscount |
Number of misses in the block cache |
count |
hadoop_hbase_compactioninputfilecount_99th_percentile |
99th percentile value of the number of input files for compaction operations |
count |
hadoop_hbase_compactionoutputfilecount_99th_percentile |
99th percentile value of the number of output files for compaction operations |
count |
hadoop_hbase_compactiontime_99th_percentile |
99th percentile value of compaction operation time |
ms |
hadoop_hbase_flushedmemstorebytes |
Number of bytes flushed from MemStore |
byte |
hadoop_hbase_flushedoutputbytes |
Number of bytes flushed from output |
byte |
hadoop_hbase_flushmemstoresize_99th_percentile |
99th percentile value of MemStore flush size |
byte |
hadoop_hbase_flushoutputsize_99th_percentile |
99th percentile value of output flush size |
byte |
hadoop_hbase_flushtime_99th_percentile |
99th percentile value of flush operation time |
ms |
hadoop_hbase_get_25th_percentile |
25th percentile value of Get operation time |
ms |
hadoop_hbase_slowappendcount |
Number of slow Append operations |
count |
hadoop_hbase_slowdeletecount |
Number of slow Delete operations |
count |
hadoop_hbase_slowgetcount |
Number of slow Get operations |
count |
hadoop_hbase_slowincrementcount |
Number of slow Increment operations |
count |
hadoop_hbase_slowputcount |
Number of slow Put operations |
count |
hadoop_hbase_snapshotavgtime |
Average time of snapshot operations |
ms |
hadoop_hbase_snapshotnumops |
Total number of snapshot operations |
count |
hadoop_hbase_source_logeditsread |
Number of log edits read by the Source |
count |
hadoop_hbase_source_shippedbytes |
Number of bytes shipped by the Source |
byte |
hadoop_hbase_source_shippedops |
Number of operations shipped by the Source |
count |
hadoop_hbase_splitreuestcount |
Number of split requests |
count |
hadoop_hbase_splitsuccesscount |
Total number of successful splits |
count |
hadoop_hbase_staticbloomsize |
Size of the static Bloom filter |
count |
hadoop_hbase_staticindexsize |
Size of the static index |
count |
hadoop_hbase_storefileindexsize |
Size of the store file index |
count |
hadoop_hbase_storefilesize |
Size of the store file |
count |
hadoop_hbase_successfullogrolls |
Number of successful log rolls |
count |
hadoop_hbase_synctime_99th_percentile |
99th percentile value of sync operation time |
ms |
hadoop_hbase_tunerdonothingcounter |
Number of times the tuner did nothing |
count |
hadoop_hbase_updatesblockedtime |
Time updates were blocked |
ms |
hadoop_hbase_writereuestcount |
Total number of write requests |
count |
hadoop_hbase_writtenbytes |
Total number of bytes written |
byte |
hadoop_hbase_zerocopybytesread |
Number of bytes read with zero-copy |
byte |