HBase Master
Collect HBase Master Metrics Information
Configuration¶
1. HBase Master Configuration¶
1.1 Download jmx-exporter¶
Download URL: https://github.com/prometheus/jmx_exporter
1.2 Download JMX Script¶
Download URL: https://github.com/lrwh/jmx-exporter/blob/main/hbase.yaml
1.3 Adjust HBase Master Startup Parameters¶
Add the following parameters to the HBase Master startup parameters:
{JAVA_GC_ARGS} -javaagent:/opt/guance/jmx/jmx_exporter-1.0.1.jar=localhost:9406:/opt/guance/jmx/hbase.yaml
1.4 Restart HBase¶
2. DataKit Collector Configuration¶
2.1 Install DataKit¶
2.2 Configure Collector¶
The jmx-exporter can directly expose a metrics
URL, so you can use the Prometheus collector for collection.
Navigate to the conf.d/prom
directory under the DataKit installation directory, and copy prom.conf.sample
to master.conf
.
cp prom.conf.sample master.conf
Modify the content of master.conf
as follows:
urls = ["http://localhost:9406/metrics"]
source ="hbase-master"
[inputs.prom.tags]
component = "hbase-master"
interval = "10s"
Adjust other configurations as needed, parameter adjustment explanation:
- urls: The metrics URL exposed by
jmx-exporter
, fill in the corresponding component's metrics URL here. - source: Alias for the collector, it is recommended to distinguish them.
- keep_exist_metric_name: Keep metric names unchanged.
- interval: Collection interval.
- inputs.prom.tags: Add additional tags.
3. Restart DataKit¶
Metrics¶
Hadoop Measurement Set¶
HBase Master metrics are located under the Hadoop Measurement set. Below is an introduction to the relevant metrics for HBase Master.
Metrics | Description | Unit |
---|---|---|
hadoop_hbase_appendcount |
Count of append operations | count |
hadoop_hbase_appendsize_25th_percentile |
25th percentile value of append operation size | Byte |
hadoop_hbase_appendsize_75th_percentile |
75th percentile value of append operation size | Byte |
hadoop_hbase_appendsize_90th_percentile |
90th percentile value of append operation size | Byte |
hadoop_hbase_appendsize_95th_percentile |
95th percentile value of append operation size | Byte |
hadoop_hbase_appendsize_98th_percentile |
98th percentile value of append operation size | Byte |
hadoop_hbase_appendsize_99_9th_percentile |
99.9th percentile value of append operation size | Byte |
hadoop_hbase_appendsize_99th_percentile |
99th percentile value of append operation size | Byte |
hadoop_hbase_appendsize_max |
Maximum size of append operation | Byte |
hadoop_hbase_appendsize_mean |
Average size of append operation | Byte |
hadoop_hbase_appendsize_median |
Median size of append operation | Byte |
hadoop_hbase_appendsize_min |
Minimum size of append operation | Byte |
hadoop_hbase_appendsize_num_ops |
Number of append operations | count |
hadoop_hbase_assignfailedcount |
Count of failed assignments | count |
hadoop_hbase_assignsubmittedcount |
Count of submitted assignments | count |
hadoop_hbase_authenticationfailures |
Number of authentication failures | count |
hadoop_hbase_authenticationsuccesses |
Number of successful authentications | count |
hadoop_hbase_authorizationfailures |
Number of authorization failures | count |
hadoop_hbase_authorizationsuccesses |
Number of successful authorizations | count |
hadoop_hbase_averageload |
Average load | count |
hadoop_hbase_balancercluster_25th_percentile |
25th percentile value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_75th_percentile |
75th percentile value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_90th_percentile |
90th percentile value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_95th_percentile |
95th percentile value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_98th_percentile |
98th percentile value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_99_9th_percentile |
99.9th percentile value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_99th_percentile |
99th percentile value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_max |
Maximum value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_mean |
Average value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_median |
Median value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_min |
Minimum value of cluster balancing operations | ms |
hadoop_hbase_balancercluster_num_ops |
Number of cluster balancing operations | ms |
hadoop_hbase_closefailedcount |
Count of failed close operations | count |
hadoop_hbase_closesubmittedcount |
Count of submitted close operations | count |
hadoop_hbase_closetime_25th_percentile |
25th percentile value of close operation time | ms |
hadoop_hbase_closetime_75th_percentile |
75th percentile value of close operation time | ms |
hadoop_hbase_closetime_90th_percentile |
90th percentile value of close operation time | ms |
hadoop_hbase_closetime_95th_percentile |
95th percentile value of close operation time | ms |
hadoop_hbase_closetime_98th_percentile |
98th percentile value of close operation time | ms |
hadoop_hbase_closetime_99_9th_percentile |
99.9th percentile value of close operation time | ms |
hadoop_hbase_closetime_max |
Maximum time of close operation | ms |
hadoop_hbase_closetime_mean |
Average time of close operation | ms |
hadoop_hbase_closetime_median |
Median time of close operation | ms |
hadoop_hbase_closetime_min |
Minimum time of close operation | ms |
hadoop_hbase_closetime_num_ops |
Number of close operations | count |
hadoop_hbase_clusterrequests |
Number of cluster requests | count |
hadoop_hbase_deadserveropenregions |
Number of open regions on dead servers | count |
hadoop_hbase_droppedpuball |
Number of dropped PubAll | count |
hadoop_hbase_errorrollrequest |
Number of error roll request | count |
hadoop_hbase_exceptions |
Total number of exceptions | count |
hadoop_hbase_exceptions_callqueuetoobig |
Number of exceptions due to call queue being too large | count |
hadoop_hbase_exceptions_failedsanitycheckexception |
Number of failed sanity check exceptions | count |
hadoop_hbase_exceptions_multiresponsetoolarge |
Number of multi-response too large exceptions | count |
hadoop_hbase_exceptions_notservingregionexception |
Number of region not serving exceptions | count |
hadoop_hbase_exceptions_otherexceptions |
Number of other exceptions | count |
hadoop_hbase_exceptions_outoforderscannernextexception |
Number of out-of-order scanner next exceptions | count |
hadoop_hbase_exceptions_quotaexceeded |
Number of quota exceeded exceptions | count |
hadoop_hbase_exceptions_regionmovedexception |
Number of region moved exceptions | count |
hadoop_hbase_exceptions_regiontoobusyexception |
Number of region too busy exceptions | count |
hadoop_hbase_exceptions_requesttoobig |
Number of request too big exceptions | count |
hadoop_hbase_exceptions_rpcthrottling |
Number of RPC throttling exceptions | count |
hadoop_hbase_exceptions_scannerresetexception |
Number of scanner reset exceptions | count |
hadoop_hbase_exceptions_unknownscannerexception |
Number of unknown scanner exceptions | count |
hadoop_hbase_fschecksumfailurecount |
Count of file system checksum failures | count |
hadoop_hbase_fspreadtime_25th_percentile |
25th percentile value of file system propagation time | ms |
hadoop_hbase_fspreadtime_75th_percentile |
75th percentile value of file system propagation time | ms |
hadoop_hbase_fspreadtime_90th_percentile |
90th percentile value of file system propagation time | ms |
hadoop_hbase_fspreadtime_95th_percentile |
95th percentile value of file system propagation time | ms |
hadoop_hbase_fspreadtime_98th_percentile |
98th percentile value of file system propagation time | ms |
hadoop_hbase_fspreadtime_99_9th_percentile |
99.9th percentile value of file system propagation time | ms |
hadoop_hbase_fspreadtime_99th_percentile |
99th percentile value of file system propagation time | ms |
hadoop_hbase_fspreadtime_max |
Maximum time of file system propagation | ms |
hadoop_hbase_fspreadtime_mean |
Average time of file system propagation | ms |
hadoop_hbase_fspreadtime_median |
Median time of file system propagation | ms |
hadoop_hbase_fspreadtime_min |
Minimum time of file system propagation | ms |
hadoop_hbase_fspreadtime_num_ops |
Number of file system propagation operations | count |
hadoop_hbase_fsreadtime_25th_percentile |
25th percentile value of file system read time | ms |
hadoop_hbase_fsreadtime_75th_percentile |
75th percentile value of file system read time | ms |
hadoop_hbase_fsreadtime_90th_percentile |
90th percentile value of file system read time | ms |
hadoop_hbase_fsreadtime_95th_percentile |
95th percentile value of file system read time | ms |
hadoop_hbase_fsreadtime_98th_percentile |
98th percentile value of file system read time | ms |
hadoop_hbase_fsreadtime_99_9th_percentile |
99.9th percentile value of file system read time | ms |
hadoop_hbase_fsreadtime_99th_percentile |
99th percentile value of file system read time | ms |
hadoop_hbase_fsreadtime_max |
Maximum time of file system read | ms |
hadoop_hbase_fsreadtime_mean |
Average time of file system read | ms |
hadoop_hbase_fsreadtime_median |
Median time of file system read | ms |
hadoop_hbase_fsreadtime_min |
Minimum time of file system read | ms |
hadoop_hbase_fspreadtime_min |
Number of file system read operations | ms |
hadoop_hbase_fswritetime_25th_percentile |
25th percentile value of file system write time | ms |
hadoop_hbase_fswritetime_75th_percentile |
75th percentile value of file system write time | ms |
hadoop_hbase_fswritetime_90th_percentile |
90th percentile value of file system write time | ms |
hadoop_hbase_fswritetime_95th_percentile |
95th percentile value of file system write time | ms |
hadoop_hbase_fswritetime_98th_percentile |
98th percentile value of file system write time | ms |
hadoop_hbase_fswritetime_99_9th_percentile |
99.9th percentile value of file system write time | ms |
hadoop_hbase_fswritetime_99th_percentile |
99th percentile value of file system write time | ms |
hadoop_hbase_fswritetime_max |
Maximum time of file system write | ms |
hadoop_hbase_fswritetime_mean |
Average time of file system write | ms |
hadoop_hbase_fswritetime_median |
Median time of file system write | ms |
Note: There is a duplicate entry for hadoop_hbase_fspreadtime_min
which appears twice in the table. One entry should be corrected to hadoop_hbase_fsreadtime_min
.