HBase Master
Collect HBase Master metric information
Config¶
1.HBase Master Configuration¶
1.1 Download jmx-exporter¶
Download link:https://github.com/prometheus/jmx_exporter
1.2 Download jmx script¶
Download link:https://github.com/lrwh/jmx-exporter/blob/main/hbase.yaml
1.3 HBase Master Start parameter adjustment¶
Adding startup parameters to HBase Master
{{JAVA_GC_ARGS}} -javaagent:/opt/guance/jmx/jmx_exporter-1.0.1.jar=localhost:9406:/opt/guance/jmx/hbase.yaml
1.4 Restart HBase¶
2. DataKit Collector Configuration¶
2.1 Install DataKit¶
2.2 Configure collector¶
By using jmx exporter, the metrics
URL can be directly exposed, so it can be collected directly through the prom collector.
Go to the conf.d/prom
directory under the DataKit installation directory, and copy prom.conf.sample
to master.conf
.
cp prom.conf.sample master.conf
Adjust the content of master.conf
as follows:
urls = ["http://localhost:9406/metrics"]
source ="hbase-master"
[inputs.prom.tags]
component = "hbase-master"
interval = "10s"
Adjust other configurations as needed,parameter adjustment instructions :
- urls:
jmx-exporter
metric address, fill in the URL of the metric exposed by the corresponding component here - source:Collector alias, it is recommended to make a distinction
- keep_exist_metric_name: Maintain metric name
- interval:Collection interval
- inputs.prom.tags: Add additional tags
3. Restart DataKit¶
Metric¶
Hadoop Metric Set¶
The HBase Master metric is located under the Hadoop metric set, and here we mainly introduce the description of HBase Master related metrics
Metrics | Description | Unit |
---|---|---|
hadoop_hbase_appendcount |
Count of additional operations |
count |
hadoop_hbase_appendsize_25th_percentile |
Add the 25th percentile value of the operation size |
Byte |
hadoop_hbase_appendsize_75th_percentile |
Add the 75th percentile value of the operation size |
Byte |
hadoop_hbase_appendsize_90th_percentile |
Add the 90th percentile value of the operation size |
Byte |
hadoop_hbase_appendsize_95th_percentile |
Add the 95th percentile value of the operation size |
Byte |
hadoop_hbase_appendsize_98th_percentile |
Add the 98th percentile value of the operation size |
Byte |
hadoop_hbase_appendsize_99_9th_percentile |
Add the 99.9th percentile value of the operation size |
Byte |
hadoop_hbase_appendsize_99th_percentile |
Add the 99th percentile value of the operation size |
Byte |
hadoop_hbase_appendsize_max |
Maximum size for append operation |
Byte |
hadoop_hbase_appendsize_mean |
The average size of the append operation |
Byte |
hadoop_hbase_appendsize_median |
Median size of append operation |
Byte |
hadoop_hbase_appendsize_min |
The minimum size for adding operations |
Byte |
hadoop_hbase_appendsize_num_ops |
Number of additional operations |
count |
hadoop_hbase_assignfailedcount |
Count of allocation failures |
count |
hadoop_hbase_assignsubmittedcount |
Submit the allocated count |
count |
hadoop_hbase_authenticationfailures |
Number of authentication failures |
count |
hadoop_hbase_authenticationsuccesses |
Number of successful authentication attempts |
count |
hadoop_hbase_authorizationfailures |
Number of authorization failures |
count |
hadoop_hbase_authorizationsuccesses |
Number of successful authorizations |
count |
hadoop_hbase_averageload |
Average load |
count |
hadoop_hbase_balancercluster_25th_percentile |
25th percentile value of cluster balancing operation |
ms |
hadoop_hbase_balancercluster_75th_percentile |
75th percentile value of cluster balancing operation |
ms |
hadoop_hbase_balancercluster_90th_percentile |
90th percentile value of cluster balancing operation |
ms |
hadoop_hbase_balancercluster_95th_percentile |
95th percentile value of cluster balancing operation |
ms |
hadoop_hbase_balancercluster_98th_percentile |
98th percentile value of cluster balancing operation |
ms |
hadoop_hbase_balancercluster_99_9th_percentile |
99.9th percentile value of cluster balancing operation |
ms |
hadoop_hbase_balancercluster_99th_percentile |
99th percentile value of cluster balancing operation |
ms |
hadoop_hbase_balancercluster_max |
Maximum value for cluster balancing operation |
ms |
hadoop_hbase_balancercluster_mean |
The average value of cluster balancing operation |
ms |
hadoop_hbase_balancercluster_median |
Median of cluster balancing operations |
ms |
hadoop_hbase_balancercluster_min |
Minimum value for cluster balancing operation |
ms |
hadoop_hbase_balancercluster_num_ops |
The number of cluster balancing operations |
ms |
hadoop_hbase_closefailedcount |
Close the failed count |
count |
hadoop_hbase_closesubmittedcount |
Submit closed count |
count |
hadoop_hbase_closetime_25th_percentile |
25th percentile value of closing operation time |
ms |
hadoop_hbase_closetime_75th_percentile |
75th percentile value of closing operation time |
ms |
hadoop_hbase_closetime_90th_percentile |
90th percentile value of closing operation time |
ms |
hadoop_hbase_closetime_95th_percentile |
95th percentile value of closing operation time |
ms |
hadoop_hbase_closetime_98th_percentile |
98th percentile value of closing operation time |
ms |
hadoop_hbase_closetime_99_9th_percentile |
99.9th percentile value of closing operation time.9百分位值 |
ms |
hadoop_hbase_closetime_max |
Maximum time for closing operation |
ms |
hadoop_hbase_closetime_mean |
The average time for closing operations |
ms |
hadoop_hbase_closetime_median |
Median time to close operation |
ms |
hadoop_hbase_closetime_min |
Minimum time to close operation |
ms |
hadoop_hbase_closetime_num_ops |
The number of closed operations |
count |
hadoop_hbase_clusterrequests |
The number of cluster requests |
count |
hadoop_hbase_deadserveropenregions |
The number of open areas on the death server |
count |
hadoop_hbase_droppedpuball |
Number of discarded PubAll |
count |
hadoop_hbase_errorrollrequest |
The number of incorrect scrolling requests |
count |
hadoop_hbase_exceptions |
Total number of exceptions |
count |
hadoop_hbase_exceptions_callqueuetoobig |
Number of exceptions caused by a large call queue |
count |
hadoop_hbase_exceptions_failedsanitycheckexception |
Number of failed integrity check exceptions |
count |
hadoop_hbase_exceptions_multiresponsetoolarge |
Excessive response to a large number of anomalies |
count |
hadoop_hbase_exceptions_notservingregionexception |
Number of abnormal services not provided in the region |
count |
hadoop_hbase_exceptions_otherexceptions |
Other abnormal quantities |
count |
hadoop_hbase_exceptions_outoforderscannernextexception |
Scanner next element order error abnormal quantity |
count |
hadoop_hbase_exceptions_quotaexceeded |
Quota exceeds abnormal quantity |
count |
hadoop_hbase_exceptions_regionmovedexception |
The number of abnormal regional movements |
count |
hadoop_hbase_exceptions_regiontoobusyexception |
The number of abnormally busy regions |
count |
hadoop_hbase_exceptions_requesttoobig |
Request too many exceptions |
count |
hadoop_hbase_exceptions_rpcthrottling |
The number of RPC throttling exceptions |
count |
hadoop_hbase_exceptions_scannerresetexception |
Number of scanner reset exceptions |
count |
hadoop_hbase_exceptions_unknownscannerexception |
Unknown number of scanner anomalies |
count |
hadoop_hbase_fschecksumfailurecount |
Count of file system checksum failures |
count |
hadoop_hbase_fspreadtime_25th_percentile |
25th percentile value of file system propagation time |
ms |
hadoop_hbase_fspreadtime_75th_percentile |
75th percentile value of file system propagation time |
ms |
hadoop_hbase_fspreadtime_90th_percentile |
90th percentile value of file system propagation time |
ms |
hadoop_hbase_fspreadtime_95th_percentile |
95th percentile value of file system propagation time |
ms |
hadoop_hbase_fspreadtime_98th_percentile |
98th percentile value of file system propagation time |
ms |
hadoop_hbase_fspreadtime_99_9th_percentile |
99.9th percentile value of file system propagation time.9百分位值 |
ms |
hadoop_hbase_fspreadtime_99th_percentile |
99th percentile value of file system propagation time |
ms |
hadoop_hbase_fspreadtime_max |
Maximum time for file system propagation |
ms |
hadoop_hbase_fspreadtime_mean |
The average time for file system propagation |
ms |
hadoop_hbase_fspreadtime_median |
Median time of file system propagation |
ms |
hadoop_hbase_fspreadtime_min |
Minimum time for file system propagation |
ms |
hadoop_hbase_fspreadtime_num_ops |
The number of file system propagation operations |
count |
hadoop_hbase_fsreadtime_25th_percentile |
25th percentile of file system read time |
ms |
hadoop_hbase_fsreadtime_75th_percentile |
75th percentile of file system read time |
ms |
hadoop_hbase_fsreadtime_90th_percentile |
90th percentile of file system read time |
ms |
hadoop_hbase_fsreadtime_95th_percentile |
95th percentile of file system read time |
ms |
hadoop_hbase_fsreadtime_98th_percentile |
98th percentile of file system read time |
ms |
hadoop_hbase_fsreadtime_99_9th_percentile |
99.9th percentile of file system read time.9百分位 |
ms |
hadoop_hbase_fsreadtime_99th_percentile |
99th percentile of file system read time |
ms |
hadoop_hbase_fsreadtime_max |
Maximum time for file system read |
ms |
hadoop_hbase_fsreadtime_mean |
The average time for file system read |
ms |
hadoop_hbase_fsreadtime_median |
Median time for file system read |
ms |
hadoop_hbase_fsreadtime_min |
Minimum time for file system read |
ms |
hadoop_hbase_fspreadtime_min |
The number of file system read operations |
ms |
hadoop_hbase_fswritetime_25th_percentile |
25th percentile value of file system write time |
ms |
hadoop_hbase_fswritetime_75th_percentile |
75th percentile value of file system write time |
ms |
hadoop_hbase_fswritetime_90th_percentile |
90th percentile value of file system write time |
ms |
hadoop_hbase_fswritetime_95th_percentile |
95th percentile value of file system write time |
ms |
hadoop_hbase_fswritetime_98th_percentile |
98th percentile value of file system write time |
ms |
hadoop_hbase_fswritetime_99_9th_percentile |
99.9th percentile value of file system write time.9百分位值 |
ms |
hadoop_hbase_fswritetime_99th_percentile |
99th percentile value of file system write time |
ms |
hadoop_hbase_fswritetime_max |
The maximum time for writing to the file system |
ms |
hadoop_hbase_fswritetime_mean |
The average time for writing to the file system |
ms |
hadoop_hbase_fswritetime_median |
Median time of file system writing |
ms |