Ranger Admin
Collect Ranger Admin Metrics information
Configuration¶
1. Ranger Admin Configuration¶
1.1 Download jmx-exporter¶
Download address: https://github.com/prometheus/jmx_exporter
1.2 Download jmx Script¶
Download address: https://github.com/lrwh/jmx-exporter/blob/main/common.yml
1.3 Adjust Ranger Admin Startup Parameters¶
Add the following to the Ranger Admin startup parameters:
{JAVA_GC_ARGS} -javaagent:/opt/guance/jmx/jmx_exporter-1.0.1.jar=localhost:17143:/opt/guance/jmx/common.yml
1.4 Restart Ranger Admin¶
2. DataKit Collector Configuration¶
2.1 Install DataKit¶
2.2 Configure Collector¶
The jmx-exporter can directly expose metrics
url, so it can be collected directly via the prom collector.
Navigate to the conf.d/prom
directory under the DataKit installation directory, and copy prom.conf.sample
as ranger-admin.conf
.
cp prom.conf.sample ranger-admin.conf
Adjust the content of ranger_admin.conf
as follows:
urls = ["http://localhost:17143/metrics"]
source ="ranger-admin"
[inputs.prom.tags]
component = "ranger-admin"
interval = "10s"
Other configurations should be adjusted as needed, parameter adjustment description:
- urls: The
jmx-exporter
metrics address, fill in the metrics url exposed by the corresponding component here. - source: Collector alias, it is recommended to make distinctions.
- keep_exist_metric_name: Keep metric names.
- interval: Collection interval.
- inputs.prom.tags: Add extra tags.
3. Restart DataKit¶
Metrics¶
Hadoop Measurement Set¶
Ranger Admin metrics are located under the Hadoop Measurement set. Here we mainly introduce the descriptions of Ranger Admin related metrics.
Metrics | Description | Unit |
---|---|---|
hadoop_admin_contextenrichercount |
Number of context enrichers |
count |
hadoop_admin_contextenrichercounttag |
Number of context enrichers with specific tags |
count |
hadoop_admin_denyconditioncount |
Number of deny conditions |
count |
hadoop_admin_denyconditioncounttag |
Number of deny conditions with specific tags |
count |
hadoop_admin_droppedpuball |
Total number of dropped publish operations |
count |
hadoop_admin_gccounttotal |
Total number of garbage collections (GC) |
count |
hadoop_admin_gctimemax |
Maximum time spent on garbage collection (GC) |
ms |
hadoop_admin_gctimetotal |
Total time spent on garbage collection (GC) |
ms |
hadoop_admin_getgroupsavgtime |
Average time to get user groups |
ms |
hadoop_admin_getgroupsnumops |
Number of operations to get user groups |
count |
hadoop_admin_groupcount |
Number of user groups |
count |
hadoop_admin_loginfailureavgtime |
Average time for login failures |
ms |
hadoop_admin_loginfailurenumops |
Number of login failures |
count |
hadoop_admin_loginsuccessavgtime |
Average time for successful logins |
ms |
hadoop_admin_loginsuccessnumops |
Number of successful logins |
count |
hadoop_admin_maskingcount |
Number of data masking operations |
count |
hadoop_admin_memorycurrent |
Current memory usage |
count |
hadoop_admin_memorymax |
Maximum memory usage |
count |
hadoop_admin_numactivesinks |
Number of active sinks |
count |
hadoop_admin_numactivesources |
Number of active sources |
count |
hadoop_admin_numallsinks |
Total number of all sinks |
count |
hadoop_admin_numallsources |
Total number of all sources |
count |
hadoop_admin_processorsavailable |
Number of available processors |
count |
hadoop_admin_publishavgtime |
Average time for publish operations |
ms |
hadoop_admin_publishnumops |
Number of publish operations |
count |
hadoop_admin_renewalfailures |
Number of renewal failures |
count |
hadoop_admin_renewalfailurestotal |
Total number of renewal failures |
count |
hadoop_admin_resourceaccesscount |
Number of resource accesses |
count |
hadoop_admin_resourceaccesscountatlas |
Number of accesses to Atlas resources |
count |
hadoop_admin_resourceaccesscounthbase |
Number of accesses to HBase resources |
count |
hadoop_admin_resourceaccesscounthdfs |
Number of accesses to HDFS resources |
count |
hadoop_admin_resourceaccesscounthive |
Number of accesses to Hive resources |
count |
hadoop_admin_resourceaccesscountkafka_connect |
Number of accesses to Kafka Connect resources |
count |
hadoop_admin_resourceaccesscountkms |
Number of accesses to KMS resources |
count |
hadoop_admin_resourceaccesscountknox |
Number of accesses to Knox resources |
count |
hadoop_admin_resourceaccesscountkudu |
Number of accesses to Kudu resources |
count |
hadoop_admin_resourceaccesscountozone |
Number of accesses to Ozone resources |
count |
hadoop_admin_resourceaccesscountsolr |
Number of accesses to Solr resources |
count |
hadoop_admin_resourceaccesscounttag |
Number of accesses to resources with specific tags |
count |
hadoop_admin_resourceaccesscountyarn |
Number of accesses to resources using ARNs |
count |
hadoop_admin_rowfilteringcount |
Number of row filtering operations |
count |
hadoop_admin_servicecount |
Total number of services |
count |
hadoop_admin_servicecountatlas |
Number of Atlas services |
count |
hadoop_admin_servicecounthbase |
Number of HBase services |
count |
hadoop_admin_servicecounthdfs |
Number of HDFS services |
count |
hadoop_admin_servicecounthive |
Number of Hive services |
count |
hadoop_admin_servicecountkafka |
Number of Kafka services |
count |
hadoop_admin_servicecountkafka_connect |
Number of Kafka Connect services |
count |
hadoop_admin_servicecountkms |
Number of KMS services |
count |
hadoop_admin_servicecountknox |
Number of Knox services |
count |
hadoop_admin_servicecountkudu |
Number of Kudu services |
count |
hadoop_admin_servicecountsolr |
Number of Solr services |
count |
hadoop_admin_servicecounttag |
Number of services with specific tags |
count |
hadoop_admin_servicecountyarn |
Number of services using ARNs |
count |
hadoop_admin_sink_jsonavgtime |
Average time for JSON sink |
ms |
hadoop_admin_sink_jsondropped |
Number of messages dropped by JSON sink |
count |
hadoop_admin_sink_jsonnumops |
Number of operations performed by JSON sink |
count |
hadoop_admin_sink_jsonqsize |
Queue size of JSON sink |
count |
hadoop_admin_sink_prometheusavgtime |
Average time for Prometheus sink |
count |
hadoop_admin_sink_prometheusdropped |
Number of messages dropped by Prometheus sink |
count |
hadoop_admin_sink_prometheusnumops |
Number of operations performed by Prometheus sink |
count |
hadoop_admin_sink_prometheusqsize |
Queue size of Prometheus sink |
count |
hadoop_admin_snapshotavgtime |
Average time for snapshot operations |
count |
hadoop_admin_snapshotnumops |
Number of snapshot operations |
count |
hadoop_admin_systemloadavg |
System average load |
count |
hadoop_admin_threadsblocked |
Number of blocked threads |
count |
hadoop_admin_threadsbusy |
Number of busy threads |
count |
hadoop_admin_threadsremaining |
Number of remaining threads |
count |
hadoop_admin_threadswaiting |
Number of waiting threads |
count |
hadoop_admin_usercount |
Total number of users |
count |
hadoop_admin_systemloadavg |
System average load |
count |
hadoop_admin_usercountsysadmin |
Number of system administrator users |
count |
hadoop_admin_usercountuser |
Number of regular users |
count |