Skip to content

Ranger Admin

Collect Ranger Admin metric information

Config

1.Ranger Admin configuration

1.1 Download jmx-exporter

Download link:https://github.com/prometheus/jmx_exporter

1.2 Download jmx script

Download link:https://github.com/lrwh/jmx-exporter/blob/main/common.yml

1.3 Ranger Admin startup parameter adjustment

在 Ranger Admin 的启动参数添加

{{JAVA_GC_ARGS}} -javaagent:/opt/guance/jmx/jmx_exporter-1.0.1.jar=localhost:17143:/opt/guance/jmx/common.yml

1.4 Restart Ranger Admin

2.1 Install DataKit

2.2 Configure collector

By using jmx exporter, the metrics URL can be directly exposed, so it can be collected directly through the prom collector.

Go to the conf.d/prom directory under the DataKit installation directory, and copy prom.conf.sample to ranger-admin.conf.

cp prom.conf.sample ranger-admin.conf

Adjust the content of ranger-admin.conf as follows:

  urls = ["http://localhost:17143/metrics"]
  source ="ranger-admin"
  [inputs.prom.tags]
    component = "ranger-admin" 
  interval = "10s"

Adjust other configurations as needed,parameter adjustment instructions :

  • urls:jmx-exporter metric address, fill in the URL of the metric exposed by the corresponding component here
  • source:Collector alias, it is recommended to make a distinction
  • keep_exist_metric_name: Maintain metric name
  • interval:Collection interval
  • inputs.prom.tags: Add additional tags

3. Restart DataKit

Restart Datakit

Metric

Hadoop Metric set

The Ranger Admin metric is located under the Hadoop metric set, and here we mainly introduce the explanation of Ranger Admin related metrics

Metrics Description Unit
hadoop_admin_contextenrichercount Number of Context Enrichers count
hadoop_admin_contextenrichercounttag The number of context enriches with specific tags count
hadoop_admin_denyconditioncount The number of rejection conditions count
hadoop_admin_denyconditioncounttag The number of rejection conditions with specific labels count
hadoop_admin_droppedpuball Total number of discarded publishing operations count
hadoop_admin_gccounttotal Total frequency of garbage collection (GC) count
hadoop_admin_gctimemax The maximum time required for garbage collection (GC) ms
hadoop_admin_gctimetotal Total time spent on garbage collection (GC) ms
hadoop_admin_getgroupsavgtime Obtain the average time of user groups ms
hadoop_admin_getgroupsnumops Get the number of operations for the user group count
hadoop_admin_groupcount Number of user groups count
hadoop_admin_loginfailureavgtime The average time taken for login failures ms
hadoop_admin_loginfailurenumops Number of login failures count
hadoop_admin_loginsuccessavgtime Average login success time ms
hadoop_admin_loginsuccessnumops Number of successful login attempts count
hadoop_admin_maskingcount The frequency of data desensitization count
hadoop_admin_memorycurrent Current memory usage count
hadoop_admin_memorymax Maximum memory usage count
hadoop_admin_numactivesinks Number of active sinks count
hadoop_admin_numactivesources Number of active data sources count
hadoop_admin_numallsinks The total number of all sinks count
hadoop_admin_numallsources The total number of all data sources count
hadoop_admin_processorsavailable Number of available processors count
hadoop_admin_publishavgtime The average time taken for publishing operations ms
hadoop_admin_publishnumops Number of publishing operations count
hadoop_admin_renewalfailures Number of failed updates count
hadoop_admin_renewalfailurestotal Total number of update failures count
hadoop_admin_resourceaccesscount Number of resource visits count
hadoop_admin_resourceaccesscountatlas Number of visits to Atlas resources count
hadoop_admin_resourceaccesscounthbase Number of visits to HBase resources count
hadoop_admin_resourceaccesscounthdfs The number of times HDFS resources are accessed count
hadoop_admin_resourceaccesscounthive Number of visits to Hive resources count
hadoop_admin_resourceaccesscountkafka_connect Number of visits to Kafka Connect resources count
hadoop_admin_resourceaccesscountkms The number of times KMS (Key Management System) resources are accessed count
hadoop_admin_resourceaccesscountknox Number of visits to Knox resources count
hadoop_admin_resourceaccesscountkudu Number of visits to Kudu resources count
hadoop_admin_resourceaccesscountozone Number of visits to Ozone resources count
hadoop_admin_resourceaccesscountsolr Number of visits to Solr resources count
hadoop_admin_resourceaccesscounttag Number of visits to resources with specific tags count
hadoop_admin_resourceaccesscountyarn The number of resource visits using ARN (Amazon Resource Name) count
hadoop_admin_rowfilteringcount The number of times the line is filtered count
hadoop_admin_servicecount Total number of services provided count
hadoop_admin_servicecountatlas Number of Atlas services count
hadoop_admin_servicecounthbase The number of HBase services count
hadoop_admin_servicecounthdfs The number of HDFS services count
hadoop_admin_servicecounthive Number of Hive services count
hadoop_admin_servicecountkafka Number of Kafka services count
hadoop_admin_servicecountkafka_connect Number of Kafka Connect services count
hadoop_admin_servicecountkms Number of KMS services count
hadoop_admin_servicecountknox The quantity of Knox services count
hadoop_admin_servicecountozone Number of Ozone services count
hadoop_admin_servicecountkudu The quantity of Kudu services count
hadoop_admin_servicecountsolr Number of solr services count
hadoop_admin_servicecounttag Number of services with specific tags count
hadoop_admin_servicecountyarn Number of services using ARN count
hadoop_admin_sink_jsonavgtime Average time consumption of JSON receiver ms
hadoop_admin_sink_jsondropped The number of messages discarded by the JSON receiver count
hadoop_admin_sink_jsonnumops JSON receiver operation times count
hadoop_admin_sink_jsonqsize The queue size of the JSON receiver count
hadoop_admin_sink_prometheusavgtime The average time consumption of Prometheus receivers count
hadoop_admin_sink_prometheusdropped Messages discarded by Prometheus receiver数 count
hadoop_admin_sink_prometheusnumops Prometheus receiver operation times count
hadoop_admin_sink_prometheusqsize The queue size of Prometheus receivers count
hadoop_admin_snapshotavgtime The average time consumption of snapshot operations count
hadoop_admin_snapshotnumops Number of snapshot operations count
hadoop_admin_systemloadavg System average load count
hadoop_admin_threadsblocked Number of blocked threads count
hadoop_admin_threadsbusy Number of busy threads count
hadoop_admin_threadsremaining Remaining number of threads count
hadoop_admin_threadswaiting Number of waiting threads count
hadoop_admin_usercount Total number of users count
hadoop_admin_systemloadavg System average load count
hadoop_admin_usercountsysadmin Number of system administrator users count
hadoop_admin_usercountuser Number of ordinary users count

Feedback

Is this page helpful? ×