The Apache Hive data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL. Structure can be projected onto data already in storage. A command line tool and JDBC driver are provided to connect users to Hive.

Prerequisites

  1. Set environment variable HADOOP_CLIENT_OPTS as follows:

    export HADOOP_CLIENT_OPTS="$HADOOP_CLIENT_OPTS -Dcom.sun.management.jmxremote \
    -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false \
    -Dcom.sun.management.jmxremote.port=8808"
    

    If you want to any other port then define in the detection YAML file.

  2. For Virtual machines, install the Linux agent.

Configuring the credentials

Configure the credentials in the directory /opt/opsramp/agent/conf/app.d/creds.yaml

hive:
- name: hive
  user: <username>
  pwd: <Password>
  encoding-type: plain
  labels:
    key1: val1
    key2: val2
  

Configuring the application

Virtual machine

Configure the application in the directory /opt/opsramp/agent/conf/app/discovery/auto-detection.yaml

- name: hive
  instance-checks:
    service-check:
      - hive
    process-check:
      - hive
    port-check:
      - 10002
  mon-type: "jmx"
  misc:
    jmx-port: "8808"

Docker environment

Configure the application in the directory /opt/opsramp/agent/conf/app/discovery/auto-container-detection.yaml

- name: hive
  container-checks:
    image-check:
      - hive
    port-check:
      - 10002
  mon-type: "jmx"
  misc:
    jmx-port: "8808"
  

Kubernetes environment

Configure the application in config.yaml

- name: hive
  container-checks:
    image-check:
      - hive
    port-check:
      - 10002
  mon-type: "jmx"
  misc:
    jmx-port: "8808"
  

Validate

Go to Resources under the Infrastructure tab to check if your resources are onboarded and the metrics are collected.

Metrics

OpsRamp MetricMetric Display NameUnit
hive_open_operations_Count

Number of open operations count
Open Operations Count
hive_memory_heap_usage_Value

Memory heap usage value
Memory Heap Usage Valuebytes
hive_memory_heap_used_Value

Memory heap used value
Memory Heap Used Valuebytes
hive_memory_heap_max_Value

Memory heap max value
Memory Heap Max Valuebytes
hive_memory_heap_committed_Value

Memory heap committed value
Memory Heap Committed Valuebytes
hive_memory_non_heap_init_Value

Memory non heap init value
Memory Non Heap Init Valuebytes
hive_memory_non_heap_used_Value

Memory non heap used value
Memory Non Heap Used Valuebytes
hive_memory_non_heap_max_Value

Memory non heap max value
Memory Non Heap Max Valuebytes
hive_memory_non_heap_committed_Value

Memory non heap committed value
Memory Non Heap Committed Valuebytes
hive_memory_total_init_Value

Memory total init value
Memory Total Init Valuebytes
hive_memory_total_usage_Value

Memory total usage value
Memory Total Usage Valuebytes
hive_memory_total_used_Value

Memory total used value
Memory Total Used Valuebytes
hive_memory_total_max_Value

Memory total max value
Memory Total Max Valuebytes
hive_memory_total_committed_Value

Memory total committed value
Memory Total Committed Valuebytes
hive_open_connections_Count

Number of open connections count
Open Connections Count
hive_create_total_count_dbs_Count

Number of create total count dbs count
Create Total Count Dbs Count
hive_delete_total_count_dbs_Count

Number of delete total count dbs count
Delete Total Count Dbs Count
hive_init_total_count_dbs_Value

Number of init total count dbs value
Init Total Count Dbs Value
hive_create_total_count_tables_Count

Number of create total count tables count
Create Total Count Tables Count
hive_delete_total_count_tables_Count

Number of delete total count tables count
Delete Total Count Tables Count
hive_init_total_count_tables_Value

init total count tables value
Init Total Count Tables Value
hive_create_total_count_partitions_Count

Number of number of create total count partitions count
Create Total Count Partitions Count
hive_delete_total_count_partitions_Count

Number of number of delete total count partitions count
Delete Total Count Partitions Count
hive_init_total_count_partitions_Value

init total count partitions value
Init Total Count Partitions Value
hive_directsql_errors_Count

Number of directsql errors count
Directsql Errors Count
hive_memory_heap_init_Value

Memory heap init value
Memory Heap Init Value
hive_api_create_table_Count

Number of api create table count
Api Create Table Count
hive_active_calls_api_create_table_Count

Number of active calls api create table count
Active Calls Api Create Table Count
hive_api_get_table_Count

Number of api get table count
Api Get Table Count
hive_active_calls_api_get_table_Count

Active calls api get table count
Active Calls Api Get Table Count
hive_api_drop_table_Count

Api drop table count
Api Drop Table Count
hive_active_calls_api_drop_table_Count

Number of active calls api drop table count
Active Calls Api Drop Table Count
hive_api_init_Count

Number of total api init count
Api Init Count
hive_active_calls_api_init_Count

Number of active calls api init count
Active Calls Api Init Count
hive_api_get_all_databases_Count

Number of api get all databases count
Api Get All Databases Count
hive_active_calls_api_get_all_databases_Count

Number of active calls api get all databases count
Active Calls Api Get All Databases Count
hive_api_get_database_Count

Number of api get database count
Api Get Database Count
hive_active_calls_api_get_database_Count

Number of active calls api get database count
Active Calls Api Get Database Count
hive_api_get_all_tables_Count

Number of api get all tables count
Api Get All Tables Count
hive_active_calls_api_get_all_tables_Count

Number of active calls api get all tables count
Active Calls Api Get All Tables Count
hive_api_shutdown_Count

Api shutdown count
Api Shutdown Count
hive_active_calls_api_shutdown_Count

Number of active calls api shutdown count
Active Calls Api Shutdown Count
hive_api_flushCache_Count

Number of api flushCache count
Api Flushcache Count
hive_active_calls_api_flushCache_Count

Number of active calls api flushCache count
Active Calls Api Flushcache Count
hive_api_alter_table_Count

Number of api alter table count
Api Alter Table Count
hive_active_calls_api_alter_table_Count

Number of active calls api alter table count
Active Calls Api Alter Table Count
hive_api_get_all_functions_Count

Number of api get all functions count
Api Get All Functions Count
hive_active_calls_api_get_all_functions_Count

Number of active calls api get all functions count
Active Calls Api Get All Functions Count
hive_api_get_table_req_Count

Number of api get table req count
Api Get Table Req Count
hive_active_calls_api_get_table_req_Count

Number of active calls api get table req count
Active Calls Api Get Table Req Count