The Apache Hive data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL. Structure can be projected onto data already in storage. A command line tool and JDBC driver are provided to connect users to Hive.
Prerequisites
Set environment variable HADOOP_CLIENT_OPTS as follows:
export HADOOP_CLIENT_OPTS="$HADOOP_CLIENT_OPTS -Dcom.sun.management.jmxremote \ -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false \ -Dcom.sun.management.jmxremote.port=8808"
If you want to any other port then define in the detection YAML file.
For Virtual machines, install the Linux agent.
Configuring the credentials
Configure the credentials in the directory /opt/opsramp/agent/conf/app.d/creds.yaml
hive:
- name: hive
user: <username>
pwd: <Password>
encoding-type: plain
labels:
key1: val1
key2: val2
Configuring the application
Virtual machine
Configure the application in the directory /opt/opsramp/agent/conf/app/discovery/auto-detection.yaml
- name: hive
instance-checks:
service-check:
- hive
process-check:
- hive
port-check:
- 10002
mon-type: "jmx"
misc:
jmx-port: "8808"
Docker environment
Configure the application in the directory /opt/opsramp/agent/conf/app/discovery/auto-container-detection.yaml
- name: hive
container-checks:
image-check:
- hive
port-check:
- 10002
mon-type: "jmx"
misc:
jmx-port: "8808"
Kubernetes environment
Configure the application in config.yaml
- name: hive
container-checks:
image-check:
- hive
port-check:
- 10002
mon-type: "jmx"
misc:
jmx-port: "8808"
Validate
Go to Resources under the Infrastructure tab to check if your resources are onboarded and the metrics are collected.
Supported metrics
OpsRamp Metric | Metric Display Name | Unit |
---|---|---|
hive_open_operations_Count Number of open operations count | Open Operations Count | |
hive_memory_heap_usage_Value Memory heap usage value | Memory Heap Usage Value | bytes |
hive_memory_heap_used_Value Memory heap used value | Memory Heap Used Value | bytes |
hive_memory_heap_max_Value Memory heap max value | Memory Heap Max Value | bytes |
hive_memory_heap_committed_Value Memory heap committed value | Memory Heap Committed Value | bytes |
hive_memory_non_heap_init_Value Memory non heap init value | Memory Non Heap Init Value | bytes |
hive_memory_non_heap_used_Value Memory non heap used value | Memory Non Heap Used Value | bytes |
hive_memory_non_heap_max_Value Memory non heap max value | Memory Non Heap Max Value | bytes |
hive_memory_non_heap_committed_Value Memory non heap committed value | Memory Non Heap Committed Value | bytes |
hive_memory_total_init_Value Memory total init value | Memory Total Init Value | bytes |
hive_memory_total_usage_Value Memory total usage value | Memory Total Usage Value | bytes |
hive_memory_total_used_Value Memory total used value | Memory Total Used Value | bytes |
hive_memory_total_max_Value Memory total max value | Memory Total Max Value | bytes |
hive_memory_total_committed_Value Memory total committed value | Memory Total Committed Value | bytes |
hive_open_connections_Count Number of open connections count | Open Connections Count | |
hive_create_total_count_dbs_Count Number of create total count dbs count | Create Total Count Dbs Count | |
hive_delete_total_count_dbs_Count Number of delete total count dbs count | Delete Total Count Dbs Count | |
hive_init_total_count_dbs_Value Number of init total count dbs value | Init Total Count Dbs Value | |
hive_create_total_count_tables_Count Number of create total count tables count | Create Total Count Tables Count | |
hive_delete_total_count_tables_Count Number of delete total count tables count | Delete Total Count Tables Count | |
hive_init_total_count_tables_Value init total count tables value | Init Total Count Tables Value | |
hive_create_total_count_partitions_Count Number of number of create total count partitions count | Create Total Count Partitions Count | |
hive_delete_total_count_partitions_Count Number of number of delete total count partitions count | Delete Total Count Partitions Count | |
hive_init_total_count_partitions_Value init total count partitions value | Init Total Count Partitions Value | |
hive_directsql_errors_Count Number of directsql errors count | Directsql Errors Count | |
hive_memory_heap_init_Value Memory heap init value | Memory Heap Init Value | |
hive_api_create_table_Count Number of api create table count | Api Create Table Count | |
hive_active_calls_api_create_table_Count Number of active calls api create table count | Active Calls Api Create Table Count | |
hive_api_get_table_Count Number of api get table count | Api Get Table Count | |
hive_active_calls_api_get_table_Count Active calls api get table count | Active Calls Api Get Table Count | |
hive_api_drop_table_Count Api drop table count | Api Drop Table Count | |
hive_active_calls_api_drop_table_Count Number of active calls api drop table count | Active Calls Api Drop Table Count | |
hive_api_init_Count Number of total api init count | Api Init Count | |
hive_active_calls_api_init_Count Number of active calls api init count | Active Calls Api Init Count | |
hive_api_get_all_databases_Count Number of api get all databases count | Api Get All Databases Count | |
hive_active_calls_api_get_all_databases_Count Number of active calls api get all databases count | Active Calls Api Get All Databases Count | |
hive_api_get_database_Count Number of api get database count | Api Get Database Count | |
hive_active_calls_api_get_database_Count Number of active calls api get database count | Active Calls Api Get Database Count | |
hive_api_get_all_tables_Count Number of api get all tables count | Api Get All Tables Count | |
hive_active_calls_api_get_all_tables_Count Number of active calls api get all tables count | Active Calls Api Get All Tables Count | |
hive_api_shutdown_Count Api shutdown count | Api Shutdown Count | |
hive_active_calls_api_shutdown_Count Number of active calls api shutdown count | Active Calls Api Shutdown Count | |
hive_api_flushCache_Count Number of api flushCache count | Api Flushcache Count | |
hive_active_calls_api_flushCache_Count Number of active calls api flushCache count | Active Calls Api Flushcache Count | |
hive_api_alter_table_Count Number of api alter table count | Api Alter Table Count | |
hive_active_calls_api_alter_table_Count Number of active calls api alter table count | Active Calls Api Alter Table Count | |
hive_api_get_all_functions_Count Number of api get all functions count | Api Get All Functions Count | |
hive_active_calls_api_get_all_functions_Count Number of active calls api get all functions count | Active Calls Api Get All Functions Count | |
hive_api_get_table_req_Count Number of api get table req count | Api Get Table Req Count | |
hive_active_calls_api_get_table_req_Count Number of active calls api get table req count | Active Calls Api Get Table Req Count |