Collector Type: Agent

Category: Application Monitors

Application Name: Pulsarbroker

Global Template Name: Agent G2 - Linux - Apache Pulsar Broker Monitoring

Introduction

The Apache Pulsar Broker actively monitors and keeps track of the performance metrics associated with different components of Apache Pulsar Broker. This includes components like Namespace, Topic, Lookup, Connection, and Jetty.

Parameters

NamesDefault ValueDescription
Host127.0.0.1Host on which Apache pulsar is Running.
Port8080Port on which Broker metrics are exposed.

Note: All field attributes are mandatory. Use default values wherever applicable.

Collected Metrics

Metric NameDisplay NameDescription
pulsar_topics_countPulsar Topics CountThe number of Pulsar topics of the namespace owned by this broker.
pulsar_subscriptions_countPulsar Subscriptions CountThe number of Pulsar subscriptions of the namespace served by this broker.
pulsar_producers_countPulsar Producers CountThe number of active producers of the namespace connected to this broker.
pulsar_consumers_countPulsar Consumers CountThe number of active consumers of the namespace connected to this broker.
pulsar_rate_inPulsar Rate InThe total message rate of the namespace coming into this broker (messages/second).
pulsar_rate_outPulsar Rate OutThe total message rate of the namespace going out from this broker (messages/second).
pulsar_throughput_inPulsar Throughput InThe total throughput of the namespace coming into this broker (bytes/second).
pulsar_throughput_outPulsar Throughput OutThe total throughput of the namespace going out from this broker (bytes/second).
pulsar_storage_sizePulsar Storage SizeThe total storage size of the topics in this namespace owned by this broker.
pulsar_storage_logical_sizePulsar Storage Logical SizeThe storage size of topics in the namespace owned by the broker without replicas.
pulsar_storage_write_ratePulsar Storage Write RateThe total message batches (entries) written to the storage for this namespace (message batches / second).
pulsar_storage_read_ratePulsar Storage Read RateThe total message batches (entries) read from the storage for this namespace (message batches / second).
pulsar_broker_lookup_countPulsar Broker Lookup CountNumber of samples of the latency of all lookup operations.
pulsar_broker_lookup_sumPulsar Broker Lookup SumTotal latency of all lookup operations.
pulsar_broker_lookup_redirects_countPulsar Broker Lookup Redirects CountThe number of lookup redirected requests.
pulsar_broker_lookup_answers_countPulsar Broker Lookup Answers Count/b>The number of lookup responses (i.e. not redirected requests).
pulsar_broker_lookup_failures_countPulsar Broker Lookup Failures CountThe number of lookup failures.
pulsar_broker_lookup_pending_requestsPulsar Broker Lookup Pending RequestsThe number of pending lookups in broker. When it is up to the threshold, new requests are rejected.
pulsar_broker_topic_load_pending_requestsPulsar Broker Topic Load Pending RequestsThe load of pending topic operations.
pulsar_ml_cache_evictionsPulsar Ml Cache EvictionsThe number of cache evictions during the last minute.
pulsar_ml_cache_hits_ratePulsar Ml Cache Hits RateThe number of cache hits per second on the broker side.
pulsar_ml_cache_hits_throughputPulsar Ml Cache Hits ThroughputThe amount of data is retrieved from the cache on the broker side (in byte/s).
pulsar_ml_cache_misses_ratePulsar Ml Cache Misses RateThe number of cache misses per second on the broker side.
pulsar_ml_cache_misses_throughputPulsar Ml Cache Misses ThroughputThe amount of data is not retrieved from the cache on the broker side (in byte/s).
pulsar_ml_cache_pool_active_allocationsPulsar Ml Cache Pool Active AllocationsThe number of currently active allocations in direct arena.
pulsar_ml_cache_pool_active_allocations_hugePulsar Ml Cache Pool Active Allocations HugeThe number of currently active huge allocation in direct arena.
pulsar_ml_cache_pool_active_allocations_normalPulsar Ml Cache Pool Active Allocations NormalThe number of currently active normal allocations in direct arena.
pulsar_ml_cache_pool_active_allocations_smallPulsar Ml Cache Pool Active Allocations SmallThe number of currently active small allocations in direct arena.
pulsar_ml_cache_pool_allocatedPulsar Ml Cache Pool AllocatedThe total allocated memory of chunk lists in direct arena.
pulsar_ml_cache_pool_usedPulsar Ml Cache Pool UsedThe total used memory of chunk lists in direct arena.
pulsar_ml_cache_used_sizePulsar Ml Cache Used SizeThe size in byte used to store the entries payloads.
pulsar_ml_countPulsar Ml CountThe number of currently opened managed ledgers.
pulsar_active_connectionsPulsar Active ConnectionsThe number of active connections.
pulsar_connection_created_total_countPulsar Connection Created Total CountThe total number of connections.
pulsar_connection_create_success_countPulsar Connection Create Success CountThe number of successfully created connections.
pulsar_connection_create_fail_countPulsar Connection Create Fail CountThe number of failed connections.
pulsar_connection_closed_total_countPulsar Connection Closed Total CountThe total number of closed connections.
pulsar_broker_throttled_connectionsPulsar Broker Throttled ConnectionsThe number of throttled connections.
pulsar_broker_throttled_connections_global_limitPulsar Broker Throttled Connections Global LimitThe number of throttled connections because of per-connection limit.
pulsar_jetty_requests_activePulsar Jetty Requests ActiveNumber of requests currently active.
pulsar_jetty_requests_active_maxPulsar Jetty Requests Active MaxMaximum number of requests that have been active at once.
pulsar_jetty_request_time_max_secondsPulsar Jetty Request Time Max SecondsMaximum time spent handling requests.
pulsar_jetty_dispatched_activePulsar Jetty Dispatched ActiveNumber of dispatches currently active.
pulsar_jetty_dispatched_active_maxPulsar Jetty Dispatched Active MaxMaximum number of active dispatches being handled.
pulsar_jetty_dispatched_time_maxPulsar Jetty Dispatched Time MaxMaximum time spent in dispatch handling.
pulsar_jetty_async_requests_waitingPulsar Jetty Async Requests WaitingCurrently waiting async requests.
pulsar_jetty_async_requests_waiting_maxPulsar Jetty Async Requests Waiting MaxMaximum number of waiting async requests.
pulsar_jetty_stats_secondsPulsar Jetty Stats SecondsStatistics for time in seconds have been obtained.