Metrics

  1. statestore
  2. memory
  3. tcmalloc

statestore
Name Value Description
rpc-method.statestore.StatestoreService.RegisterSubscriber.call_duration Count: 26, min / max: 0 / 9ms, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 2ms, 95th %-ile: 4ms, 99.9th %-ile: 9ms
impala.thrift-server.StatestoreService.connection-setup-time Count: 181, min / max: 3.000us / 48.000us, 25th %-ile: 13.000us, 50th %-ile: 17.000us, 75th %-ile: 21.000us, 90th %-ile: 28.000us, 95th %-ile: 30.000us, 99.9th %-ile: 48.000us Amount of time clients of StateStore Service spent waiting for connection to be set up
impala.thrift-server.StatestoreService.svc-thread-wait-time Count: 181, min / max: 0.000ns / 18.000us, 25th %-ile: 1000.000ns, 50th %-ile: 2.000us, 75th %-ile: 3.000us, 90th %-ile: 3.000us, 95th %-ile: 4.000us, 99.9th %-ile: 18.000us Amount of time clients of StateStore Service spent waiting for service threads
impala.thrift-server.StatestoreService.connection-setup-queue-size 0 The number of connections to the Statestore Service that have been accepted and are waiting to be setup.
statestore.live-backends 7 The number of registered Statestore subscribers.
subscriber-heartbeat.client-cache.total-clients 7 The total number of clients in the Statestore heartbeat client cache.
kudu-client.version kudu 1.14.5.6-SNAPSHOT (rev b354e75310a57d5a7af2e4fe07a34f67814e10f2-dirty) A version string identifying the Kudu client
impala.thrift-server.StatestoreService.timedout-cnxn-requests 0 The number of connection requests to the Statestore Service that have been timed out waiting to be setup.
subscriber-update-state.client-cache.clients-in-use 0 The number of clients in use by the Statestore update state client cache.
process-start-time 2025-05-16 14:42:46.852700000 The local start time of the process
impala.thrift-server.StatestoreService.connections-in-use 8 The number of active connections to this StateStore's service.
statestore.slow-backends 0 The number of slow Statestore subscribers.
impala.thrift-server.StatestoreService.total-connections 181 The total number of connections made to this StateStore's StateStore service over its lifetime.
statestore.version statestored version 4.0.0.4211-[test/4.0.x]-x86_64-el7 RELEASE (build e7735d080bfeb70fb8f480ce3230835b53f6b3e1) The full version string of the Statestore Server.
thread-manager.total-threads-created 215 Threads created over the lifetime of the process.
thread-manager.running-threads 42 The number of running threads in this process.
statestore.live-backends.list [catalog-server@ngmmserver005.sa:26000, impalad@ngmmserver001.sa:22000, impalad@ngmmserver002.sa:22000, impalad@ngmmserver003.sa:22000, impalad@ngmmserver004.sa:22000, impalad@ngmmserver005.sa:22000, impalad@ngmmserver006.sa:22000] The set of all live Statestore subscribers.
statestore.total-key-size-bytes 6596997 The sum of the size of all keys for all topics tracked by the StateStore.
statestore.total-value-size-bytes 90376880 The sum of the size of all values for all topics tracked by the StateStore.
subscriber-heartbeat.client-cache.clients-in-use 0 The number of clients in use by the Statestore heartbeat client cache.
statestore.topic-update-durations Last (of 10687131): 0.000297607. Min: 0, max: 31.7418, avg: 0.00142741 The time (sec) spent sending non-priority topic update RPCs. Includes subscriber-side processing time and network transmission time.
statestore.total-topic-size-bytes 96973877 The sum of the size of all keys and all values for all topics tracked by the StateStore.
subscriber-update-state.client-cache.total-clients 13 The total number of clients in the Statestore update state client cache.
statestore.priority-topic-update-durations Last (of 182530992): 0.000269355. Min: 0, max: 30.5288, avg: 0.000352283 The time (sec) spent sending priority topic update RPCs. Includes subscriber-side processing time and network transmission time.
statestore.heartbeat-durations Last (of 21381489): 0.00017926. Min: 0, max: 27.9933, avg: 0.000314534 The time (sec) spent sending heartbeat RPCs. Includes subscriber-side processing time and network transmission time.

memory
Name Value Description
memory.thp.defrag always madvise [never] The system-wide 'defrag' setting for Transparent Huge Pages.
memory.thp.enabled always madvise [never] The system-wide 'enabled' setting for Transparent Huge Pages.
memory.thp.khugepaged-defrag 1 The system-wide 'defrag' setting for khugepaged.
memory.rss 187.14 MB Resident set size (RSS) of this process, including TCMalloc, buffer pool and Jvm.
memory.total-used 196.16 MB Total memory currently used by TCMalloc and buffer pool.
memory.mapped-bytes 1.01 GB Total bytes of memory mappings in this process (the virtual memory size).

tcmalloc
Name Value Description
tcmalloc.physical-bytes-reserved 196.16 MB Derived metric computing the amount of physical memory (in bytes) used by the process, including that actually in use and free bytes reserved by tcmalloc. Does not include the tcmalloc metadata.
tcmalloc.pageheap-free-bytes 0 Number of bytes in free, mapped pages in page heap. These bytes can be used to fulfill allocation requests. They always count towards virtual memory usage, and unless the underlying memory is swapped out by the OS, they also count towards physical memory usage.
tcmalloc.pageheap-unmapped-bytes 232.29 MB Number of bytes in free, unmapped pages in page heap. These are bytes that have been released back to the OS, possibly by one of the MallocExtension "Release" calls. They can be used to fulfill allocation requests, but typically incur a page fault. They always count towards virtual memory usage, and depending on the OS, typically do not count towards physical memory usage.
tcmalloc.bytes-in-use 143.26 MB Number of bytes used by the application. This will not typically match the memory use reported by the OS, because it does not include TCMalloc overhead or memory fragmentation.
tcmalloc.total-bytes-reserved 428.45 MB Bytes of system memory reserved by TCMalloc.