Skip to content

Latest commit

 

History

History
578 lines (559 loc) · 80.4 KB

File metadata and controls

578 lines (559 loc) · 80.4 KB

All Links

Metric Type Description
link_​slow_​count counter The number of times the consumer was detected as rate limiting consumer by the producer.
link_​consumed_​count counter The number of times the link reader has consumed a fragment.
link_​consumed_​size_​bytes counter The total number of bytes read by the link consumer.
link_​filtered_​count counter The number of fragments that were filtered and not consumed.
link_​filtered_​size_​bytes counter The total number of bytes read by the link consumer that were filtered.
link_​overrun_​polling_​count counter The number of times the link has been overrun while polling.
link_​overrun_​polling_​frag_​count counter The number of fragments the link has not processed because it was overrun while polling.
link_​overrun_​reading_​count counter The number of input overruns detected while reading metadata by the consumer.
link_​overrun_​reading_​frag_​count counter The number of fragments the link has not processed because it was overrun while reading.

All Tiles

Metric Type Description
tile_​pid gauge The process ID of the tile.
tile_​tid gauge The thread ID of the tile. Always the same as the Pid in production, but might be different in development.
tile_​context_​switch_​involuntary_​count counter The number of involuntary context switches.
tile_​context_​switch_​voluntary_​count counter The number of voluntary context switches.
tile_​status gauge The current status of the tile. 0 is booting, 1 is running.
tile_​heartbeat gauge The last UNIX timestamp in nanoseconds that the tile heartbeated.
tile_​in_​backpressure gauge Whether the tile is currently backpressured or not, either 1 or 0.
tile_​backpressure_​count counter Number of times the times the tile has had to wait for one of more consumers to catch up to resume publishing.
tile_​regime_​duration_​nanos_​caught_​up_​housekeeping counter Mutually exclusive and exhaustive duration of time the tile spent in each of the regimes. (Caught up + Housekeeping)
tile_​regime_​duration_​nanos_​processing_​housekeeping counter Mutually exclusive and exhaustive duration of time the tile spent in each of the regimes. (Processing + Housekeeping)
tile_​regime_​duration_​nanos_​backpressure_​housekeeping counter Mutually exclusive and exhaustive duration of time the tile spent in each of the regimes. (Backpressure + Housekeeping)
tile_​regime_​duration_​nanos_​caught_​up_​prefrag counter Mutually exclusive and exhaustive duration of time the tile spent in each of the regimes. (Caught up + Prefrag)
tile_​regime_​duration_​nanos_​processing_​prefrag counter Mutually exclusive and exhaustive duration of time the tile spent in each of the regimes. (Processing + Prefrag)
tile_​regime_​duration_​nanos_​backpressure_​prefrag counter Mutually exclusive and exhaustive duration of time the tile spent in each of the regimes. (Backpressure + Prefrag)
tile_​regime_​duration_​nanos_​caught_​up_​postfrag counter Mutually exclusive and exhaustive duration of time the tile spent in each of the regimes. (Caught up + Postfrag)
tile_​regime_​duration_​nanos_​processing_​postfrag counter Mutually exclusive and exhaustive duration of time the tile spent in each of the regimes. (Processing + Postfrag)

Net Tile

Metric Type Description
net_​rx_​pkt_​cnt counter Packet receive count.
net_​rx_​bytes_​total counter Total number of bytes received (including Ethernet header).
net_​rx_​undersz_​cnt counter Number of incoming packets dropped due to being too small.
net_​rx_​fill_​blocked_​cnt counter Number of incoming packets dropped due to fill ring being full.
net_​rx_​backpressure_​cnt counter Number of incoming packets dropped due to backpressure.
net_​rx_​busy_​cnt gauge Number of receive buffers currently busy.
net_​rx_​idle_​cnt gauge Number of receive buffers currently idle.
net_​tx_​submit_​cnt counter Number of packet transmit jobs submitted.
net_​tx_​complete_​cnt counter Number of packet transmit jobs marked as completed by the kernel.
net_​tx_​bytes_​total counter Total number of bytes transmitted (including Ethernet header).
net_​tx_​route_​fail_​cnt counter Number of packet transmit jobs dropped due to route failure.
net_​tx_​neighbor_​fail_​cnt counter Number of packet transmit jobs dropped due to unresolved neighbor.
net_​tx_​full_​fail_​cnt counter Number of packet transmit jobs dropped due to XDP TX ring full or missing completions.
net_​tx_​busy_​cnt gauge Number of transmit buffers currently busy.
net_​tx_​idle_​cnt gauge Number of transmit buffers currently idle.
net_​xsk_​tx_​wakeup_​cnt counter Number of XSK sendto syscalls dispatched.
net_​xsk_​rx_​wakeup_​cnt counter Number of XSK recvmsg syscalls dispatched.
net_​xdp_​rx_​dropped_​other counter xdp_statistics_v0.rx_dropped: Dropped for other reasons
net_​xdp_​rx_​invalid_​descs counter xdp_statistics_v0.rx_invalid_descs: Dropped due to invalid descriptor
net_​xdp_​tx_​invalid_​descs counter xdp_statistics_v0.tx_invalid_descs: Dropped due to invalid descriptor
net_​xdp_​rx_​ring_​full counter xdp_statistics_v1.rx_ring_full: Dropped due to rx ring being full
net_​xdp_​rx_​fill_​ring_​empty_​descs counter xdp_statistics_v1.rx_fill_ring_empty_descs: Failed to retrieve item from fill ring
net_​xdp_​tx_​ring_​empty_​descs counter xdp_statistics_v1.tx_ring_empty_descs: Failed to retrieve item from tx ring

Quic Tile

Metric Type Description
quic_​txns_​overrun counter Count of txns overrun before reassembled (too small txn_reassembly_count).
quic_​txn_​reasms_​started counter Count of fragmented txn receive ops started.
quic_​txn_​reasms_​active gauge Number of fragmented txn receive ops currently active.
quic_​frags_​ok counter Count of txn frags received
quic_​frags_​gap counter Count of txn frags dropped due to data gap
quic_​frags_​dup counter Count of txn frags dropped due to dup (stream already completed)
quic_​txns_​received_​udp counter Count of txns received via TPU. (TPU/UDP)
quic_​txns_​received_​quic_​fast counter Count of txns received via TPU. (TPU/QUIC unfragmented)
quic_​txns_​received_​quic_​frag counter Count of txns received via TPU. (TPU/QUIC fragmented)
quic_​txns_​abandoned counter Count of txns abandoned because a conn was lost.
quic_​txn_​undersz counter Count of txns received via QUIC dropped because they were too small.
quic_​txn_​oversz counter Count of txns received via QUIC dropped because they were too large.
quic_​legacy_​txn_​undersz counter Count of packets received on the non-QUIC port that were too small to be a valid IP packet.
quic_​legacy_​txn_​oversz counter Count of packets received on the non-QUIC port that were too large to be a valid transaction.
quic_​received_​packets counter Number of IP packets received.
quic_​received_​bytes counter Total bytes received (including IP, UDP, QUIC headers).
quic_​sent_​packets counter Number of IP packets sent.
quic_​sent_​bytes counter Total bytes sent (including IP, UDP, QUIC headers).
quic_​connections_​active gauge The number of currently active QUIC connections.
quic_​connections_​created counter The total number of connections that have been created.
quic_​connections_​closed counter Number of connections gracefully closed.
quic_​connections_​aborted counter Number of connections aborted.
quic_​connections_​timed_​out counter Number of connections timed out.
quic_​connections_​retried counter Number of connections established with retry.
quic_​connection_​error_​no_​slots counter Number of connections that failed to create due to lack of slots.
quic_​connection_​error_​retry_​fail counter Number of connections that failed during retry (e.g. invalid token).
quic_​pkt_​no_​conn counter Number of packets with an unknown connection ID.
quic_​pkt_​tx_​alloc_​fail counter Number of packets failed to send because of metadata alloc fail.
quic_​handshakes_​created counter Number of handshake flows created.
quic_​handshake_​error_​alloc_​fail counter Number of handshakes dropped due to alloc fail.
quic_​handshake_​evicted counter Number of handshakes dropped due to eviction.
quic_​stream_​received_​events counter Number of stream RX events.
quic_​stream_​received_​bytes counter Total stream payload bytes received.
quic_​received_​frames_​unknown counter Number of QUIC frames received. (Unknown frame type)
quic_​received_​frames_​ack counter Number of QUIC frames received. (ACK frame)
quic_​received_​frames_​reset_​stream counter Number of QUIC frames received. (RESET_STREAM frame)
quic_​received_​frames_​stop_​sending counter Number of QUIC frames received. (STOP_SENDING frame)
quic_​received_​frames_​crypto counter Number of QUIC frames received. (CRYPTO frame)
quic_​received_​frames_​new_​token counter Number of QUIC frames received. (NEW_TOKEN frame)
quic_​received_​frames_​stream counter Number of QUIC frames received. (STREAM frame)
quic_​received_​frames_​max_​data counter Number of QUIC frames received. (MAX_DATA frame)
quic_​received_​frames_​max_​stream_​data counter Number of QUIC frames received. (MAX_STREAM_DATA frame)
quic_​received_​frames_​max_​streams counter Number of QUIC frames received. (MAX_STREAMS frame)
quic_​received_​frames_​data_​blocked counter Number of QUIC frames received. (DATA_BLOCKED frame)
quic_​received_​frames_​stream_​data_​blocked counter Number of QUIC frames received. (STREAM_DATA_BLOCKED frame)
quic_​received_​frames_​streams_​blocked counter Number of QUIC frames received. (STREAMS_BLOCKED(bidi) frame)
quic_​received_​frames_​new_​conn_​id counter Number of QUIC frames received. (NEW_CONN_ID frame)
quic_​received_​frames_​retire_​conn_​id counter Number of QUIC frames received. (RETIRE_CONN_ID frame)
quic_​received_​frames_​path_​challenge counter Number of QUIC frames received. (PATH_CHALLENGE frame)
quic_​received_​frames_​path_​response counter Number of QUIC frames received. (PATH_RESPONSE frame)
quic_​received_​frames_​conn_​close_​quic counter Number of QUIC frames received. (CONN_CLOSE(transport) frame)
quic_​received_​frames_​conn_​close_​app counter Number of QUIC frames received. (CONN_CLOSE(app) frame)
quic_​received_​frames_​handshake_​done counter Number of QUIC frames received. (HANDSHAKE_DONE frame)
quic_​received_​frames_​ping counter Number of QUIC frames received. (PING frame)
quic_​received_​frames_​padding counter Number of QUIC frames received. (PADDING frame)
quic_​ack_​tx_​noop counter ACK events (non-ACK-eliciting packet)
quic_​ack_​tx_​new counter ACK events (new ACK range)
quic_​ack_​tx_​merged counter ACK events (merged into existing ACK range)
quic_​ack_​tx_​drop counter ACK events (out of buffers)
quic_​ack_​tx_​cancel counter ACK events (ACK suppressed by handler)
quic_​service_​duration_​seconds histogram Duration spent in service
quic_​receive_​duration_​seconds histogram Duration spent receiving packets
quic_​frame_​fail_​parse counter Number of QUIC frames failed to parse.
quic_​pkt_​crypto_​failed_​initial counter Number of packets that failed decryption. (initial)
quic_​pkt_​crypto_​failed_​early counter Number of packets that failed decryption. (early data)
quic_​pkt_​crypto_​failed_​handshake counter Number of packets that failed decryption. (handshake)
quic_​pkt_​crypto_​failed_​app counter Number of packets that failed decryption. (app data)
quic_​pkt_​no_​key_​initial counter Number of packets that failed decryption due to missing key. (initial)
quic_​pkt_​no_​key_​early counter Number of packets that failed decryption due to missing key. (early data)
quic_​pkt_​no_​key_​handshake counter Number of packets that failed decryption due to missing key. (handshake)
quic_​pkt_​no_​key_​app counter Number of packets that failed decryption due to missing key. (app data)
quic_​pkt_​net_​header_​invalid counter Number of packets dropped due to weird IP or UDP header.
quic_​pkt_​quic_​header_​invalid counter Number of packets dropped due to weird QUIC header.
quic_​pkt_​undersz counter Number of QUIC packets dropped due to being too small.
quic_​pkt_​oversz counter Number of QUIC packets dropped due to being too large.
quic_​pkt_​verneg counter Number of QUIC version negotiation packets received.
quic_​retry_​sent counter Number of QUIC Retry packets sent.

Bundle Tile

Metric Type Description
bundle_​transaction_​received counter Total count of transactions received, including transactions within bundles
bundle_​packet_​received counter Total count of packets received
bundle_​bundle_​received counter Total count of bundles received

Verify Tile

Metric Type Description
verify_​transaction_​bundle_​peer_​failure counter Count of transactions that failed to verify because a peer transaction in the bundle failed
verify_​transaction_​parse_​failure counter Count of transactions that failed to parse
verify_​transaction_​dedup_​failure counter Count of transactions that failed to deduplicate in the verify stage
verify_​transaction_​verify_​failure counter Count of transactions that failed to deduplicate in the verify stage

Dedup Tile

Metric Type Description
dedup_​transaction_​bundle_​peer_​failure counter Count of transactions that failed to dedup because a peer transaction in the bundle failed
dedup_​transaction_​dedup_​failure counter Count of transactions that failed to deduplicate in the dedup stage
dedup_​gossiped_​votes_​received counter Count of simple vote transactions received over gossip instead of via the normal TPU path

Resolv Tile

Metric Type Description
resolv_​no_​bank_​drop counter Count of transactions dropped because the bank was not available
resolv_​stash_​operation_​inserted counter Count of operations that happened on the transaction stash (A transaction with an unknown blockhash was added to the stash)
resolv_​stash_​operation_​overrun counter Count of operations that happened on the transaction stash (A transaction with an unknown blockhash was dropped because the stash was full)
resolv_​stash_​operation_​published counter Count of operations that happened on the transaction stash (A transaction with an unknown blockhash was published as the blockhash became known)
resolv_​stash_​operation_​removed counter Count of operations that happened on the transaction stash (A transaction with an unknown blockhash was removed from the stash without publishing, due to a bad LUT resolved failure, or no bank. These errors are double counted with the respective metrics for those categories.)
resolv_​lut_​resolved_​invalid_​lookup_​index counter Count of address lookup tables resolved (The transaction referenced an index in a LUT that didn't exist)
resolv_​lut_​resolved_​account_​uninitialized counter Count of address lookup tables resolved (The account referenced as a LUT hasn't been initialized)
resolv_​lut_​resolved_​invalid_​account_​data counter Count of address lookup tables resolved (The account referenced as a LUT couldn't be parsed)
resolv_​lut_​resolved_​invalid_​account_​owner counter Count of address lookup tables resolved (The account referenced as a LUT wasn't owned by the ALUT program ID)
resolv_​lut_​resolved_​account_​not_​found counter Count of address lookup tables resolved (The account referenced as a LUT couldn't be found)
resolv_​lut_​resolved_​success counter Count of address lookup tables resolved (Resolved successfully)
resolv_​blockhash_​expired counter Count of transactions that failed to resolve because the blockhash was expired
resolv_​transaction_​bundle_​peer_​failure counter Count of transactions that failed to resolve because a peer transaction in the bundle failed

Pack Tile

Metric Type Description
pack_​schedule_​microblock_​duration_​seconds histogram Duration of scheduling one microblock
pack_​no_​sched_​microblock_​duration_​seconds histogram Duration of discovering that there are no schedulable transactions
pack_​insert_​transaction_​duration_​seconds histogram Duration of inserting one transaction into the pool of available transactions
pack_​complete_​microblock_​duration_​seconds histogram Duration of the computation associated with marking one microblock as complete
pack_​total_​transactions_​per_​microblock_​count histogram Count of transactions in a scheduled microblock, including both votes and non-votes
pack_​votes_​per_​microblock_​count histogram Count of simple vote transactions in a scheduled microblock
pack_​normal_​transaction_​received counter Count of transactions received via the normal TPU path
pack_​transaction_​inserted_​bundle_​blacklist counter Result of inserting a transaction into the pack object (Transaction uses an account on the bundle blacklist)
pack_​transaction_​inserted_​write_​sysvar counter Result of inserting a transaction into the pack object (Transaction tries to write to a sysvar)
pack_​transaction_​inserted_​estimation_​fail counter Result of inserting a transaction into the pack object (Estimating compute cost and/or fee failed)
pack_​transaction_​inserted_​duplicate_​account counter Result of inserting a transaction into the pack object (Transaction included an account address twice)
pack_​transaction_​inserted_​too_​many_​accounts counter Result of inserting a transaction into the pack object (Transaction tried to load too many accounts)
pack_​transaction_​inserted_​too_​large counter Result of inserting a transaction into the pack object (Transaction requests too many CUs)
pack_​transaction_​inserted_​expired counter Result of inserting a transaction into the pack object (Transaction already expired)
pack_​transaction_​inserted_​addr_​lut counter Result of inserting a transaction into the pack object (Transaction loaded accounts from a lookup table)
pack_​transaction_​inserted_​unaffordable counter Result of inserting a transaction into the pack object (Fee payer's balance below transaction fee)
pack_​transaction_​inserted_​duplicate counter Result of inserting a transaction into the pack object (Pack aware of transaction with same signature)
pack_​transaction_​inserted_​priority counter Result of inserting a transaction into the pack object (Transaction's fee was too low given its compute unit requirement and other competing transactions)
pack_​transaction_​inserted_​nonvote_​add counter Result of inserting a transaction into the pack object (Transaction that was not a simple vote added to pending transactions)
pack_​transaction_​inserted_​vote_​add counter Result of inserting a transaction into the pack object (Simple vote transaction was added to pending transactions)
pack_​transaction_​inserted_​nonvote_​replace counter Result of inserting a transaction into the pack object (Transaction that was not a simple vote replaced a lower priority transaction)
pack_​transaction_​inserted_​vote_​replace counter Result of inserting a transaction into the pack object (Simple vote transaction replaced a lower priority transaction)
pack_​metric_​timing_​no_​txn_​no_​bank_​no_​leader_​no_​microblock counter Time in nanos spent in each state (Pack had no transactions available, and wasn't leader)
pack_​metric_​timing_​txn_​no_​bank_​no_​leader_​no_​microblock counter Time in nanos spent in each state (Pack had transactions available, but wasn't leader or had hit a limit)
pack_​metric_​timing_​no_​txn_​bank_​no_​leader_​no_​microblock counter Time in nanos spent in each state (Pack had no transactions available, had banks but wasn't leader)
pack_​metric_​timing_​txn_​bank_​no_​leader_​no_​microblock counter Time in nanos spent in each state (Pack had transactions available, had banks but wasn't leader)
pack_​metric_​timing_​no_​txn_​no_​bank_​leader_​no_​microblock counter Time in nanos spent in each state (Pack had no transactions available, and was leader but had no available banks)
pack_​metric_​timing_​txn_​no_​bank_​leader_​no_​microblock counter Time in nanos spent in each state (Pack had transactions available, was leader, but had no available banks)
pack_​metric_​timing_​no_​txn_​bank_​leader_​no_​microblock counter Time in nanos spent in each state (Pack had available banks but no transactions)
pack_​metric_​timing_​txn_​bank_​leader_​no_​microblock counter Time in nanos spent in each state (Pack had banks and transactions available but couldn't schedule anything non-conflicting)
pack_​metric_​timing_​no_​txn_​no_​bank_​no_​leader_​microblock counter Time in nanos spent in each state (Pack scheduled a non-empty microblock while not leader)
pack_​metric_​timing_​txn_​no_​bank_​no_​leader_​microblock counter Time in nanos spent in each state (Pack scheduled a non-empty microblock while not leader)
pack_​metric_​timing_​no_​txn_​bank_​no_​leader_​microblock counter Time in nanos spent in each state (Pack scheduled a non-empty microblock while not leader)
pack_​metric_​timing_​txn_​bank_​no_​leader_​microblock counter Time in nanos spent in each state (Pack scheduled a non-empty microblock while not leader)
pack_​metric_​timing_​no_​txn_​no_​bank_​leader_​microblock counter Time in nanos spent in each state (Pack scheduled a non-empty microblock but all banks were busy)
pack_​metric_​timing_​txn_​no_​bank_​leader_​microblock counter Time in nanos spent in each state (Pack scheduled a non-empty microblock but all banks were busy)
pack_​metric_​timing_​no_​txn_​bank_​leader_​microblock counter Time in nanos spent in each state (Pack scheduled a non-empty microblock and now has no transactions)
pack_​metric_​timing_​txn_​bank_​leader_​microblock counter Time in nanos spent in each state (Pack scheduled a non-empty microblock)
pack_​transaction_​dropped_​from_​extra counter Transactions dropped from the extra transaction storage because it was full
pack_​transaction_​inserted_​to_​extra counter Transactions inserted into the extra transaction storage because pack's primary storage was full
pack_​transaction_​inserted_​from_​extra counter Transactions pulled from the extra transaction storage and inserted into pack's primary storage
pack_​transaction_​expired counter Transactions deleted from pack because their TTL expired
pack_​transaction_​dropped_​partial_​bundle counter Transactions dropped from pack because they were part of a partial bundle
pack_​available_​transactions_​all gauge The total number of pending transactions in pack's pool that are available to be scheduled (All transactions in any treap)
pack_​available_​transactions_​regular gauge The total number of pending transactions in pack's pool that are available to be scheduled (Non-votes in the main treap)
pack_​available_​transactions_​votes gauge The total number of pending transactions in pack's pool that are available to be scheduled (Simple votes)
pack_​available_​transactions_​conflicting gauge The total number of pending transactions in pack's pool that are available to be scheduled (Non-votes that write to a hotly-contended account)
pack_​available_​transactions_​bundles gauge The total number of pending transactions in pack's pool that are available to be scheduled (Transactions that are part of a bundle)
pack_​pending_​transactions_​heap_​size gauge The maximum number of pending transactions that pack can consider. This value is fixed at Firedancer startup but is a useful reference for AvailableTransactions.
pack_​smallest_​pending_​transaction gauge A lower bound on the smallest non-vote transaction (in cost units) that is immediately available for scheduling
pack_​microblock_​per_​block_​limit counter The number of times pack did not pack a microblock because the limit on microblocks/block had been reached
pack_​data_​per_​block_​limit counter The number of times pack did not pack a microblock because it reached the data per block limit at the start of trying to schedule a microblock
pack_​transaction_​schedule_​taken counter Result of trying to consider a transaction for scheduling (Pack included the transaction in the microblock)
pack_​transaction_​schedule_​cu_​limit counter Result of trying to consider a transaction for scheduling (Pack skipped the transaction because it would have exceeded the block CU limit)
pack_​transaction_​schedule_​fast_​path counter Result of trying to consider a transaction for scheduling (Pack skipped the transaction because of account conflicts using the fast bitvector check)
pack_​transaction_​schedule_​byte_​limit counter Result of trying to consider a transaction for scheduling (Pack skipped the transaction because it would have exceeded the block data size limit)
pack_​transaction_​schedule_​write_​cost counter Result of trying to consider a transaction for scheduling (Pack skipped the transaction because it would have caused a writable account to exceed the per-account block write cost limit)
pack_​transaction_​schedule_​slow_​path counter Result of trying to consider a transaction for scheduling (Pack skipped the transaction because of account conflicts using the full slow check)
pack_​transaction_​schedule_​defer_​skip counter Result of trying to consider a transaction for scheduling (Pack skipped the transaction it previously exceeded the per-account block write cost limit too many times)
pack_​bundle_​crank_​status_​not_​needed counter Result of considering whether bundle cranks are needed (On-chain state in the correct state)
pack_​bundle_​crank_​status_​inserted counter Result of considering whether bundle cranks are needed (Inserted an initializer bundle to update the on-chain state)
pack_​bundle_​crank_​status_​creation_​failed counter Result of considering whether bundle cranks are needed (Tried to insert an initializer bundle to update the on-chain state, but creation failed)
pack_​bundle_​crank_​status_​insertion_​failed counter Result of considering whether bundle cranks are needed (Tried to insert an initializer bundle to update the on-chain state, but insertion failed)
pack_​cus_​consumed_​in_​block gauge The number of cost units consumed in the current block, or 0 if pack is not currently packing a block
pack_​cus_​scheduled histogram The number of cost units scheduled for each block pack produced. This can be higher than the block limit because of returned CUs.
pack_​cus_​rebated histogram The number of compute units rebated for each block pack produced. Compute units are rebated when a transaction fails prior to execution or requests more compute units than it uses.
pack_​cus_​net histogram The net number of cost units (scheduled - rebated) in each block pack produced.
pack_​cus_​pct histogram The percent of the total block cost limit used for each block pack produced.
pack_​delete_​missed counter Count of attempts to delete a transaction that wasn't found
pack_​delete_​hit counter Count of attempts to delete a transaction that was found and deleted

Bank Tile

Metric Type Description
bank_​transaction_​sanitize_​failure counter Number of transactions that failed to sanitize.
bank_​transaction_​not_​executed_​failure counter Number of transactions that did not execute. This is different than transactions which fail to execute, which make it onto the chain.
bank_​precompile_​verify_​failure counter Number of transactions that failed precompile verification and thus will not execute.
bank_​slot_​acquire_​success counter Result of acquiring a slot. (Success)
bank_​slot_​acquire_​too_​high counter Result of acquiring a slot. (Too high)
bank_​slot_​acquire_​too_​low counter Result of acquiring a slot. (Too low)
bank_​transaction_​load_​address_​tables_​success counter Result of loading address lookup tables for a transaction. If there are multiple errors for the transaction, only the first one is reported. (Success)
bank_​transaction_​load_​address_​tables_​slot_​hashes_​sysvar_​not_​found counter Result of loading address lookup tables for a transaction. If there are multiple errors for the transaction, only the first one is reported. (The slot hashes syvar could not be found.)
bank_​transaction_​load_​address_​tables_​account_​not_​found counter Result of loading address lookup tables for a transaction. If there are multiple errors for the transaction, only the first one is reported. (The account storing the address lookup table was deactivated or could not be found.)
bank_​transaction_​load_​address_​tables_​invalid_​account_​owner counter Result of loading address lookup tables for a transaction. If there are multiple errors for the transaction, only the first one is reported. (The account that owns the referenced lookup table is not the address lookup table program.)
bank_​transaction_​load_​address_​tables_​invalid_​account_​data counter Result of loading address lookup tables for a transaction. If there are multiple errors for the transaction, only the first one is reported. (The data for the referenced address lookup table is malformed.)
bank_​transaction_​load_​address_​tables_​invalid_​index counter Result of loading address lookup tables for a transaction. If there are multiple errors for the transaction, only the first one is reported. (The referenced index in the address lookup table does not exist.)
bank_​transaction_​result_​success counter Result of loading and executing a transaction. (Success)
bank_​transaction_​result_​account_​in_​use counter Result of loading and executing a transaction. (An account is already being processed in another transaction in a way that does not support parallelism.)
bank_​transaction_​result_​account_​loaded_​twice counter Result of loading and executing a transaction. (A Pubkey appears twice in the transaction's account_keys. Instructions can reference Pubkeys more than once but the message must contain a list with no duplicate keys.)
bank_​transaction_​result_​account_​not_​found counter Result of loading and executing a transaction. (Attempt to debit an account but found no record of a prior credit.)
bank_​transaction_​result_​program_​account_​not_​found counter Result of loading and executing a transaction. (Attempt to load a program that does not exist.)
bank_​transaction_​result_​insufficient_​funds_​for_​fee counter Result of loading and executing a transaction. (The fee payer Pubkey does not have sufficient balance to pay the fee to schedule the transaction.)
bank_​transaction_​result_​invalid_​account_​for_​fee counter Result of loading and executing a transaction. (This account may not be used to pay transaction fees.)
bank_​transaction_​result_​already_​processed counter Result of loading and executing a transaction. (The bank has seen this transaction before. This can occur under normal operation when a UDP packet is duplicated, as a user error from a client not updating its recent_blockhash, or as a double-spend attack.)
bank_​transaction_​result_​blockhash_​not_​found counter Result of loading and executing a transaction. (The bank has not seen the given recent_blockhash or the transaction is too old and the recent_blockhash has been discarded.)
bank_​transaction_​result_​instruction_​error counter Result of loading and executing a transaction. (An error occurred while processing an instruction.)
bank_​transaction_​result_​call_​chain_​too_​deep counter Result of loading and executing a transaction. (Loader call chain is too deep.)
bank_​transaction_​result_​missing_​signature_​for_​fee counter Result of loading and executing a transaction. (Transaction requires a fee but has no signature present.)
bank_​transaction_​result_​invalid_​account_​index counter Result of loading and executing a transaction. (Transaction contains an invalid account reference.)
bank_​transaction_​result_​signature_​failure counter Result of loading and executing a transaction. (Transaction did not pass signature verification.)
bank_​transaction_​result_​invalid_​program_​for_​execution counter Result of loading and executing a transaction. (This program may not be used for executing instructions.)
bank_​transaction_​result_​sanitize_​failure counter Result of loading and executing a transaction. (Transaction failed to sanitize accounts offsets correctly implies that account locks are not taken for this TX, and should not be unlocked.)
bank_​transaction_​result_​cluster_​maintenance counter Result of loading and executing a transaction. (Transactions are currently disabled due to cluster maintenance.)
bank_​transaction_​result_​account_​borrow_​outstanding counter Result of loading and executing a transaction. (Transaction processing left an account with an outstanding borrowed reference.)
bank_​transaction_​result_​would_​exceed_​max_​block_​cost_​limit counter Result of loading and executing a transaction. (Transaction would exceed max Block Cost Limit.)
bank_​transaction_​result_​unsupported_​version counter Result of loading and executing a transaction. (Transaction version is unsupported.)
bank_​transaction_​result_​invalid_​writable_​account counter Result of loading and executing a transaction. (Transaction loads a writable account that cannot be written.)
bank_​transaction_​result_​would_​exceed_​max_​account_​cost_​limit counter Result of loading and executing a transaction. (Transaction would exceed max account limit within the block.)
bank_​transaction_​result_​would_​exceed_​account_​data_​block_​limit counter Result of loading and executing a transaction. (Transaction would exceed account data limit within the block.)
bank_​transaction_​result_​too_​many_​account_​locks counter Result of loading and executing a transaction. (Transaction locked too many accounts.)
bank_​transaction_​result_​address_​lookup_​table_​not_​found counter Result of loading and executing a transaction. (Address lookup table not found.)
bank_​transaction_​result_​invalid_​address_​lookup_​table_​owner counter Result of loading and executing a transaction. (Attempted to lookup addresses from an account owned by the wrong program.)
bank_​transaction_​result_​invalid_​address_​lookup_​table_​data counter Result of loading and executing a transaction. (Attempted to lookup addresses from an invalid account.)
bank_​transaction_​result_​invalid_​address_​lookup_​table_​index counter Result of loading and executing a transaction. (Address table lookup uses an invalid index.)
bank_​transaction_​result_​invalid_​rent_​paying_​account counter Result of loading and executing a transaction. (Transaction leaves an account with a lower balance than rent-exempt minimum.)
bank_​transaction_​result_​would_​exceed_​max_​vote_​cost_​limit counter Result of loading and executing a transaction. (Transaction would exceed max Vote Cost Limit.)
bank_​transaction_​result_​would_​exceed_​account_​data_​total_​limit counter Result of loading and executing a transaction. (Transaction would exceed total account data limit.)
bank_​transaction_​result_​duplicate_​instruction counter Result of loading and executing a transaction. (Transaction contains a duplicate instruction that is not allowed.)
bank_​transaction_​result_​insufficient_​funds_​for_​rent counter Result of loading and executing a transaction. (Transaction results in an account with insufficient funds for rent.)
bank_​transaction_​result_​max_​loaded_​accounts_​data_​size_​exceeded counter Result of loading and executing a transaction. (Transaction exceeded max loaded accounts data size cap.)
bank_​transaction_​result_​invalid_​loaded_​accounts_​data_​size_​limit counter Result of loading and executing a transaction. (LoadedAccountsDataSizeLimit set for transaction must be greater than 0.)
bank_​transaction_​result_​resanitization_​needed counter Result of loading and executing a transaction. (Sanitized transaction differed before/after feature activation. Needs to be resanitized.)
bank_​transaction_​result_​program_​execution_​temporarily_​restricted counter Result of loading and executing a transaction. (Program execution is temporarily restricted on an account.)
bank_​transaction_​result_​unbalanced_​transaction counter Result of loading and executing a transaction. (The total balance before the transaction does not equal the total balance after the transaction.)
bank_​transaction_​result_​program_​cache_​hit_​max_​limit counter Result of loading and executing a transaction. (The total program cache size hit the maximum allowed limit.)
bank_​transaction_​result_​commit_​cancelled counter Result of loading and executing a transaction. (The process for comitting the transaction was cancelled internaly.)
bank_​transaction_​result_​bundle_​peer counter Result of loading and executing a transaction. (Transaction is part of a bundle and one of the peer transactions failed.)
bank_​processing_​failed counter Count of transactions for which the processing stage failed and won't land on chain
bank_​fee_​only_​transactions counter Count of transactions that will land on chain but without executing
bank_​executed_​failed_​transactions counter Count of transactions that execute on chain but failed
bank_​successful_​transactions counter Count of transactions that execute on chain and succeed
bank_​cost_​model_​undercount counter Count of transactions that used more CUs than the cost model should have permitted them to

Poh Tile

Metric Type Description
poh_​begin_​leader_​delay_​seconds histogram Delay between when we become leader in a slot and when we receive the bank.
poh_​first_​microblock_​delay_​seconds histogram Delay between when we become leader in a slot and when we receive the first microblock.
poh_​slot_​done_​delay_​seconds histogram Delay between when we become leader in a slot and when we finish the slot.
poh_​bundle_​initialize_​delay_​seconds histogram Delay in starting the slot caused by loading the information needed to generate the bundle crank transactions

Shred Tile

Metric Type Description
shred_​cluster_​contact_​info_​cnt histogram Number of contact infos in the cluster contact info message
shred_​microblocks_​abandoned counter The number of microblocks that were abandoned because we switched slots without finishing the current slot
shred_​batch_​sz histogram The size (in bytes) of each microblock batch that is shredded
shred_​batch_​microblock_​cnt histogram The number of microblocks in each microblock batch that is shredded
shred_​shredding_​duration_​seconds histogram Duration of producing one FEC set from the shredder
shred_​add_​shred_​duration_​seconds histogram Duration of verifying and processing one shred received from the network
shred_​shred_​processed_​bad_​slot counter The result of processing a thread from the network (Shred was for a slot for which we don't know the leader)
shred_​shred_​processed_​parse_​failed counter The result of processing a thread from the network (Shred parsing failed)
shred_​shred_​processed_​rejected counter The result of processing a thread from the network (Shred was invalid for one of many reasons)
shred_​shred_​processed_​ignored counter The result of processing a thread from the network (Shred was ignored because we had already received or reconstructed it)
shred_​shred_​processed_​okay counter The result of processing a thread from the network (Shred accepted to an incomplete FEC set)
shred_​shred_​processed_​completes counter The result of processing a thread from the network (Shred accepted and resulted in a valid, complete FEC set)
shred_​fec_​set_​spilled counter The number of FEC sets that were spilled because they didn't complete in time and we needed space
shred_​shred_​rejected_​initial counter The number shreds that were rejected before any resources were allocated for the FEC set
shred_​fec_​rejected_​fatal counter The number of FEC sets that were rejected for reasons that cause the whole FEC set to become invalid

Store Tile

Metric Type Description
store_​transactions_​inserted counter Count of transactions produced while we were leader in the shreds that have been inserted so far

Replay Tile

Metric Type Description
replay_​slot gauge
replay_​last_​voted_​slot gauge

Storei Tile

Metric Type Description
storei_​first_​turbine_​slot gauge
storei_​current_​turbine_​slot gauge

Gossip Tile

Metric Type Description
gossip_​last_​crds_​push_​contact_​info_​publish_​timestamp_​nanos gauge Time (in nanoseconds) of last CRDS Push ContactInfo message publish
gossip_​mismatched_​contact_​info_​shred_​version counter Mismatched Contact Info Shred Version
gossip_​ipv6_​contact_​info_​tvu counter IPv6 Contact Info (by peer type) (TVU)
gossip_​ipv6_​contact_​info_​repair counter IPv6 Contact Info (by peer type) (Repair)
gossip_​ipv6_​contact_​info_​voter counter IPv6 Contact Info (by peer type) (Voter)
gossip_​zero_​ipv4_​contact_​info_​tvu counter Zero IPv4 Contact Info (by peer type) (TVU)
gossip_​zero_​ipv4_​contact_​info_​repair counter Zero IPv4 Contact Info (by peer type) (Repair)
gossip_​zero_​ipv4_​contact_​info_​voter counter Zero IPv4 Contact Info (by peer type) (Voter)
gossip_​peer_​counts_​tvu gauge Number of peers of each type (TVU)
gossip_​peer_​counts_​repair gauge Number of peers of each type (Repair)
gossip_​peer_​counts_​voter gauge Number of peers of each type (Voter)
gossip_​shred_​version_​zero counter Shred version zero
gossip_​received_​packets counter Number of all gossip packets received
gossip_​corrupted_​messages counter Number of corrupted gossip messages received
gossip_​received_​gossip_​messages_​pull_​request counter Number of gossip messages received (Pull Request)
gossip_​received_​gossip_​messages_​pull_​response counter Number of gossip messages received (Pull Response)
gossip_​received_​gossip_​messages_​push counter Number of gossip messages received (Push)
gossip_​received_​gossip_​messages_​prune counter Number of gossip messages received (Prune)
gossip_​received_​gossip_​messages_​ping counter Number of gossip messages received (Ping)
gossip_​received_​gossip_​messages_​pong counter Number of gossip messages received (Pong)
gossip_​received_​unknown_​message counter Number of gossip messages received that have an unknown discriminant
gossip_​received_​crds_​push_​contact_​info_​v1 counter Number of CRDS values received from push messages (Contact Info V1)
gossip_​received_​crds_​push_​vote counter Number of CRDS values received from push messages (Vote)
gossip_​received_​crds_​push_​lowest_​slot counter Number of CRDS values received from push messages (Lowest Slot)
gossip_​received_​crds_​push_​snapshot_​hashes counter Number of CRDS values received from push messages (Snapshot Hashes)
gossip_​received_​crds_​push_​accounts_​hashes counter Number of CRDS values received from push messages (Accounts Hashes)
gossip_​received_​crds_​push_​epoch_​slots counter Number of CRDS values received from push messages (Epoch Slots)
gossip_​received_​crds_​push_​version_​v1 counter Number of CRDS values received from push messages (Version V1)
gossip_​received_​crds_​push_​version_​v2 counter Number of CRDS values received from push messages (Version V2)
gossip_​received_​crds_​push_​node_​instance counter Number of CRDS values received from push messages (Node Instance)
gossip_​received_​crds_​push_​duplicate_​shred counter Number of CRDS values received from push messages (Duplicate Shred)
gossip_​received_​crds_​push_​incremental_​snapshot_​hashes counter Number of CRDS values received from push messages (Incremental Snapshot Hashes)
gossip_​received_​crds_​push_​contact_​info_​v2 counter Number of CRDS values received from push messages (Contact Info V2)
gossip_​received_​crds_​push_​restart_​last_​voted_​fork_​slots counter Number of CRDS values received from push messages (Restart Last Voted Fork Slots)
gossip_​received_​crds_​push_​restart_​heaviest_​fork counter Number of CRDS values received from push messages (Restart Heaviest Fork)
gossip_​received_​crds_​pull_​contact_​info_​v1 counter Number of CRDS values received from pull response messages (Contact Info V1)
gossip_​received_​crds_​pull_​vote counter Number of CRDS values received from pull response messages (Vote)
gossip_​received_​crds_​pull_​lowest_​slot counter Number of CRDS values received from pull response messages (Lowest Slot)
gossip_​received_​crds_​pull_​snapshot_​hashes counter Number of CRDS values received from pull response messages (Snapshot Hashes)
gossip_​received_​crds_​pull_​accounts_​hashes counter Number of CRDS values received from pull response messages (Accounts Hashes)
gossip_​received_​crds_​pull_​epoch_​slots counter Number of CRDS values received from pull response messages (Epoch Slots)
gossip_​received_​crds_​pull_​version_​v1 counter Number of CRDS values received from pull response messages (Version V1)
gossip_​received_​crds_​pull_​version_​v2 counter Number of CRDS values received from pull response messages (Version V2)
gossip_​received_​crds_​pull_​node_​instance counter Number of CRDS values received from pull response messages (Node Instance)
gossip_​received_​crds_​pull_​duplicate_​shred counter Number of CRDS values received from pull response messages (Duplicate Shred)
gossip_​received_​crds_​pull_​incremental_​snapshot_​hashes counter Number of CRDS values received from pull response messages (Incremental Snapshot Hashes)
gossip_​received_​crds_​pull_​contact_​info_​v2 counter Number of CRDS values received from pull response messages (Contact Info V2)
gossip_​received_​crds_​pull_​restart_​last_​voted_​fork_​slots counter Number of CRDS values received from pull response messages (Restart Last Voted Fork Slots)
gossip_​received_​crds_​pull_​restart_​heaviest_​fork counter Number of CRDS values received from pull response messages (Restart Heaviest Fork)
gossip_​received_​crds_​duplicate_​message_​push_​contact_​info_​v1 counter Number of duplicate CRDS values received from push messages (Contact Info V1)
gossip_​received_​crds_​duplicate_​message_​push_​vote counter Number of duplicate CRDS values received from push messages (Vote)
gossip_​received_​crds_​duplicate_​message_​push_​lowest_​slot counter Number of duplicate CRDS values received from push messages (Lowest Slot)
gossip_​received_​crds_​duplicate_​message_​push_​snapshot_​hashes counter Number of duplicate CRDS values received from push messages (Snapshot Hashes)
gossip_​received_​crds_​duplicate_​message_​push_​accounts_​hashes counter Number of duplicate CRDS values received from push messages (Accounts Hashes)
gossip_​received_​crds_​duplicate_​message_​push_​epoch_​slots counter Number of duplicate CRDS values received from push messages (Epoch Slots)
gossip_​received_​crds_​duplicate_​message_​push_​version_​v1 counter Number of duplicate CRDS values received from push messages (Version V1)
gossip_​received_​crds_​duplicate_​message_​push_​version_​v2 counter Number of duplicate CRDS values received from push messages (Version V2)
gossip_​received_​crds_​duplicate_​message_​push_​node_​instance counter Number of duplicate CRDS values received from push messages (Node Instance)
gossip_​received_​crds_​duplicate_​message_​push_​duplicate_​shred counter Number of duplicate CRDS values received from push messages (Duplicate Shred)
gossip_​received_​crds_​duplicate_​message_​push_​incremental_​snapshot_​hashes counter Number of duplicate CRDS values received from push messages (Incremental Snapshot Hashes)
gossip_​received_​crds_​duplicate_​message_​push_​contact_​info_​v2 counter Number of duplicate CRDS values received from push messages (Contact Info V2)
gossip_​received_​crds_​duplicate_​message_​push_​restart_​last_​voted_​fork_​slots counter Number of duplicate CRDS values received from push messages (Restart Last Voted Fork Slots)
gossip_​received_​crds_​duplicate_​message_​push_​restart_​heaviest_​fork counter Number of duplicate CRDS values received from push messages (Restart Heaviest Fork)
gossip_​received_​crds_​duplicate_​message_​pull_​contact_​info_​v1 counter Number of duplicate CRDS values received from pull response messages (Contact Info V1)
gossip_​received_​crds_​duplicate_​message_​pull_​vote counter Number of duplicate CRDS values received from pull response messages (Vote)
gossip_​received_​crds_​duplicate_​message_​pull_​lowest_​slot counter Number of duplicate CRDS values received from pull response messages (Lowest Slot)
gossip_​received_​crds_​duplicate_​message_​pull_​snapshot_​hashes counter Number of duplicate CRDS values received from pull response messages (Snapshot Hashes)
gossip_​received_​crds_​duplicate_​message_​pull_​accounts_​hashes counter Number of duplicate CRDS values received from pull response messages (Accounts Hashes)
gossip_​received_​crds_​duplicate_​message_​pull_​epoch_​slots counter Number of duplicate CRDS values received from pull response messages (Epoch Slots)
gossip_​received_​crds_​duplicate_​message_​pull_​version_​v1 counter Number of duplicate CRDS values received from pull response messages (Version V1)
gossip_​received_​crds_​duplicate_​message_​pull_​version_​v2 counter Number of duplicate CRDS values received from pull response messages (Version V2)
gossip_​received_​crds_​duplicate_​message_​pull_​node_​instance counter Number of duplicate CRDS values received from pull response messages (Node Instance)
gossip_​received_​crds_​duplicate_​message_​pull_​duplicate_​shred counter Number of duplicate CRDS values received from pull response messages (Duplicate Shred)
gossip_​received_​crds_​duplicate_​message_​pull_​incremental_​snapshot_​hashes counter Number of duplicate CRDS values received from pull response messages (Incremental Snapshot Hashes)
gossip_​received_​crds_​duplicate_​message_​pull_​contact_​info_​v2 counter Number of duplicate CRDS values received from pull response messages (Contact Info V2)
gossip_​received_​crds_​duplicate_​message_​pull_​restart_​last_​voted_​fork_​slots counter Number of duplicate CRDS values received from pull response messages (Restart Last Voted Fork Slots)
gossip_​received_​crds_​duplicate_​message_​pull_​restart_​heaviest_​fork counter Number of duplicate CRDS values received from pull response messages (Restart Heaviest Fork)
gossip_​received_​crds_​drop_​success counter Number of CRDS values dropped on receive (Successfully processed CRDS (not dropped))
gossip_​received_​crds_​drop_​duplicate counter Number of CRDS values dropped on receive (Duplicate CRDS value)
gossip_​received_​crds_​drop_​unknown_​discriminant counter Number of CRDS values dropped on receive (Unknown discriminant)
gossip_​received_​crds_​drop_​own_​message counter Number of CRDS values dropped on receive (Own message)
gossip_​received_​crds_​drop_​invalid_​signature counter Number of CRDS values dropped on receive (Invalid signature)
gossip_​received_​crds_​drop_​table_​full counter Number of CRDS values dropped on receive (Table full)
gossip_​received_​crds_​drop_​push_​queue_​full counter Number of CRDS values dropped on receive (Push queue full)
gossip_​received_​crds_​drop_​invalid_​gossip_​port counter Number of CRDS values dropped on receive (Invalid gossip port)
gossip_​received_​crds_​drop_​peer_​table_​full counter Number of CRDS values dropped on receive (Peer table full)
gossip_​received_​crds_​drop_​inactives_​queue_​full counter Number of CRDS values dropped on receive (Inactives queue full)
gossip_​received_​crds_​drop_​discarded_​peer counter Number of CRDS values dropped on receive (Discarded peer)
gossip_​received_​crds_​drop_​encoding_​failed counter Number of CRDS values dropped on receive (Encoding failed)
gossip_​push_​crds_​contact_​info_​v1 counter Number of CRDS values pushed (Contact Info V1)
gossip_​push_​crds_​vote counter Number of CRDS values pushed (Vote)
gossip_​push_​crds_​lowest_​slot counter Number of CRDS values pushed (Lowest Slot)
gossip_​push_​crds_​snapshot_​hashes counter Number of CRDS values pushed (Snapshot Hashes)
gossip_​push_​crds_​accounts_​hashes counter Number of CRDS values pushed (Accounts Hashes)
gossip_​push_​crds_​epoch_​slots counter Number of CRDS values pushed (Epoch Slots)
gossip_​push_​crds_​version_​v1 counter Number of CRDS values pushed (Version V1)
gossip_​push_​crds_​version_​v2 counter Number of CRDS values pushed (Version V2)
gossip_​push_​crds_​node_​instance counter Number of CRDS values pushed (Node Instance)
gossip_​push_​crds_​duplicate_​shred counter Number of CRDS values pushed (Duplicate Shred)
gossip_​push_​crds_​incremental_​snapshot_​hashes counter Number of CRDS values pushed (Incremental Snapshot Hashes)
gossip_​push_​crds_​contact_​info_​v2 counter Number of CRDS values pushed (Contact Info V2)
gossip_​push_​crds_​restart_​last_​voted_​fork_​slots counter Number of CRDS values pushed (Restart Last Voted Fork Slots)
gossip_​push_​crds_​restart_​heaviest_​fork counter Number of CRDS values pushed (Restart Heaviest Fork)
gossip_​push_​crds_​duplicate_​message_​contact_​info_​v1 counter Number of duplicate CRDS values inserted (internally) (Contact Info V1)
gossip_​push_​crds_​duplicate_​message_​vote counter Number of duplicate CRDS values inserted (internally) (Vote)
gossip_​push_​crds_​duplicate_​message_​lowest_​slot counter Number of duplicate CRDS values inserted (internally) (Lowest Slot)
gossip_​push_​crds_​duplicate_​message_​snapshot_​hashes counter Number of duplicate CRDS values inserted (internally) (Snapshot Hashes)
gossip_​push_​crds_​duplicate_​message_​accounts_​hashes counter Number of duplicate CRDS values inserted (internally) (Accounts Hashes)
gossip_​push_​crds_​duplicate_​message_​epoch_​slots counter Number of duplicate CRDS values inserted (internally) (Epoch Slots)
gossip_​push_​crds_​duplicate_​message_​version_​v1 counter Number of duplicate CRDS values inserted (internally) (Version V1)
gossip_​push_​crds_​duplicate_​message_​version_​v2 counter Number of duplicate CRDS values inserted (internally) (Version V2)
gossip_​push_​crds_​duplicate_​message_​node_​instance counter Number of duplicate CRDS values inserted (internally) (Node Instance)
gossip_​push_​crds_​duplicate_​message_​duplicate_​shred counter Number of duplicate CRDS values inserted (internally) (Duplicate Shred)
gossip_​push_​crds_​duplicate_​message_​incremental_​snapshot_​hashes counter Number of duplicate CRDS values inserted (internally) (Incremental Snapshot Hashes)
gossip_​push_​crds_​duplicate_​message_​contact_​info_​v2 counter Number of duplicate CRDS values inserted (internally) (Contact Info V2)
gossip_​push_​crds_​duplicate_​message_​restart_​last_​voted_​fork_​slots counter Number of duplicate CRDS values inserted (internally) (Restart Last Voted Fork Slots)
gossip_​push_​crds_​duplicate_​message_​restart_​heaviest_​fork counter Number of duplicate CRDS values inserted (internally) (Restart Heaviest Fork)
gossip_​push_​crds_​drop_​success counter Number of CRDS values dropped on push (Successfully processed CRDS (not dropped))
gossip_​push_​crds_​drop_​duplicate counter Number of CRDS values dropped on push (Duplicate CRDS value)
gossip_​push_​crds_​drop_​unknown_​discriminant counter Number of CRDS values dropped on push (Unknown discriminant)
gossip_​push_​crds_​drop_​own_​message counter Number of CRDS values dropped on push (Own message)
gossip_​push_​crds_​drop_​invalid_​signature counter Number of CRDS values dropped on push (Invalid signature)
gossip_​push_​crds_​drop_​table_​full counter Number of CRDS values dropped on push (Table full)
gossip_​push_​crds_​drop_​push_​queue_​full counter Number of CRDS values dropped on push (Push queue full)
gossip_​push_​crds_​drop_​invalid_​gossip_​port counter Number of CRDS values dropped on push (Invalid gossip port)
gossip_​push_​crds_​drop_​peer_​table_​full counter Number of CRDS values dropped on push (Peer table full)
gossip_​push_​crds_​drop_​inactives_​queue_​full counter Number of CRDS values dropped on push (Inactives queue full)
gossip_​push_​crds_​drop_​discarded_​peer counter Number of CRDS values dropped on push (Discarded peer)
gossip_​push_​crds_​drop_​encoding_​failed counter Number of CRDS values dropped on push (Encoding failed)
gossip_​push_​crds_​queue_​count gauge Number of CRDS values in the queue to be pushed
gossip_​active_​push_​destinations gauge Number of active Push destinations
gossip_​refresh_​push_​states_​fail_​count counter Number of failures whilst refreshing push states
gossip_​pull_​req_​fail_​peer_​not_​in_​actives counter Number of PullReq messages that failed (Number of PullReq messages from peers that are not in the active set)
gossip_​pull_​req_​fail_​unresponsive_​peer counter Number of PullReq messages that failed (Number of PullReq messages from a peer that hasn't responded to our ping message yet)
gossip_​pull_​req_​fail_​pending_​pool_​full counter Number of PullReq messages that failed (Number of PullReq messages skipped due to the pending pool being full)
gossip_​pull_​req_​fail_​encoding_​failed counter Number of PullReq messages that failed (Number of PullReq messages skipped due to message encoding failed)
gossip_​pull_​req_​bloom_​filter_​hit counter Result of the bloom filter check for a PullReq (Number of PullReq messages that hit the bloom filter)
gossip_​pull_​req_​bloom_​filter_​miss counter Result of the bloom filter check for a PullReq (Number of PullReq messages that missed the bloom filter)
gossip_​pull_​req_​resp_​packets gauge Number of packets used to respond to a PullReq
gossip_​prune_​fail_​count_​not_​for_​me counter Number of Prune messages that failed (Prune message not for me)
gossip_​prune_​fail_​count_​sign_​encoding_​failed counter Number of Prune messages that failed (Prune message sign encoding failed)
gossip_​prune_​fail_​count_​invalid_​signature counter Number of Prune messages that failed (Prune message invalid signature)
gossip_​make_​prune_​stale_​entry counter Number of stale entries removed from the stats table while making prune messages
gossip_​make_​prune_​high_​duplicates counter Number of origins with high duplicate counts found while making prune messages
gossip_​make_​prune_​requested_​origins gauge Number of requested origins in the last prune message we made
gossip_​make_​prune_​sign_​data_​encode_​failed counter Number of times we failed to encode the sign data
gossip_​sent_​gossip_​messages_​pull_​request counter Number of gossip messages sent (Pull Request)
gossip_​sent_​gossip_​messages_​pull_​response counter Number of gossip messages sent (Pull Response)
gossip_​sent_​gossip_​messages_​push counter Number of gossip messages sent (Push)
gossip_​sent_​gossip_​messages_​prune counter Number of gossip messages sent (Prune)
gossip_​sent_​gossip_​messages_​ping counter Number of gossip messages sent (Ping)
gossip_​sent_​gossip_​messages_​pong counter Number of gossip messages sent (Pong)
gossip_​sent_​packets counter Number of Packets sent
gossip_​send_​ping_​event_​actives_​table_​full counter Number of Ping messages sent with non-standard outcomes (Number of Ping messages we failed to send due to the Active Peers table being full)
gossip_​send_​ping_​event_​actives_​table_​insert counter Number of Ping messages sent with non-standard outcomes (Number of Ping messages that cause an insert into the Active Peers table)
gossip_​send_​ping_​event_​max_​ping_​count_​exceeded counter Number of Ping messages sent with non-standard outcomes (Number of times we removed a peer from the Actives table, because it repeatedly failed to respond to a ping)
gossip_​recv_​ping_​invalid_​signature counter Number of times we received a Ping message with an invalid signature
gossip_​recv_​pong_​event_​new_​peer counter Number of Pong messages processed with non-standard outcomes (Pong peer is not in table)
gossip_​recv_​pong_​event_​wrong_​token counter Number of Pong messages processed with non-standard outcomes (Pong peer token mismatch)
gossip_​recv_​pong_​event_​invalid_​signature counter Number of Pong messages processed with non-standard outcomes (Pong peer invalid signature)
gossip_​recv_​pong_​event_​expired counter Number of Pong messages processed with non-standard outcomes (Pong peer expired)
gossip_​recv_​pong_​event_​table_​full counter Number of Pong messages processed with non-standard outcomes (Unable to insert peer due to table full)
gossip_​gossip_​peer_​counts_​total gauge Number of gossip peers tracked (Total Peers Detected)
gossip_​gossip_​peer_​counts_​active gauge Number of gossip peers tracked (Active)
gossip_​gossip_​peer_​counts_​inactive gauge Number of gossip peers tracked (Inactive)

Netlnk Tile

Metric Type Description
netlnk_​drop_​events counter Number of netlink drop events caught
netlnk_​link_​full_​syncs counter Number of full link table syncs done
netlnk_​route_​full_​syncs counter Number of full route table syncs done
netlnk_​updates_​link counter Number of netlink live updates processed (Link)
netlnk_​updates_​neigh counter Number of netlink live updates processed (Neighbor Table Entry)
netlnk_​updates_​ipv4_​route counter Number of netlink live updates processed (IPv4 Route Table Entry)
netlnk_​interface_​count gauge Number of network interfaces
netlnk_​route_​count_​local gauge Number of IPv4 routes (Local)
netlnk_​route_​count_​main gauge Number of IPv4 routes (Main)
netlnk_​neigh_​probe_​sent counter Number of neighbor solicit requests sent to kernel
netlnk_​neigh_​probe_​fails counter Number of neighbor solicit requests that failed to send (kernel too slow)
netlnk_​neigh_​probe_​rate_​limit_​host counter Number of neighbor solicit that exceeded the per-host rate limit
netlnk_​neigh_​probe_​rate_​limit_​global counter Number of neighbor solicit that exceeded the global rate limit

Sock Tile

Metric Type Description
sock_​syscalls_​sendmmsg counter Number of sendmmsg syscalls dispatched
sock_​syscalls_​recvmmsg counter Number of recvmsg syscalls dispatched
sock_​rx_​pkt_​cnt counter Number of packets received
sock_​tx_​pkt_​cnt counter Number of packets sent
sock_​tx_​drop_​cnt counter Number of packets failed to send
sock_​tx_​bytes_​total counter Total number of bytes transmitted (including Ethernet header).
sock_​rx_​bytes_​total counter Total number of bytes received (including Ethernet header).

Repair Tile

Metric Type Description
repair_​recv_​clnt_​pkt counter Now many client packets have we received
repair_​recv_​serv_​pkt counter How many server packets have we received
repair_​recv_​serv_​corrupt_​pkt counter How many corrupt server packets have we received
repair_​recv_​serv_​invalid_​signature counter How many invalid signatures have we received
repair_​recv_​serv_​full_​ping_​table counter Is our ping table full and causing packet drops
repair_​recv_​serv_​pkt_​types_​pong counter Server messages received (Pong)
repair_​recv_​serv_​pkt_​types_​window counter Server messages received (Window)
repair_​recv_​serv_​pkt_​types_​highest_​window counter Server messages received (Highest Window)
repair_​recv_​serv_​pkt_​types_​orphan counter Server messages received (Orphan)
repair_​recv_​serv_​pkt_​types_​unknown counter Server messages received (Unknown)
repair_​recv_​pkt_​corrupted_​msg counter How many corrupt messages have we received
repair_​send_​pkt_​cnt counter How many packets have sent
repair_​sent_​pkt_​types_​needed_​window counter What types of client messages are we sending (Need Window)
repair_​sent_​pkt_​types_​needed_​highest_​window counter What types of client messages are we sending (Need Highest Window)
repair_​sent_​pkt_​types_​needed_​orphan counter What types of client messages are we sending (Need Orphans)