-
Notifications
You must be signed in to change notification settings - Fork 54
Open
Description
When deploying DSE on k8ssandra or Mission-Control the following error can be seen repeating in the system and debug logs of the nodes deployed in the data plane.
ERROR [epollEventLoopGroup-9-1] 2025-10-21 14:48:41,612 CassandraMetricRegistryListener.java:410 - Values and bucket lengths do not match: 1028 != 90. SnapshotClass: com.codahale.metrics.WeightedSnapshot, metric: com_datastax_bdp_type_performance_objects_name_cql_slow_log_metrics_queries_latency
The error can be safely ignored but repeats every 30 seconds, generating about 3% overhead in the system logs due to the regular repetition. Issue is trivial and can be ignored but recording it for reference
# Total of errors in logs
╰─$ find . -name system.log | while read sysl; do val=$(grep "ERROR" $sysl |wc -l) ; echo $val $sysl; done
2226 ./nodes/k8-rack1-sts-0_artifacts_2025/logs/system.log
2372 ./nodes/k8-rack1-sts-1_artifacts_2025/logs/system.log
2265 ./nodes/k8-rack1-sts-2_artifacts_2025/logs/system.log
2313 ./nodes/k8-rack1-sts-3_artifacts_2025/logs/system.log
2325 ./nodes/k8-rack1-sts-4_artifacts_2025/logs/system.log
2341 ./nodes/k8-rack1-sts-5_artifacts_2025/logs/system.log
# Error count minus referenced issue
╰─$ find . -name system.log | while read sysl; do val=$(grep "ERROR" $sysl | grep -v "Values and bucket" | wc -l) ; echo $val $sysl; done
9 ./nodes/k8-rack1-sts-0_artifacts_2025/logs/system.log
9 ./nodes/k8-rack1-sts-1_artifacts_2025/logs/system.log
9 ./nodes/k8-rack1-sts-2_artifacts_2025/logs/system.log
11 ./nodes/k8-rack1-sts-3_artifacts_2025/logs/system.log
9 ./nodes/k8-rack1-sts-4_artifacts_2025/logs/system.log
10 ./nodes/k8-rack1-sts-5_artifacts_2025/logs/system.log
# Recurrence of issue (30s)
╰─$ find . -name system.log | while read sysl ; do echo +++ $sysl +++; grep 'Values and bucket' $sysl; done | head -8
+++ ./k8-rack-1-sts-5_artifacts_2025/logs/system.log +++
ERROR [epollEventLoopGroup-9-1] 2025-10-21 14:32:41,240 CassandraMetricRegistryListener.java:410 - Values and bucket lengths do not match: 27 != 90. SnapshotClass: com.codahale.metrics.WeightedSnapshot, metric: com_datastax_bdp_type_performance_objects_name_cql_slow_log_metrics_queries_latency
ERROR [epollEventLoopGroup-9-1] 2025-10-21 14:33:11,153 CassandraMetricRegistryListener.java:410 - Values and bucket lengths do not match: 83 != 90. SnapshotClass: com.codahale.metrics.WeightedSnapshot, metric: com_datastax_bdp_type_performance_objects_name_cql_slow_log_metrics_queries_latency
ERROR [epollEventLoopGroup-9-1] 2025-10-21 14:33:41,151 CassandraMetricRegistryListener.java:410 - Values and bucket lengths do not match: 157 != 90. SnapshotClass: com.codahale.metrics.WeightedSnapshot, metric: com_datastax_bdp_type_performance_objects_name_cql_slow_log_metrics_queries_latency
ERROR [epollEventLoopGroup-9-1] 2025-10-21 14:34:11,148 CassandraMetricRegistryListener.java:410 - Values and bucket lengths do not match: 267 != 90. SnapshotClass: com.codahale.metrics.WeightedSnapshot, metric: com_datastax_bdp_type_performance_objects_name_cql_slow_log_metrics_queries_latency
ERROR [epollEventLoopGroup-9-1] 2025-10-21 14:34:41,148 CassandraMetricRegistryListener.java:410 - Values and bucket lengths do not match: 395 != 90. SnapshotClass: com.codahale.metrics.WeightedSnapshot, metric: com_datastax_bdp_type_performance_objects_name_cql_slow_log_metrics_queries_latency
Addendum:
While the issue has mostly bee seen with the com_datastax_bdp_type_performance_objects_name_cql_slow_log_metrics_queries_latency metric object, it has also been noted once on spark enabled cluster for the lease renewal leader_master_6_8_dc1_renew in a MC cluster:
ERROR [epollEventLoopGroup-10-1] 2024-12-02 16:20:14,782 CassandraMetricRegistryListener.java:410 - Values and bucket lengths do not match: 1028 != 90. SnapshotClass: com.codahale.metrics.WeightedSnapshot, metric: leader_master_6_8_dc1_resolve
ERROR [epollEventLoopGroup-10-1] 2024-12-02 16:20:14,783 CassandraMetricRegistryListener.java:410 - Values and bucket lengths do not match: 0 != 90. SnapshotClass: com.codahale.metrics.WeightedSnapshot, metric: leader_master_6_8_dc1_disable```
Metadata
Metadata
Assignees
Labels
No labels