Task consistency_checker failed: chain mismatch post gateway migration #4394
Description
🐛 Bug Report
The consistency checker is repeatedly throwing an error during EN startup.
📝 Description
There seems to have been a migration "Task consistency_checker failed: Batch #501263 was committed to chain with id 1 while node is configured to check chain with id 9075. Error is thrown so node can restart and reload SL data. If node doesn't make any progress after restart, then it's bug, please contact developers."
🔄 Reproduction Steps
I am running a geth node v1.16.2-stable as my L1 RPC and have tried several external node tags: 2.0-v29.0.0-alpha, 2.0-v28.10.0-alpha, 2.0-v28.9.0-alpha, and 2.0-v28.6.0.
docker-compose.yml
services:
geth:
# ...
zksync:
image: "matterlabs/external-node:latest"
container_name: zksync
entrypoint:
[
"/usr/bin/entrypoint.sh",
"--enable-consensus",
]
depends_on:
postgres:
condition: service_healthy
generate-secrets:
condition: service_completed_successfully
geth:
condition: service_healthy
ports:
- "0.0.0.0:3054:3054"
- "127.0.0.1:3060:3060"
- "127.0.0.1:3061:3061"
- "127.0.0.1:3081:3081"
- "127.0.0.1:5000:5000"
volumes:
- ${DATA_DIR}/rocksdb:/db
- ./nodes/configs:/configs
expose:
- 3322
deploy:
resources:
limits:
cpus: '16.0'
memory: 48G
environment:
DATABASE_URL: "postgres://postgres:${POSTGRES_PASSWORD}@postgres:5430/mainnet2"
DATABASE_POOL_SIZE: 16
EN_HTTP_PORT: 3060
EN_WS_PORT: 3061
EN_HEALTHCHECK_PORT: 3081
EN_PROMETHEUS_PORT: 3322
EN_ETH_CLIENT_URL: ${EN_ETH_CLIENT_URL}
EN_MAIN_NODE_URL: ${EN_MAIN_NODE_URL}
EN_L1_CHAIN_ID: ${EN_L1_CHAIN_ID}
EN_L2_CHAIN_ID: ${EN_L2_CHAIN_ID}
EN_PRUNING_ENABLED: false
EN_STATE_CACHE_PATH: "./db/ext-node/state_keeper"
EN_MERKLE_TREE_PATH: "./db/ext-node/lightweight"
EN_SNAPSHOTS_RECOVERY_ENABLED: "false"
EN_SNAPSHOTS_OBJECT_STORE_BUCKET_BASE_URL: ${EN_SNAPSHOTS_OBJECT_STORE_BUCKET_BASE_URL}
EN_SNAPSHOTS_OBJECT_STORE_MODE: "GCSAnonymousReadOnly"
RUST_LOG: "warn,zksync=info,zksync_core::metadata_calculator=debug,zksync_state=debug,zksync_utils=debug,zksync_web3_decl::client=error"
EN_CONSENSUS_CONFIG_PATH: ${EN_CONSENSUS_CONFIG_PATH}
EN_CONSENSUS_SECRETS_PATH: ${EN_CONSENSUS_SECRETS_PATH}
ZKSYNC_MASTER_POOL_STATEMENT_TIMEOUT: 0
ZKSYNC_REPLICA_POOL_STATEMENT_TIMEOUT: 0
EN_CONSISTENCY_CHECKER_ENABLED: "false"
healthcheck:
test: ["CMD-SHELL", "curl -s http://localhost:3081/health | grep -q '\"status\":\"ready\"' || exit 1"] # healthy or ready??
interval: 60s
timeout: 5s
retries: 360
start_period: 60s
restart: unless-stopped
networks:
- node-net
📎 Log Output
zksync | 2025-08-14T00:00:59.119898Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Finished re-executing tx 0xd4a2…1549 by 0xf54e…0f62 (is_l1: false, #1782 in L1 batch #501264, #2 in L2 block #63452299); status: Success { output: [] }. Tx execution metrics: VmExecutionMetrics { gas_used: 84175, published_bytecode_bytes: 0, l2_l1_long_messages: 0, l2_to_l1_logs: 0, user_l2_to_l1_logs: 0, contracts_used: 0, vm_events: 6, storage_logs: 129, total_log_queries: 176, cycles_used: 8284, computational_gas_used: 84175, pubdata_published: 0, circuit_statistic: CircuitStatistic { main_vm: 1.5481218, ram_permutation: 0.18717213, storage_application: 0.030303031, storage_sorter: 0.0034052725, code_decommitter: 0.0, code_decommitter_sorter: 0.000647191, log_demuxer: 0.003716129, events_sorter: 0.0011506376, keccak256: 0.105802044, ecrecover: 0.14285715, sha256: 0.0, secp256k1_verify: 0.0, transient_storage_checker: 0.0, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }, block execution metrics: VmExecutionMetrics { gas_used: 263256575, published_bytecode_bytes: 0, l2_l1_long_messages: 1280, l2_to_l1_logs: 22, user_l2_to_l1_logs: 21, contracts_used: 866, vm_events: 8893, storage_logs: 349163, total_log_queries: 467860, cycles_used: 22884556, computational_gas_used: 263256575, pubdata_published: 63259, circuit_statistic: CircuitStatistic { main_vm: 4276.685, ram_permutation: 523.73926, storage_application: 700.29785, storage_sorter: 8.880017, code_decommitter: 107.10296, code_decommitter_sorter: 1.6123741, log_demuxer: 9.334842, events_sorter: 1.9082649, keccak256: 312.22864, ecrecover: 331.42758, sha256: 0.052130558, secp256k1_verify: 1.5, transient_storage_checker: 0.024746923, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }
zksync | 2025-08-14T00:00:59.119914Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Setting next L2 block #63452300 (L1 batch #501264) with initial params: timestamp 2025-07-28 10:40:46 UTC, virtual block 1
zksync | 2025-08-14T00:00:59.119920Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}:start_next_l2_block{l1_batch=501264 l2_block=63452300}: zksync_state_keeper::keeper: Initialized new L2 block #63452300 (L1 batch #501264) with timestamp 2025-07-28 10:40:46 UTC
zksync | 2025-08-14T00:00:59.119961Z INFO NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Starting to reexecute transactions from sealed L2 block #63452300
zksync | 2025-08-14T00:00:59.122074Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Finished re-executing tx 0x6e7f…7546 by 0x03ac…074c (is_l1: false, #1783 in L1 batch #501264, #1 in L2 block #63452300); status: Success { output: [] }. Tx execution metrics: VmExecutionMetrics { gas_used: 79923, published_bytecode_bytes: 0, l2_l1_long_messages: 0, l2_to_l1_logs: 0, user_l2_to_l1_logs: 0, contracts_used: 0, vm_events: 3, storage_logs: 119, total_log_queries: 156, cycles_used: 7916, computational_gas_used: 79923, pubdata_published: 0, circuit_statistic: CircuitStatistic { main_vm: 1.4793496, ram_permutation: 0.17916551, storage_application: 0.030303031, storage_sorter: 0.0031572063, code_decommitter: 0.0, code_decommitter_sorter: 0.00056629215, log_demuxer: 0.0032, events_sorter: 0.0005753188, keccak256: 0.092150174, ecrecover: 0.14285715, sha256: 0.0, secp256k1_verify: 0.0, transient_storage_checker: 0.0, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }, block execution metrics: VmExecutionMetrics { gas_used: 263336498, published_bytecode_bytes: 0, l2_l1_long_messages: 1280, l2_to_l1_logs: 22, user_l2_to_l1_logs: 21, contracts_used: 866, vm_events: 8896, storage_logs: 349282, total_log_queries: 468016, cycles_used: 22892472, computational_gas_used: 263336498, pubdata_published: 63259, circuit_statistic: CircuitStatistic { main_vm: 4278.1646, ram_permutation: 523.9184, storage_application: 700.3281, storage_sorter: 8.883175, code_decommitter: 107.10296, code_decommitter_sorter: 1.6129403, log_demuxer: 9.338041, events_sorter: 1.9088402, keccak256: 312.3208, ecrecover: 331.57043, sha256: 0.052130558, secp256k1_verify: 1.5, transient_storage_checker: 0.024746923, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }
zksync | 2025-08-14T00:00:59.122104Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Setting next L2 block #63452301 (L1 batch #501264) with initial params: timestamp 2025-07-28 10:40:48 UTC, virtual block 1
zksync | 2025-08-14T00:00:59.122113Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}:start_next_l2_block{l1_batch=501264 l2_block=63452301}: zksync_state_keeper::keeper: Initialized new L2 block #63452301 (L1 batch #501264) with timestamp 2025-07-28 10:40:48 UTC
zksync | 2025-08-14T00:00:59.122150Z INFO NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Starting to reexecute transactions from sealed L2 block #63452301
zksync | 2025-08-14T00:00:59.124566Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Finished re-executing tx 0x2991…9fab by 0xbc87…8cb3 (is_l1: false, #1784 in L1 batch #501264, #1 in L2 block #63452301); status: Success { output: [] }. Tx execution metrics: VmExecutionMetrics { gas_used: 105910, published_bytecode_bytes: 0, l2_l1_long_messages: 0, l2_to_l1_logs: 0, user_l2_to_l1_logs: 0, contracts_used: 0, vm_events: 4, storage_logs: 145, total_log_queries: 197, cycles_used: 9646, computational_gas_used: 105910, pubdata_published: 13, circuit_statistic: CircuitStatistic { main_vm: 1.8026537, ram_permutation: 0.22094458, storage_application: 0.21212122, storage_sorter: 0.0038337505, code_decommitter: 0.0, code_decommitter_sorter: 0.00068314606, log_demuxer: 0.004111828, events_sorter: 0.0010867133, keccak256: 0.13651878, ecrecover: 0.14285715, sha256: 0.0, secp256k1_verify: 0.0, transient_storage_checker: 0.0, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }, block execution metrics: VmExecutionMetrics { gas_used: 263442408, published_bytecode_bytes: 0, l2_l1_long_messages: 1280, l2_to_l1_logs: 22, user_l2_to_l1_logs: 21, contracts_used: 866, vm_events: 8900, storage_logs: 349427, total_log_queries: 468213, cycles_used: 22902118, computational_gas_used: 263442408, pubdata_published: 63272, circuit_statistic: CircuitStatistic { main_vm: 4279.9673, ram_permutation: 524.13934, storage_application: 700.5402, storage_sorter: 8.887009, code_decommitter: 107.10296, code_decommitter_sorter: 1.6136235, log_demuxer: 9.342154, events_sorter: 1.9099269, keccak256: 312.4573, ecrecover: 331.7133, sha256: 0.052130558, secp256k1_verify: 1.5, transient_storage_checker: 0.024746923, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }
zksync | 2025-08-14T00:00:59.126495Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Finished re-executing tx 0x093c…059e by 0x03ac…074c (is_l1: false, #1785 in L1 batch #501264, #2 in L2 block #63452301); status: Success { output: [] }. Tx execution metrics: VmExecutionMetrics { gas_used: 78972, published_bytecode_bytes: 0, l2_l1_long_messages: 0, l2_to_l1_logs: 0, user_l2_to_l1_logs: 0, contracts_used: 0, vm_events: 3, storage_logs: 114, total_log_queries: 150, cycles_used: 7845, computational_gas_used: 78972, pubdata_published: 0, circuit_statistic: CircuitStatistic { main_vm: 1.4660811, ram_permutation: 0.177506, storage_application: 0.030303031, storage_sorter: 0.0029767945, code_decommitter: 0.0, code_decommitter_sorter: 0.00055730337, log_demuxer: 0.0030451613, events_sorter: 0.0005753188, keccak256: 0.088737205, ecrecover: 0.14285715, sha256: 0.0, secp256k1_verify: 0.0, transient_storage_checker: 0.0, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }, block execution metrics: VmExecutionMetrics { gas_used: 263521380, published_bytecode_bytes: 0, l2_l1_long_messages: 1280, l2_to_l1_logs: 22, user_l2_to_l1_logs: 21, contracts_used: 866, vm_events: 8903, storage_logs: 349541, total_log_queries: 468363, cycles_used: 22909963, computational_gas_used: 263521380, pubdata_published: 63272, circuit_statistic: CircuitStatistic { main_vm: 4281.433, ram_permutation: 524.31683, storage_application: 700.57056, storage_sorter: 8.889985, code_decommitter: 107.10296, code_decommitter_sorter: 1.6141808, log_demuxer: 9.345199, events_sorter: 1.9105022, keccak256: 312.54605, ecrecover: 331.85614, sha256: 0.052130558, secp256k1_verify: 1.5, transient_storage_checker: 0.024746923, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }
zksync | 2025-08-14T00:00:59.126512Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Setting next L2 block #63452302 (L1 batch #501264) with initial params: timestamp 2025-07-28 10:40:51 UTC, virtual block 1
zksync | 2025-08-14T00:00:59.126517Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}:start_next_l2_block{l1_batch=501264 l2_block=63452302}: zksync_state_keeper::keeper: Initialized new L2 block #63452302 (L1 batch #501264) with timestamp 2025-07-28 10:40:51 UTC
zksync | 2025-08-14T00:00:59.126548Z INFO NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Starting to reexecute transactions from sealed L2 block #63452302
zksync | 2025-08-14T00:00:59.128541Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Finished re-executing tx 0x0f1d…5518 by 0x03ac…074c (is_l1: false, #1786 in L1 batch #501264, #1 in L2 block #63452302); status: Success { output: [] }. Tx execution metrics: VmExecutionMetrics { gas_used: 79923, published_bytecode_bytes: 0, l2_l1_long_messages: 0, l2_to_l1_logs: 0, user_l2_to_l1_logs: 0, contracts_used: 0, vm_events: 3, storage_logs: 119, total_log_queries: 156, cycles_used: 7916, computational_gas_used: 79923, pubdata_published: 0, circuit_statistic: CircuitStatistic { main_vm: 1.4793496, ram_permutation: 0.17916551, storage_application: 0.030303031, storage_sorter: 0.0031572063, code_decommitter: 0.0, code_decommitter_sorter: 0.00056629215, log_demuxer: 0.0032, events_sorter: 0.0005753188, keccak256: 0.092150174, ecrecover: 0.14285715, sha256: 0.0, secp256k1_verify: 0.0, transient_storage_checker: 0.0, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }, block execution metrics: VmExecutionMetrics { gas_used: 263601303, published_bytecode_bytes: 0, l2_l1_long_messages: 1280, l2_to_l1_logs: 22, user_l2_to_l1_logs: 21, contracts_used: 866, vm_events: 8906, storage_logs: 349660, total_log_queries: 468519, cycles_used: 22917879, computational_gas_used: 263601303, pubdata_published: 63272, circuit_statistic: CircuitStatistic { main_vm: 4282.9126, ram_permutation: 524.496, storage_application: 700.6008, storage_sorter: 8.893143, code_decommitter: 107.10296, code_decommitter_sorter: 1.614747, log_demuxer: 9.348398, events_sorter: 1.9110775, keccak256: 312.6382, ecrecover: 331.999, sha256: 0.052130558, secp256k1_verify: 1.5, transient_storage_checker: 0.024746923, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }
zksync | 2025-08-14T00:00:59.128558Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Setting next L2 block #63452303 (L1 batch #501264) with initial params: timestamp 2025-07-28 10:40:52 UTC, virtual block 1
zksync | 2025-08-14T00:00:59.128563Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}:start_next_l2_block{l1_batch=501264 l2_block=63452303}: zksync_state_keeper::keeper: Initialized new L2 block #63452303 (L1 batch #501264) with timestamp 2025-07-28 10:40:52 UTC
zksync | 2025-08-14T00:00:59.128598Z INFO NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Starting to reexecute transactions from sealed L2 block #63452303
zksync | 2025-08-14T00:00:59.130549Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Finished re-executing tx 0xd97f…6f7c by 0x3cfe…0b6c (is_l1: false, #1787 in L1 batch #501264, #1 in L2 block #63452303); status: Success { output: [] }. Tx execution metrics: VmExecutionMetrics { gas_used: 79291, published_bytecode_bytes: 0, l2_l1_long_messages: 0, l2_to_l1_logs: 0, user_l2_to_l1_logs: 0, contracts_used: 0, vm_events: 4, storage_logs: 118, total_log_queries: 157, cycles_used: 7785, computational_gas_used: 79291, pubdata_published: 0, circuit_statistic: CircuitStatistic { main_vm: 1.4548682, ram_permutation: 0.17626332, storage_application: 0.030303031, storage_sorter: 0.0031346548, code_decommitter: 0.0, code_decommitter_sorter: 0.00058426964, log_demuxer: 0.0032688172, events_sorter: 0.00076709175, keccak256: 0.088737205, ecrecover: 0.14285715, sha256: 0.0, secp256k1_verify: 0.0, transient_storage_checker: 0.0, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }, block execution metrics: VmExecutionMetrics { gas_used: 263680594, published_bytecode_bytes: 0, l2_l1_long_messages: 1280, l2_to_l1_logs: 22, user_l2_to_l1_logs: 21, contracts_used: 866, vm_events: 8910, storage_logs: 349778, total_log_queries: 468676, cycles_used: 22925664, computational_gas_used: 263680594, pubdata_published: 63272, circuit_statistic: CircuitStatistic { main_vm: 4284.3677, ram_permutation: 524.67224, storage_application: 700.6311, storage_sorter: 8.896277, code_decommitter: 107.10296, code_decommitter_sorter: 1.6153313, log_demuxer: 9.351667, events_sorter: 1.9118446, keccak256: 312.72696, ecrecover: 332.14185, sha256: 0.052130558, secp256k1_verify: 1.5, transient_storage_checker: 0.024746923, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }
zksync | 2025-08-14T00:00:59.130565Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Setting next L2 block #63452304 (L1 batch #501264) with initial params: timestamp 2025-07-28 10:40:53 UTC, virtual block 1
zksync | 2025-08-14T00:00:59.130570Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}:start_next_l2_block{l1_batch=501264 l2_block=63452304}: zksync_state_keeper::keeper: Initialized new L2 block #63452304 (L1 batch #501264) with timestamp 2025-07-28 10:40:53 UTC
zksync | 2025-08-14T00:00:59.130604Z INFO NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Starting to reexecute transactions from sealed L2 block #63452304
zksync | 2025-08-14T00:00:59.132598Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Finished re-executing tx 0x082a…397f by 0x03ac…074c (is_l1: false, #1788 in L1 batch #501264, #1 in L2 block #63452304); status: Success { output: [] }. Tx execution metrics: VmExecutionMetrics { gas_used: 79923, published_bytecode_bytes: 0, l2_l1_long_messages: 0, l2_to_l1_logs: 0, user_l2_to_l1_logs: 0, contracts_used: 0, vm_events: 3, storage_logs: 119, total_log_queries: 156, cycles_used: 7916, computational_gas_used: 79923, pubdata_published: 0, circuit_statistic: CircuitStatistic { main_vm: 1.4793496, ram_permutation: 0.17916551, storage_application: 0.030303031, storage_sorter: 0.0031572063, code_decommitter: 0.0, code_decommitter_sorter: 0.00056629215, log_demuxer: 0.0032, events_sorter: 0.0005753188, keccak256: 0.092150174, ecrecover: 0.14285715, sha256: 0.0, secp256k1_verify: 0.0, transient_storage_checker: 0.0, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }, block execution metrics: VmExecutionMetrics { gas_used: 263760517, published_bytecode_bytes: 0, l2_l1_long_messages: 1280, l2_to_l1_logs: 22, user_l2_to_l1_logs: 21, contracts_used: 866, vm_events: 8913, storage_logs: 349897, total_log_queries: 468832, cycles_used: 22933580, computational_gas_used: 263760517, pubdata_published: 63272, circuit_statistic: CircuitStatistic { main_vm: 4285.847, ram_permutation: 524.8514, storage_application: 700.6614, storage_sorter: 8.899435, code_decommitter: 107.10296, code_decommitter_sorter: 1.6158975, log_demuxer: 9.354867, events_sorter: 1.9124199, keccak256: 312.81912, ecrecover: 332.2847, sha256: 0.052130558, secp256k1_verify: 1.5, transient_storage_checker: 0.024746923, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }
zksync | 2025-08-14T00:00:59.151900Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: Finished re-executing tx 0xb755…d20e by 0x2f63…ddd1 (is_l1: false, #1789 in L1 batch #501264, #2 in L2 block #63452304); status: Success { output: [] }. Tx execution metrics: VmExecutionMetrics { gas_used: 843964, published_bytecode_bytes: 0, l2_l1_long_messages: 0, l2_to_l1_logs: 0, user_l2_to_l1_logs: 0, contracts_used: 0, vm_events: 30, storage_logs: 1463, total_log_queries: 1890, cycles_used: 94278, computational_gas_used: 843964, pubdata_published: 84, circuit_statistic: CircuitStatistic { main_vm: 17.618763, ram_permutation: 2.1794486, storage_application: 0.3939394, storage_sorter: 0.03657849, code_decommitter: 0.0, code_decommitter_sorter: 0.006274157, log_demuxer: 0.037195697, events_sorter: 0.0072234473, keccak256: 1.2286689, ecrecover: 0.14285715, sha256: 0.0, secp256k1_verify: 0.0, transient_storage_checker: 0.0, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }, block execution metrics: VmExecutionMetrics { gas_used: 264604481, published_bytecode_bytes: 0, l2_l1_long_messages: 1280, l2_to_l1_logs: 22, user_l2_to_l1_logs: 21, contracts_used: 866, vm_events: 8943, storage_logs: 351360, total_log_queries: 470722, cycles_used: 23027858, computational_gas_used: 264604481, pubdata_published: 63356, circuit_statistic: CircuitStatistic { main_vm: 4303.466, ram_permutation: 527.0309, storage_application: 701.05536, storage_sorter: 8.936013, code_decommitter: 107.10296, code_decommitter_sorter: 1.6221718, log_demuxer: 9.392063, events_sorter: 1.9196434, keccak256: 314.0478, ecrecover: 332.42755, sha256: 0.052130558, secp256k1_verify: 1.5, transient_storage_checker: 0.024746923, modexp: 0.0, ecadd: 0.0, ecmul: 0.0, ecpairing: 0.0 } }
zksync | 2025-08-14T00:00:59.151929Z DEBUG NamedFuture{name="state_keeper"}:restore_state{n_blocks=1095}: zksync_state_keeper::keeper: All the transactions from the pending state were re-executed successfully
zksync | 2025-08-14T00:00:59.152054Z INFO NamedFuture{name="state_keeper"}: zksync_state_keeper::keeper: Stop request was received
zksync | 2025-08-14T00:00:59.228982Z INFO NamedFuture{name="state_keeper"}: zksync_vm_executor::batch::factory: State keeper exited with an unfinished L1 batch
zksync | 2025-08-14T00:00:59.552085Z INFO zksync_storage::db: Initialized RocksDB `merkle_tree` at `./db/ext-node/lightweight` with RocksDBOptions { block_cache_capacity: Some(134217728), include_indices_and_filters_in_block_cache: false, large_memtable_capacity: Some(268435456), stalled_writes_retries: StalledWritesRetries { max_batch_size: 134217728, timeout: 30s, start_interval: 50ms, max_interval: 2s, scale_factor: 1.5 }, max_open_files: None }
zksync | 2025-08-14T00:00:59.552223Z INFO NamedFuture{name="metadata_calculator"}: zksync_metadata_calculator: Opened Merkle tree RocksDB with configuration MetadataCalculatorConfig { db_path: "./db/ext-node/lightweight", max_open_files: None, mode: Lightweight, delay_interval: 100ms, max_l1_batches_per_iter: 20, multi_get_chunk_size: 500, block_cache_capacity: 134217728, include_indices_and_filters_in_block_cache: false, memtable_capacity: 268435456, stalled_writes_timeout: 30s, sealed_batches_have_protective_reads: false, recovery: MetadataCalculatorRecoveryConfig { desired_chunk_size: 200000, parallel_persistence_buffer: None } } in 8.529975185s
zksync | 2025-08-14T00:00:59.552482Z INFO NamedFuture{name="metadata_calculator"}: zksync_metadata_calculator: Stop request was received
zksync | 2025-08-14T00:01:21.178360Z INFO zksync_node_framework::service: Task sigint_handler finished
zksync | 2025-08-14T00:01:21.178383Z INFO zksync_node_framework::service: Task healthcheck_server finished
zksync | 2025-08-14T00:01:21.178386Z INFO zksync_node_framework::service: Task prometheus_exporter finished
zksync | 2025-08-14T00:01:21.178388Z INFO zksync_node_framework::service: Task reorg_detector finished
zksync | 2025-08-14T00:01:21.178389Z INFO zksync_node_framework::service: Task jemalloc_monitor_task finished
zksync | 2025-08-14T00:01:21.178391Z INFO zksync_node_framework::service: Task postgres_metrics_scraping finished
zksync | 2025-08-14T00:01:21.178393Z INFO zksync_node_framework::service: Task en_protocol_version_metrics finished
zksync | 2025-08-14T00:01:21.178394Z INFO zksync_node_framework::service: Task state_keeper/l2_block_sealer finished
zksync | 2025-08-14T00:01:21.178396Z INFO zksync_node_framework::service: Task state_keeper finished
zksync | 2025-08-14T00:01:21.178398Z INFO zksync_node_framework::service: Task consensus_fetcher finished
zksync | 2025-08-14T00:01:21.178399Z INFO zksync_node_framework::service: Task oneshot_runner finished
zksync | 2025-08-14T00:01:21.178401Z INFO zksync_node_framework::service: Task commitment_generator finished
zksync | 2025-08-14T00:01:21.178402Z INFO zksync_node_framework::service: Task batch_transaction_fetcher finished
zksync | 2025-08-14T00:01:21.178404Z INFO zksync_node_framework::service: Task transaction_finality_updater finished
zksync | 2025-08-14T00:01:21.178406Z ERROR zksync_node_framework::service: Task miniblock_precommit_fetcher timed out
zksync | 2025-08-14T00:01:21.178408Z INFO zksync_node_framework::service: Task metadata_calculator finished
zksync | 2025-08-14T00:01:21.178410Z INFO zksync_node_framework::service: Task sync_state_metrics_task finished
zksync | 2025-08-14T00:01:21.178411Z INFO zksync_node_framework::service: Task bridge_addresses_updater_task finished
zksync | 2025-08-14T00:01:21.178413Z INFO zksync_node_framework::service: Task mempool_cache_update_task finished
zksync | 2025-08-14T00:01:21.178414Z INFO zksync_node_framework::service: Task main_node_fee_params_fetcher finished
zksync | 2025-08-14T00:01:21.178416Z INFO zksync_node_framework::service: Task account_nonce_sweeper_task finished
zksync | 2025-08-14T00:01:21.178417Z INFO zksync_node_framework::service: Task vm_concurrency_barrier_task finished
zksync | 2025-08-14T00:01:21.178419Z INFO zksync_node_framework::service: Task postgres_storage_caches finished
zksync | 2025-08-14T00:01:21.178420Z INFO zksync_node_framework::service: Task whitelisted_tokens_for_aa_update_task finished
zksync | 2025-08-14T00:01:21.178422Z INFO zksync_node_framework::service: Task web3_http_server finished
zksync | 2025-08-14T00:01:21.178424Z INFO zksync_node_framework::service: Task api_sealed_l2_block_updater_task finished
zksync | 2025-08-14T00:01:21.178428Z INFO zksync_node_framework::service: Task web3_ws_server finished
zksync | 2025-08-14T00:01:21.178429Z INFO zksync_node_framework::service: Task api/pub_sub_notifiers/blocks finished
zksync | 2025-08-14T00:01:21.178431Z INFO zksync_node_framework::service: Task api/pub_sub_notifiers/txs finished
zksync | 2025-08-14T00:01:21.178432Z INFO zksync_node_framework::service: Task api/pub_sub_notifiers/logs finished
zksync | 2025-08-14T00:01:21.178434Z INFO zksync_node_framework::service: Task api_sealed_l2_block_updater_task finished
zksync | 2025-08-14T00:01:21.178622Z INFO zksync_storage::db: All the RocksDB instances are dropped
zksync | 2025-08-14T00:01:21.178673Z INFO zksync_node_framework::service: Shutdown hook rocksdb_terminaton completed
zksync | 2025-08-14T00:01:21.178695Z INFO zksync_storage::db: All the RocksDB instances are dropped
zksync | 2025-08-14T00:01:21.178712Z INFO zksync_node_framework::service: Shutdown hook rocksdb_terminaton completed
zksync | 2025-08-14T00:01:21.178715Z INFO zksync_node_framework::service: Exiting the service
zksync | 2025-08-14T00:01:21.178806Z WARN NamedFuture{name="miniblock_precommit_fetcher"}: sqlx::query: slow statement: execution time exceeded alert threshold summary="SELECT number FROM miniblocks …" db.statement="\n\n\n SELECT\n number\n FROM\n miniblocks\n WHERE\n eth_precommit_tx_id IS NOT NULL\n ORDER BY\n number DESC\n LIMIT\n 1\n \n" rows_affected=0 rows_returned=0 elapsed=30.169553856s elapsed_secs=30.169553856 slow_threshold=1s
zksync | 2025-08-14T00:01:21.178853Z INFO zksync_db_connection::connection: Long-living connection for `sync_layer` created at node/node_sync/src/miniblock_precommit_fetcher/mod.rs:168: 30.169637213s
zksync | Error: One or more tasks failed: ["Task consistency_checker failed: Batch #501263 was committed to chain with id 1 while node is configured to check chain with id 9075. Error is thrown so node can restart and reload SL data. If node doesn't make any progress after restart, then it's bug, please contact developers.", "Shutdown for task miniblock_precommit_fetcher timed out"]