2025.05.14 01:41:22.256190 [ 1 ] {} <Information> : Starting ClickHouse Keeper 23.8.7.1(revision : 54477, git hash: 3042d295d963012962f5c683bd2776fa331a38c3, build id: <unknown>), PID 16477
2025.05.14 01:41:22.256344 [ 1 ] {} <Information> Application: starting up
2025.05.14 01:41:22.256394 [ 1 ] {} <Information> Application: OS Name = SunOS, OS Version = 5.11, OS Architecture = i86pc
2025.05.14 01:41:22.257875 [ 1 ] {} <Debug> Application: Initializing DateLUT.
2025.05.14 01:41:22.257902 [ 1 ] {} <Trace> Application: Initialized DateLUT with time zone 'UTC'.
2025.05.14 01:41:22.259159 [ 1 ] {} <Information> Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously
2025.05.14 01:41:22.259249 [ 1 ] {} <Debug> KeeperDispatcher: Initializing storage dispatcher
2025.05.14 01:41:22.259961 [ 1 ] {} <Information> KeeperContext: Keeper feature flag FILTERED_LIST: enabled
2025.05.14 01:41:22.259987 [ 1 ] {} <Information> KeeperContext: Keeper feature flag MULTI_READ: enabled
2025.05.14 01:41:22.260005 [ 1 ] {} <Information> KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled
2025.05.14 01:41:22.260198 [ 1 ] {} <Trace> KeeperSnapshotManager: Reading from disk LocalSnapshotDisk
2025.05.14 01:41:22.260609 [ 1 ] {} <Trace> KeeperLogStore: Reading from disk LocalLogDisk
2025.05.14 01:41:22.260687 [ 1 ] {} <Warning> KeeperLogStore: No logs exists in /var/tmp/omicron_tmp/oximeter_db-11d8f51cb75f441f-test_ensure_schema_walks_through_multiple_steps_replicated.16475.2-clickhouse-QHo06T/log. It's Ok if it's the first run of clickhouse-keeper.
2025.05.14 01:41:22.260938 [ 1 ] {} <Information> KeeperLogStore: force_sync enabled
2025.05.14 01:41:22.260958 [ 1 ] {} <Debug> KeeperDispatcher: Waiting server to initialize
2025.05.14 01:41:22.260966 [ 1 ] {} <Debug> KeeperStateMachine: Totally have 0 snapshots
2025.05.14 01:41:22.260972 [ 1 ] {} <Debug> KeeperStateMachine: No existing snapshots, last committed log index 0
2025.05.14 01:41:22.261116 [ 1 ] {} <Warning> KeeperLogStore: Removing all changelogs
2025.05.14 01:41:22.261363 [ 1 ] {} <Trace> Changelog: Starting new changelog changelog_1_100000.bin.zstd
2025.05.14 01:41:22.261550 [ 1 ] {} <Information> KeeperServer: Preprocessing 0 log entries
2025.05.14 01:41:22.261563 [ 1 ] {} <Information> KeeperServer: Preprocessing done
2025.05.14 01:41:22.261595 [ 1 ] {} <Information> KeeperServer: No config in log store and snapshot, probably it's initial run. Will use config from .xml on disk
2025.05.14 01:41:22.263261 [ 1 ] {} <Information> RaftInstance: Raft ASIO listener initiated on :::9235, unsecured
2025.05.14 01:41:22.263393 [ 1 ] {} <Warning> KeeperStateManager: No state was read
2025.05.14 01:41:22.263443 [ 1 ] {} <Information> RaftInstance: parameters: election timeout range 1000 - 2000, heartbeat 500, leadership expiry 10000, max batch 100, backoff 50, snapshot distance 100000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 100000, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on
2025.05.14 01:41:22.263478 [ 1 ] {} <Information> RaftInstance: new election timeout range: 1000 - 2000
2025.05.14 01:41:22.263525 [ 1 ] {} <Information> RaftInstance:    === INIT RAFT SERVER ===
commit index 0
term 0
election timer allowed
log store start 1, end 0
config log idx 0, prev log idx 0
2025.05.14 01:41:22.263685 [ 1 ] {} <Trace> RaftInstance: asio client created: 1bc071e0
2025.05.14 01:41:22.264119 [ 1 ] {} <Trace> RaftInstance: asio client created: 1bc06060
2025.05.14 01:41:22.264145 [ 1 ] {} <Information> RaftInstance: peer 1: DC ID 0, ::1:9234, voting member, 1
peer 2: DC ID 0, ::1:9235, voting member, 1
peer 3: DC ID 0, ::1:9236, voting member, 1
my id: 2, voting_member
num peers: 2
2025.05.14 01:41:22.264168 [ 1 ] {} <Information> RaftInstance: global manager does not exist. will use local thread for commit and append
2025.05.14 01:41:22.264312 [ 1 ] {} <Information> RaftInstance: wait for HB, for 50 + [1000, 2000] ms
2025.05.14 01:41:22.264785 [ 20 ] {} <Trace> RaftInstance: commit_cv_ sleep
2025.05.14 01:41:22.265606 [ 21 ] {} <Information> RaftInstance: bg append_entries thread initiated
2025.05.14 01:41:22.316729 [ 1 ] {} <Trace> RaftInstance: re-schedule election timer
2025.05.14 01:41:22.316839 [ 1 ] {} <Debug> RaftInstance: server 2 started
2025.05.14 01:41:22.316922 [ 1 ] {} <Trace> RaftInstance: asio rpc session created: 1c9079a0
2025.05.14 01:41:22.317009 [ 1 ] {} <Debug> KeeperDispatcher: Server initialized, waiting for quorum
2025.05.14 01:41:23.378225 [ 13 ] {} <Trace> RaftInstance: election timeout
2025.05.14 01:41:23.378300 [ 13 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.05.14 01:41:23.378357 [ 13 ] {} <Information> RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1
2025.05.14 01:41:23.378374 [ 13 ] {} <Information> RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 0, state term 0, target p 1, my p 1, hb dead, pre-vote NOT done
2025.05.14 01:41:23.378446 [ 13 ] {} <Information> RaftInstance: [PRE-VOTE INIT] my id 2, my role candidate, term 0, log idx 0, log term 0, priority (target 1 / mine 1)
2025.05.14 01:41:23.378474 [ 13 ] {} <Trace> RaftInstance: send req 2 -> 3, type pre_vote_request
2025.05.14 01:41:23.378484 [ 13 ] {} <Debug> RaftInstance: socket 1bc06060 to ::1:9236 is not opened yet
2025.05.14 01:41:23.378650 [ 13 ] {} <Trace> RaftInstance: send req 2 -> 1, type pre_vote_request
2025.05.14 01:41:23.378672 [ 13 ] {} <Debug> RaftInstance: socket 1bc071e0 to ::1:9234 is not opened yet
2025.05.14 01:41:23.378682 [ 13 ] {} <Trace> RaftInstance: cancel existing timer
2025.05.14 01:41:23.378688 [ 13 ] {} <Trace> RaftInstance: re-schedule election timer
2025.05.14 01:41:23.379687 [ 19 ] {} <Information> RaftInstance: receive a incoming rpc connection
2025.05.14 01:41:23.379704 [ 12 ] {} <Information> RaftInstance: 1bc06060 connected to ::1:9236 (as a client)
2025.05.14 01:41:23.379804 [ 19 ] {} <Information> RaftInstance: session 1 got connection from ::1:36546 (as a server)
2025.05.14 01:41:23.379948 [ 17 ] {} <Information> RaftInstance: 1bc071e0 connected to ::1:9234 (as a client)
2025.05.14 01:41:23.380042 [ 19 ] {} <Trace> RaftInstance: asio rpc session created: 1c9070a0
2025.05.14 01:41:23.380108 [ 18 ] {} <Debug> RaftInstance: Receive a pre_vote_request message from 1 with LastLogIndex=0, LastLogTerm 0, EntriesLength=0, CommitIndex=0 and Term=0
2025.05.14 01:41:23.380347 [ 18 ] {} <Information> RaftInstance: [PRE-VOTE REQ] my role candidate, from peer 1, log term: req 0 / mine 0
last idx: req 0 / mine 0, term: req 0 / mine 0
HB dead
2025.05.14 01:41:23.380371 [ 18 ] {} <Information> RaftInstance: pre-vote decision: O (grant)
2025.05.14 01:41:23.380392 [ 18 ] {} <Debug> RaftInstance: Response back a pre_vote_response message to 1 with Accepted=1, Term=0, NextIndex=1
2025.05.14 01:41:23.380490 [ 14 ] {} <Trace> RaftInstance: resp of req 2 -> 1, type pre_vote_request, OK
2025.05.14 01:41:23.380549 [ 14 ] {} <Debug> RaftInstance: Receive a pre_vote_response message from peer 1 with Result=1, Term=0, NextIndex=1
2025.05.14 01:41:23.380560 [ 14 ] {} <Trace> RaftInstance: src: 1, dst: 2, resp->get_term(): 0
2025.05.14 01:41:23.380571 [ 14 ] {} <Information> RaftInstance: [PRE-VOTE RESP] peer 1 (O), term 0, resp term 0, my role candidate, dead 2, live 0, abandoned 0, num voting members 3, quorum 2
2025.05.14 01:41:23.380583 [ 14 ] {} <Information> RaftInstance: [PRE-VOTE DONE] SUCCESS, term 0
2025.05.14 01:41:23.380597 [ 14 ] {} <Information> RaftInstance: [PRE-VOTE DONE] initiate actual vote
2025.05.14 01:41:23.380826 [ 14 ] {} <Information> RaftInstance: [VOTE INIT] my id 2, my role candidate, term 1, log idx 0, log term 0, priority (target 1 / mine 1)
2025.05.14 01:41:23.380842 [ 14 ] {} <Debug> RaftInstance: send request_vote_request to server 3 with term 1
2025.05.14 01:41:23.380854 [ 14 ] {} <Warning> RaftInstance: failed to send vote request: peer 3 (::1:9236) is busy
2025.05.14 01:41:23.380885 [ 14 ] {} <Debug> RaftInstance: send request_vote_request to server 1 with term 1
2025.05.14 01:41:23.380891 [ 14 ] {} <Trace> RaftInstance: send req 2 -> 1, type request_vote_request
2025.05.14 01:41:23.380943 [ 14 ] {} <Trace> RaftInstance: cancel existing timer
2025.05.14 01:41:23.380968 [ 14 ] {} <Trace> RaftInstance: re-schedule election timer
2025.05.14 01:41:23.381152 [ 18 ] {} <Debug> RaftInstance: Receive a request_vote_request message from 1 with LastLogIndex=0, LastLogTerm 0, EntriesLength=0, CommitIndex=0 and Term=1
2025.05.14 01:41:23.381192 [ 18 ] {} <Information> RaftInstance: [VOTE REQ] my role candidate, from peer 1, log term: req 0 / mine 0
last idx: req 0 / mine 0, term: req 1 / mine 1
priority: target 1 / mine 1, voted_for 2
2025.05.14 01:41:23.381200 [ 18 ] {} <Information> RaftInstance: decision: X (deny), term 1
2025.05.14 01:41:23.381207 [ 18 ] {} <Debug> RaftInstance: Response back a request_vote_response message to 1 with Accepted=0, Term=1, NextIndex=0
2025.05.14 01:41:23.381376 [ 13 ] {} <Trace> RaftInstance: resp of req 2 -> 3, type pre_vote_request, OK
2025.05.14 01:41:23.381400 [ 13 ] {} <Debug> RaftInstance: Receive a pre_vote_response message from peer 3 with Result=1, Term=0, NextIndex=1
2025.05.14 01:41:23.381452 [ 13 ] {} <Trace> RaftInstance: src: 3, dst: 2, resp->get_term(): 0
2025.05.14 01:41:23.381462 [ 13 ] {} <Information> RaftInstance: [PRE-VOTE RESP] peer 3 (O), term 0, resp term 0, my role candidate, dead 3, live 0, abandoned 0, num voting members 3, quorum 2
2025.05.14 01:41:23.381476 [ 13 ] {} <Information> RaftInstance: [PRE-VOTE DONE] SUCCESS, term 0
2025.05.14 01:41:23.381495 [ 13 ] {} <Information> RaftInstance: [PRE-VOTE DONE] actual vote is already initiated, do nothing
2025.05.14 01:41:23.381518 [ 15 ] {} <Trace> RaftInstance: resp of req 2 -> 1, type request_vote_request, OK
2025.05.14 01:41:23.381558 [ 15 ] {} <Debug> RaftInstance: Receive a request_vote_response message from peer 1 with Result=0, Term=1, NextIndex=0
2025.05.14 01:41:23.381580 [ 15 ] {} <Trace> RaftInstance: src: 1, dst: 2, resp->get_term(): 1
2025.05.14 01:41:23.381593 [ 15 ] {} <Information> RaftInstance: [VOTE RESP] peer 1 (X), resp term 1, my role candidate, granted 1, responded 2, num voting members 3, quorum 2
2025.05.14 01:41:24.333384 [ 13 ] {} <Information> RaftInstance: receive a incoming rpc connection
2025.05.14 01:41:24.333425 [ 13 ] {} <Information> RaftInstance: session 2 got connection from ::1:58523 (as a server)
2025.05.14 01:41:24.333525 [ 13 ] {} <Trace> RaftInstance: asio rpc session created: 1c9506e0
2025.05.14 01:41:24.333573 [ 13 ] {} <Debug> RaftInstance: Receive a pre_vote_request message from 3 with LastLogIndex=0, LastLogTerm 0, EntriesLength=0, CommitIndex=0 and Term=0
2025.05.14 01:41:24.333589 [ 13 ] {} <Information> RaftInstance: [PRE-VOTE REQ] my role candidate, from peer 3, log term: req 0 / mine 0
last idx: req 0 / mine 0, term: req 0 / mine 1
HB dead
2025.05.14 01:41:24.333598 [ 13 ] {} <Information> RaftInstance: pre-vote decision: O (grant)
2025.05.14 01:41:24.333612 [ 13 ] {} <Debug> RaftInstance: Response back a pre_vote_response message to 3 with Accepted=1, Term=0, NextIndex=1
2025.05.14 01:41:24.334323 [ 15 ] {} <Debug> RaftInstance: Receive a request_vote_request message from 3 with LastLogIndex=0, LastLogTerm 0, EntriesLength=0, CommitIndex=0 and Term=1
2025.05.14 01:41:24.334378 [ 15 ] {} <Information> RaftInstance: [VOTE REQ] my role candidate, from peer 3, log term: req 0 / mine 0
last idx: req 0 / mine 0, term: req 1 / mine 1
priority: target 1 / mine 1, voted_for 2
2025.05.14 01:41:24.334408 [ 15 ] {} <Information> RaftInstance: decision: X (deny), term 1
2025.05.14 01:41:24.334419 [ 15 ] {} <Debug> RaftInstance: Response back a request_vote_response message to 3 with Accepted=0, Term=1, NextIndex=0
2025.05.14 01:41:24.778332 [ 18 ] {} <Debug> RaftInstance: Receive a pre_vote_request message from 1 with LastLogIndex=0, LastLogTerm 0, EntriesLength=0, CommitIndex=0 and Term=1
2025.05.14 01:41:24.778440 [ 18 ] {} <Information> RaftInstance: [PRE-VOTE REQ] my role candidate, from peer 1, log term: req 0 / mine 0
last idx: req 0 / mine 0, term: req 1 / mine 1
HB dead
2025.05.14 01:41:24.778455 [ 18 ] {} <Information> RaftInstance: pre-vote decision: O (grant)
2025.05.14 01:41:24.778467 [ 18 ] {} <Debug> RaftInstance: Response back a pre_vote_response message to 1 with Accepted=1, Term=1, NextIndex=1
2025.05.14 01:41:24.779428 [ 15 ] {} <Debug> RaftInstance: Receive a request_vote_request message from 1 with LastLogIndex=0, LastLogTerm 0, EntriesLength=0, CommitIndex=0 and Term=2
2025.05.14 01:41:24.779584 [ 15 ] {} <Debug> IDisk: Copying from LocalStateFileDisk (path: /var/tmp/omicron_tmp/oximeter_db-11d8f51cb75f441f-test_ensure_schema_walks_through_multiple_steps_replicated.16475.2-clickhouse-QHo06T/snapshots) state to LocalStateFileDisk (path: /var/tmp/omicron_tmp/oximeter_db-11d8f51cb75f441f-test_ensure_schema_walks_through_multiple_steps_replicated.16475.2-clickhouse-QHo06T/snapshots) state-OLD.
2025.05.14 01:41:24.779961 [ 15 ] {} <Information> RaftInstance: [BECOME FOLLOWER] term 2
2025.05.14 01:41:24.779988 [ 15 ] {} <Trace> RaftInstance: cancel existing timer
2025.05.14 01:41:24.780018 [ 15 ] {} <Trace> RaftInstance: re-schedule election timer
2025.05.14 01:41:24.780050 [ 15 ] {} <Information> RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1
2025.05.14 01:41:24.780061 [ 15 ] {} <Information> RaftInstance: [VOTE REQ] my role follower, from peer 1, log term: req 0 / mine 0
last idx: req 0 / mine 0, term: req 2 / mine 2
priority: target 1 / mine 1, voted_for -1
2025.05.14 01:41:24.780077 [ 15 ] {} <Information> RaftInstance: decision: O (grant), voted_for 1, term 2
2025.05.14 01:41:24.780130 [ 15 ] {} <Debug> IDisk: Copying from LocalStateFileDisk (path: /var/tmp/omicron_tmp/oximeter_db-11d8f51cb75f441f-test_ensure_schema_walks_through_multiple_steps_replicated.16475.2-clickhouse-QHo06T/snapshots) state to LocalStateFileDisk (path: /var/tmp/omicron_tmp/oximeter_db-11d8f51cb75f441f-test_ensure_schema_walks_through_multiple_steps_replicated.16475.2-clickhouse-QHo06T/snapshots) state-OLD.
2025.05.14 01:41:24.780311 [ 15 ] {} <Debug> RaftInstance: Response back a request_vote_response message to 1 with Accepted=1, Term=2, NextIndex=1
2025.05.14 01:41:24.781349 [ 18 ] {} <Debug> RaftInstance: Receive a append_entries_request message from 1 with LastLogIndex=0, LastLogTerm 0, EntriesLength=1, CommitIndex=0 and Term=2
2025.05.14 01:41:24.781423 [ 18 ] {} <Trace> RaftInstance: from peer 1, req type: 3, req term: 2, req l idx: 0 (1), req c idx: 0, my term: 2, my role: 1
2025.05.14 01:41:24.781448 [ 18 ] {} <Trace> RaftInstance: (update) new target priority: 1
2025.05.14 01:41:24.781484 [ 18 ] {} <Trace> RaftInstance: [LOG OK] req log idx: 0, req log term: 0, my last log idx: 0, my log (0) term: 0
2025.05.14 01:41:24.781500 [ 18 ] {} <Debug> RaftInstance: [INIT] log_idx: 1, count: 0, log_store_->next_slot(): 1, req.log_entries().size(): 1
2025.05.14 01:41:24.781508 [ 18 ] {} <Debug> RaftInstance: [after SKIP] log_idx: 1, count: 0
2025.05.14 01:41:24.781518 [ 18 ] {} <Debug> RaftInstance: [after OVWR] log_idx: 1, count: 0
2025.05.14 01:41:24.781525 [ 18 ] {} <Trace> RaftInstance: append at 1, term 2, timestamp 0
2025.05.14 01:41:24.781887 [ 18 ] {} <Information> RaftInstance: receive a config change from leader at 1
2025.05.14 01:41:24.781935 [ 18 ] {} <Trace> RaftInstance: local log idx 1, target_commit_idx 0, quick_commit_index_ 0, state_->get_commit_idx() 0
2025.05.14 01:41:24.781967 [ 18 ] {} <Trace> RaftInstance: cancel existing timer
2025.05.14 01:41:24.781961 [ 8 ] {} <Trace> RaftInstance: got log append completion notification: OK
2025.05.14 01:41:24.781996 [ 1 ] {} <Debug> KeeperDispatcher: Quorum initialized
2025.05.14 01:41:24.782023 [ 8 ] {} <Trace> RaftInstance: got log append completion notification: OK
2025.05.14 01:41:24.782002 [ 18 ] {} <Trace> RaftInstance: re-schedule election timer
2025.05.14 01:41:24.782132 [ 18 ] {} <Trace> RaftInstance: batch size hint: 0 bytes
2025.05.14 01:41:24.782141 [ 18 ] {} <Debug> RaftInstance: Response back a append_entries_response message to 1 with Accepted=1, Term=2, NextIndex=2
2025.05.14 01:41:24.782252 [ 1 ] {} <Debug> KeeperDispatcher: Dispatcher initialized
2025.05.14 01:41:24.782866 [ 1 ] {} <Information> Application: Listening for Keeper (tcp): [::]:9182
2025.05.14 01:41:24.782953 [ 1 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 175.08 KiB, peak 2.17 MiB, free memory in arenas 0.00 B, will set to 118.48 MiB (RSS), difference: 118.31 MiB
2025.05.14 01:41:24.783967 [ 1 ] {} <Debug> ConfigReloader: Loading config '/work/oxidecomputer/omicron/oximeter/db/src/configs/keeper_config.xml'
2025.05.14 01:41:24.784855 [ 1 ] {} <Debug> ConfigReloader: Loaded config '/work/oxidecomputer/omicron/oximeter/db/src/configs/keeper_config.xml', performing update on configuration
2025.05.14 01:41:24.784948 [ 1 ] {} <Trace> KeeperDispatcher: Configuration update triggered, but nothing changed for Raft
2025.05.14 01:41:24.784993 [ 1 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again.
2025.05.14 01:41:24.785008 [ 1 ] {} <Debug> ConfigReloader: Loaded config '/work/oxidecomputer/omicron/oximeter/db/src/configs/keeper_config.xml', performed update on configuration
2025.05.14 01:41:24.785681 [ 1 ] {} <Information> Application: Ready for connections.
2025.05.14 01:41:24.785785 [ 16 ] {} <Debug> RaftInstance: Receive a append_entries_request message from 1 with LastLogIndex=1, LastLogTerm 2, EntriesLength=0, CommitIndex=1 and Term=2
2025.05.14 01:41:24.785809 [ 16 ] {} <Trace> RaftInstance: from peer 1, req type: 3, req term: 2, req l idx: 1 (0), req c idx: 1, my term: 2, my role: 1
2025.05.14 01:41:24.785818 [ 16 ] {} <Trace> RaftInstance: (update) new target priority: 1
2025.05.14 01:41:24.785828 [ 16 ] {} <Trace> RaftInstance: [LOG OK] req log idx: 1, req log term: 2, my last log idx: 1, my log (1) term: 2
2025.05.14 01:41:24.785835 [ 16 ] {} <Debug> RaftInstance: trigger commit upto 1
2025.05.14 01:41:24.785843 [ 16 ] {} <Trace> RaftInstance: local log idx 1, target_commit_idx 1, quick_commit_index_ 1, state_->get_commit_idx() 0
2025.05.14 01:41:24.785865 [ 16 ] {} <Trace> RaftInstance: commit_cv_ notify (local thread)
2025.05.14 01:41:24.785891 [ 16 ] {} <Trace> RaftInstance: cancel existing timer
2025.05.14 01:41:24.785903 [ 16 ] {} <Trace> RaftInstance: re-schedule election timer
2025.05.14 01:41:24.785913 [ 20 ] {} <Trace> RaftInstance: commit_cv_ wake up
2025.05.14 01:41:24.785918 [ 16 ] {} <Trace> RaftInstance: batch size hint: 0 bytes
2025.05.14 01:41:24.785949 [ 16 ] {} <Debug> RaftInstance: Response back a append_entries_response message to 1 with Accepted=1, Term=2, NextIndex=2
2025.05.14 01:41:24.785983 [ 20 ] {} <Debug> RaftInstance: commit upto 1, current idx 0
2025.05.14 01:41:24.785993 [ 20 ] {} <Trace> RaftInstance: commit upto 1, current idx 1
2025.05.14 01:41:24.786005 [ 20 ] {} <Information> RaftInstance: config at index 1 is committed, prev config log idx 0
2025.05.14 01:41:24.786049 [ 20 ] {} <Information> RaftInstance: new config log idx 1, prev log idx 0, cur config log idx 0, prev log idx 0
2025.05.14 01:41:24.786060 [ 20 ] {} <Debug> RaftInstance: system is reconfigured to have 3 servers, last config index: 0, this config index: 1
2025.05.14 01:41:24.786114 [ 20 ] {} <Information> RaftInstance: new configuration: log idx 1, prev log idx 0
peer 1, DC ID 0, ::1:9234, voting member, 1
peer 2, DC ID 0, ::1:9235, voting member, 1
peer 3, DC ID 0, ::1:9236, voting member, 1
my id: 2, leader: 1, term: 2
2025.05.14 01:41:24.786138 [ 20 ] {} <Trace> RaftInstance: (update) new target priority: 1
2025.05.14 01:41:24.786151 [ 20 ] {} <Debug> RaftInstance: DONE: commit upto 1, current idx 1
2025.05.14 01:41:24.786160 [ 20 ] {} <Trace> RaftInstance: commit_cv_ sleep
2025.05.14 01:41:25.000412 [ 26 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 120.71 MiB, peak 127.18 MiB, free memory in arenas 0.00 B, will set to 118.76 MiB (RSS), difference: -1.96 MiB
2025.05.14 01:41:25.282020 [ 15 ] {} <Debug> RaftInstance: Receive a append_entries_request message from 1 with LastLogIndex=1, LastLogTerm 2, EntriesLength=0, CommitIndex=1 and Term=2
2025.05.14 01:41:25.282093 [ 15 ] {} <Trace> RaftInstance: from peer 1, req type: 3, req term: 2, req l idx: 1 (0), req c idx: 1, my term: 2, my role: 1
2025.05.14 01:41:25.282105 [ 15 ] {} <Trace> RaftInstance: (update) new target priority: 1
2025.05.14 01:41:25.282116 [ 15 ] {} <Trace> RaftInstance: [LOG OK] req log idx: 1, req log term: 2, my last log idx: 1, my log (1) term: 2
2025.05.14 01:41:25.282131 [ 15 ] {} <Trace> RaftInstance: local log idx 1, target_commit_idx 1, quick_commit_index_ 1, state_->get_commit_idx() 1
2025.05.14 01:41:25.282142 [ 15 ] {} <Trace> RaftInstance: cancel existing timer
2025.05.14 01:41:25.282170 [ 15 ] {} <Trace> RaftInstance: re-schedule election timer
2025.05.14 01:41:25.282193 [ 15 ] {} <Trace> RaftInstance: batch size hint: 0 bytes
2025.05.14 01:41:25.282203 [ 15 ] {} <Debug> RaftInstance: Response back a append_entries_response message to 1 with Accepted=1, Term=2, NextIndex=2