| 1 | 2024.09.28 15:28:36.985628 [ 43351 ] {} <Information> SentryWriter: Sending crash reports is disabled | ||
| 2 | 2024.09.28 15:28:36.985688 [ 43351 ] {} <Trace> Pipe: Pipe capacity is 1.00 MiB | ||
| 3 | 2024.09.28 15:28:37.104399 [ 43351 ] {} <Information> : Starting ClickHouse Keeper 23.8.7.24(revision : 54477, git hash: 812b95e14ba8cf744bf1d70e6de607cf130a79fa, build id: 6484B75ECB16F4FF87A88E10249A45E1BDBDE2E5), PID 43351 | ||
| 4 | 2024.09.28 15:28:37.104437 [ 43351 ] {} <Information> Application: starting up | ||
| 5 | 2024.09.28 15:28:37.104449 [ 43351 ] {} <Information> Application: OS Name = Linux, OS Version = 5.15.0-1015-aws, OS Architecture = x86_64 | ||
| 6 | 2024.09.28 15:28:37.107008 [ 43351 ] {} <Debug> Application: Initializing DateLUT. | ||
| 7 | 2024.09.28 15:28:37.107022 [ 43351 ] {} <Trace> Application: Initialized DateLUT with time zone 'UTC'. | ||
| 8 | 2024.09.28 15:28:37.147278 [ 43351 ] {} <Trace> AsynchronousMetrics: Scanning /sys/class/thermal | ||
| 9 | 2024.09.28 15:28:37.147301 [ 43351 ] {} <Trace> AsynchronousMetrics: Scanning /sys/block | ||
| 10 | 2024.09.28 15:28:37.147338 [ 43351 ] {} <Trace> AsynchronousMetrics: Scanning /sys/devices/system/edac | ||
| 11 | 2024.09.28 15:28:37.147352 [ 43351 ] {} <Trace> AsynchronousMetrics: Scanning /sys/class/hwmon | ||
| 12 | 2024.09.28 15:28:37.147517 [ 43351 ] {} <Information> Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously | ||
| 13 | 2024.09.28 15:28:37.147531 [ 43351 ] {} <Debug> KeeperDispatcher: Initializing storage dispatcher | ||
| 14 | 2024.09.28 15:28:37.147740 [ 43351 ] {} <Information> KeeperContext: Keeper feature flag FILTERED_LIST: enabled | ||
| 15 | 2024.09.28 15:28:37.147746 [ 43351 ] {} <Information> KeeperContext: Keeper feature flag MULTI_READ: enabled | ||
| 16 | 2024.09.28 15:28:37.147749 [ 43351 ] {} <Information> KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled | ||
| 17 | 2024.09.28 15:28:37.147914 [ 43351 ] {} <Trace> KeeperSnapshotManager: Reading from disk LocalSnapshotDisk | ||
| 18 | 2024.09.28 15:28:37.148022 [ 43351 ] {} <Trace> KeeperLogStore: Reading from disk LocalLogDisk | ||
| 19 | 2024.09.28 15:28:37.148045 [ 43351 ] {} <Warning> KeeperLogStore: No logs exists in /var/tmp/omicron_tmp/integration_test-191fb91badeb8f2e-test_raft_config_parsing.43348.1-oximeter-clickward-test/keeper-3/coordination/log. It's Ok if it's the first run of clickhouse-keeper. | ||
| 20 | 2024.09.28 15:28:37.148156 [ 43351 ] {} <Information> KeeperLogStore: force_sync enabled | ||
| 21 | 2024.09.28 15:28:37.148162 [ 43351 ] {} <Debug> KeeperDispatcher: Waiting server to initialize | ||
| 22 | 2024.09.28 15:28:37.148169 [ 43351 ] {} <Debug> KeeperStateMachine: Totally have 0 snapshots | ||
| 23 | 2024.09.28 15:28:37.148173 [ 43351 ] {} <Debug> KeeperStateMachine: No existing snapshots, last committed log index 0 | ||
| 24 | 2024.09.28 15:28:37.148204 [ 43351 ] {} <Warning> KeeperLogStore: Removing all changelogs | ||
| 25 | 2024.09.28 15:28:37.148215 [ 43351 ] {} <Trace> Changelog: Starting new changelog changelog_1_100000.bin.zstd | ||
| 26 | 2024.09.28 15:28:37.148258 [ 43351 ] {} <Information> KeeperServer: Preprocessing 0 log entries | ||
| 27 | 2024.09.28 15:28:37.148263 [ 43351 ] {} <Information> KeeperServer: Preprocessing done | ||
| 28 | 2024.09.28 15:28:37.148267 [ 43351 ] {} <Information> KeeperServer: No config in log store and snapshot, probably it's initial run. Will use config from .xml on disk | ||
| 29 | 2024.09.28 15:28:37.148658 [ 43351 ] {} <Information> RaftInstance: Raft ASIO listener initiated on :::39103, unsecured | ||
| 30 | 2024.09.28 15:28:37.148686 [ 43351 ] {} <Warning> KeeperStateManager: No state was read | ||
| 31 | 2024.09.28 15:28:37.148699 [ 43351 ] {} <Information> RaftInstance: parameters: election timeout range 1000 - 2000, heartbeat 500, leadership expiry 10000, max batch 100, backoff 50, snapshot distance 100000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 100000, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on | ||
| 32 | 2024.09.28 15:28:37.148704 [ 43351 ] {} <Information> RaftInstance: new election timeout range: 1000 - 2000 | ||
| 33 | 2024.09.28 15:28:37.148720 [ 43351 ] {} <Information> RaftInstance: === INIT RAFT SERVER === | ||
| 34 | commit index 0 | ||
| 35 | term 0 | ||
| 36 | election timer allowed | ||
| 37 | log store start 1, end 0 | ||
| 38 | config log idx 0, prev log idx 0 | ||
| 39 | 2024.09.28 15:28:37.148752 [ 43351 ] {} <Trace> RaftInstance: asio client created: 0x7f5458654318 | ||
| 40 | 2024.09.28 15:28:37.148773 [ 43351 ] {} <Trace> RaftInstance: asio client created: 0x7f5458654698 | ||
| 41 | 2024.09.28 15:28:37.148781 [ 43351 ] {} <Information> RaftInstance: peer 1: DC ID 0, ::1:39101, voting member, 1 | ||
| 42 | peer 2: DC ID 0, ::1:39102, voting member, 1 | ||
| 43 | peer 3: DC ID 0, ::1:39103, voting member, 1 | ||
| 44 | my id: 3, voting_member | ||
| 45 | num peers: 2 | ||
| 46 | 2024.09.28 15:28:37.148786 [ 43351 ] {} <Information> RaftInstance: global manager does not exist. will use local thread for commit and append | ||
| 47 | 2024.09.28 15:28:37.148847 [ 43351 ] {} <Information> RaftInstance: wait for HB, for 50 + [1000, 2000] ms | ||
| 48 | 2024.09.28 15:28:37.154999 [ 43406 ] {} <Trace> RaftInstance: commit_cv_ sleep | ||
| 49 | 2024.09.28 15:28:37.155059 [ 43407 ] {} <Information> RaftInstance: bg append_entries thread initiated | ||
| 50 | 2024.09.28 15:28:37.198946 [ 43351 ] {} <Trace> RaftInstance: re-schedule election timer | ||
| 51 | 2024.09.28 15:28:37.198972 [ 43351 ] {} <Debug> RaftInstance: server 3 started | ||
| 52 | 2024.09.28 15:28:37.199013 [ 43351 ] {} <Trace> RaftInstance: asio rpc session created: 0x7f545873c918 | ||
| 53 | 2024.09.28 15:28:37.199038 [ 43351 ] {} <Debug> KeeperDispatcher: Server initialized, waiting for quorum | ||
| 54 | 2024.09.28 15:28:38.307636 [ 43398 ] {} <Information> RaftInstance: receive a incoming rpc connection | ||
| 55 | 2024.09.28 15:28:38.307685 [ 43398 ] {} <Information> RaftInstance: session 1 got connection from ::1:33830 (as a server) | ||
| 56 | 2024.09.28 15:28:38.307764 [ 43398 ] {} <Trace> RaftInstance: asio rpc session created: 0x7f5458e70018 | ||
| 57 | 2024.09.28 15:28:38.308042 [ 43398 ] {} <Debug> RaftInstance: Receive a pre_vote_request message from 2 with LastLogIndex=0, LastLogTerm 0, EntriesLength=0, CommitIndex=0 and Term=0 | ||
| 58 | 2024.09.28 15:28:38.308067 [ 43398 ] {} <Information> RaftInstance: [PRE-VOTE REQ] my role follower, from peer 2, log term: req 0 / mine 0 | ||
| 59 | last idx: req 0 / mine 0, term: req 0 / mine 0 | ||
| 60 | HB dead | ||
| 61 | 2024.09.28 15:28:38.308078 [ 43398 ] {} <Information> RaftInstance: pre-vote decision: O (grant) | ||
| 62 | 2024.09.28 15:28:38.308084 [ 43398 ] {} <Debug> RaftInstance: Response back a pre_vote_response message to 2 with Accepted=1, Term=0, NextIndex=1 | ||
| 63 | 2024.09.28 15:28:38.311108 [ 43399 ] {} <Debug> RaftInstance: Receive a request_vote_request message from 2 with LastLogIndex=0, LastLogTerm 0, EntriesLength=0, CommitIndex=0 and Term=1 | ||
| 64 | 2024.09.28 15:28:38.313755 [ 43399 ] {} <Information> RaftInstance: [BECOME FOLLOWER] term 1 | ||
| 65 | 2024.09.28 15:28:38.313772 [ 43399 ] {} <Trace> RaftInstance: cancel existing timer | ||
| 66 | 2024.09.28 15:28:38.313781 [ 43399 ] {} <Trace> RaftInstance: re-schedule election timer | ||
| 67 | 2024.09.28 15:28:38.313789 [ 43399 ] {} <Information> RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 | ||
| 68 | 2024.09.28 15:28:38.313795 [ 43399 ] {} <Information> RaftInstance: [VOTE REQ] my role follower, from peer 2, log term: req 0 / mine 0 | ||
| 69 | last idx: req 0 / mine 0, term: req 1 / mine 1 | ||
| 70 | priority: target 1 / mine 1, voted_for -1 | ||
| 71 | 2024.09.28 15:28:38.313803 [ 43399 ] {} <Information> RaftInstance: decision: O (grant), voted_for 2, term 1 | ||
| 72 | 2024.09.28 15:28:38.314576 [ 43399 ] {} <Debug> IDisk: Copying from LocalStateFileDisk (path: /var/tmp/omicron_tmp/integration_test-191fb91badeb8f2e-test_raft_config_parsing.43348.1-oximeter-clickward-test/keeper-3/coordination) state to LocalStateFileDisk (path: /var/tmp/omicron_tmp/integration_test-191fb91badeb8f2e-test_raft_config_parsing.43348.1-oximeter-clickward-test/keeper-3/coordination) state-OLD. | ||
| 73 | 2024.09.28 15:28:38.316986 [ 43399 ] {} <Debug> RaftInstance: Response back a request_vote_response message to 2 with Accepted=1, Term=1, NextIndex=1 | ||
| 74 | 2024.09.28 15:28:38.325008 [ 43401 ] {} <Debug> RaftInstance: Receive a append_entries_request message from 2 with LastLogIndex=0, LastLogTerm 0, EntriesLength=1, CommitIndex=0 and Term=1 | ||
| 75 | 2024.09.28 15:28:38.325037 [ 43401 ] {} <Trace> RaftInstance: from peer 2, req type: 3, req term: 1, req l idx: 0 (1), req c idx: 0, my term: 1, my role: 1 | ||
| 76 | 2024.09.28 15:28:38.325051 [ 43401 ] {} <Trace> RaftInstance: (update) new target priority: 1 | ||
| 77 | 2024.09.28 15:28:38.325062 [ 43401 ] {} <Trace> RaftInstance: [LOG OK] req log idx: 0, req log term: 0, my last log idx: 0, my log (0) term: 0 | ||
| 78 | 2024.09.28 15:28:38.325068 [ 43401 ] {} <Debug> RaftInstance: [INIT] log_idx: 1, count: 0, log_store_->next_slot(): 1, req.log_entries().size(): 1 | ||
| 79 | 2024.09.28 15:28:38.325073 [ 43401 ] {} <Debug> RaftInstance: [after SKIP] log_idx: 1, count: 0 | ||
| 80 | 2024.09.28 15:28:38.325077 [ 43401 ] {} <Debug> RaftInstance: [after OVWR] log_idx: 1, count: 0 | ||
| 81 | 2024.09.28 15:28:38.325082 [ 43401 ] {} <Trace> RaftInstance: append at 1, term 1, timestamp 0 | ||
| 82 | 2024.09.28 15:28:38.328348 [ 43393 ] {} <Trace> RaftInstance: got log append completion notification: OK | ||
| 83 | 2024.09.28 15:28:38.328379 [ 43401 ] {} <Information> RaftInstance: receive a config change from leader at 1 | ||
| 84 | 2024.09.28 15:28:38.328389 [ 43401 ] {} <Trace> RaftInstance: local log idx 1, target_commit_idx 0, quick_commit_index_ 0, state_->get_commit_idx() 0 | ||
| 85 | 2024.09.28 15:28:38.328398 [ 43401 ] {} <Trace> RaftInstance: cancel existing timer | ||
| 86 | 2024.09.28 15:28:38.328407 [ 43401 ] {} <Trace> RaftInstance: re-schedule election timer | ||
| 87 | 2024.09.28 15:28:38.328416 [ 43401 ] {} <Trace> RaftInstance: batch size hint: 0 bytes | ||
| 88 | 2024.09.28 15:28:38.328420 [ 43401 ] {} <Debug> RaftInstance: Response back a append_entries_response message to 2 with Accepted=1, Term=1, NextIndex=2 | ||
| 89 | 2024.09.28 15:28:38.328485 [ 43351 ] {} <Debug> KeeperDispatcher: Quorum initialized | ||
| 90 | 2024.09.28 15:28:38.328602 [ 43351 ] {} <Debug> KeeperDispatcher: Dispatcher initialized | ||
| 91 | 2024.09.28 15:28:38.328834 [ 43393 ] {} <Trace> RaftInstance: got log append completion notification: OK | ||
| 92 | 2024.09.28 15:28:38.329010 [ 43351 ] {} <Trace> Context: Shutting down named sessions | ||
| 93 | 2024.09.28 15:28:38.329024 [ 43351 ] {} <Trace> Context: Shutting down database catalog | ||
| 94 | 2024.09.28 15:28:38.329031 [ 43351 ] {} <Trace> DatabaseCatalog: Shutting down system databases | ||
| 95 | 2024.09.28 15:28:38.329036 [ 43351 ] {} <Trace> Context: Shutting down DDLWorker | ||
| 96 | 2024.09.28 15:28:38.329040 [ 43351 ] {} <Trace> Context: Shutting down caches | ||
| 97 | 2024.09.28 15:28:38.329087 [ 43351 ] {} <Debug> KeeperDispatcher: Shutting down storage dispatcher | ||
| 98 | 2024.09.28 15:28:38.329149 [ 43400 ] {} <Debug> RaftInstance: Receive a append_entries_request message from 2 with LastLogIndex=1, LastLogTerm 1, EntriesLength=0, CommitIndex=1 and Term=1 | ||
| 99 | 2024.09.28 15:28:38.329182 [ 43400 ] {} <Trace> RaftInstance: from peer 2, req type: 3, req term: 1, req l idx: 1 (0), req c idx: 1, my term: 1, my role: 1 | ||
| 100 | 2024.09.28 15:28:38.329196 [ 43400 ] {} <Trace> RaftInstance: (update) new target priority: 1 | ||
| 101 | 2024.09.28 15:28:38.329203 [ 43400 ] {} <Trace> RaftInstance: [LOG OK] req log idx: 1, req log term: 1, my last log idx: 1, my log (1) term: 1 | ||
| 102 | 2024.09.28 15:28:38.329208 [ 43400 ] {} <Debug> RaftInstance: trigger commit upto 1 | ||
| 103 | 2024.09.28 15:28:38.329212 [ 43400 ] {} <Trace> RaftInstance: local log idx 1, target_commit_idx 1, quick_commit_index_ 1, state_->get_commit_idx() 0 | ||
| 104 | 2024.09.28 15:28:38.329217 [ 43400 ] {} <Trace> RaftInstance: commit_cv_ notify (local thread) | ||
| 105 | 2024.09.28 15:28:38.329225 [ 43400 ] {} <Trace> RaftInstance: cancel existing timer | ||
| 106 | 2024.09.28 15:28:38.329242 [ 43400 ] {} <Trace> RaftInstance: re-schedule election timer | ||
| 107 | 2024.09.28 15:28:38.329250 [ 43400 ] {} <Trace> RaftInstance: batch size hint: 0 bytes | ||
| 108 | 2024.09.28 15:28:38.329255 [ 43400 ] {} <Debug> RaftInstance: Response back a append_entries_response message to 2 with Accepted=1, Term=1, NextIndex=2 | ||
| 109 | 2024.09.28 15:28:38.329439 [ 43351 ] {} <Information> RaftInstance: shutting down raft core | ||
| 110 | 2024.09.28 15:28:38.329449 [ 43351 ] {} <Information> RaftInstance: sent stop signal to the commit thread. | ||
| 111 | 2024.09.28 15:28:38.329461 [ 43351 ] {} <Trace> RaftInstance: asio client destroyed: 0x7f5458654698 | ||
| 112 | 2024.09.28 15:28:38.329748 [ 43406 ] {} <Trace> RaftInstance: commit_cv_ wake up | ||
| 113 | 2024.09.28 15:28:38.333039 [ 43351 ] {} <Trace> RaftInstance: asio client destroyed: 0x7f5458654318 | ||
| 114 | 2024.09.28 15:28:38.333062 [ 43351 ] {} <Information> RaftInstance: cancelled all schedulers. | ||
| 115 | 2024.09.28 15:28:38.333066 [ 43351 ] {} <Information> RaftInstance: commit thread stopped. | ||
| 116 | 2024.09.28 15:28:38.333069 [ 43351 ] {} <Information> RaftInstance: all pending commit elements dropped. | ||
| 117 | 2024.09.28 15:28:38.333071 [ 43351 ] {} <Information> RaftInstance: reset all pointers. | ||
| 118 | 2024.09.28 15:28:38.333077 [ 43351 ] {} <Information> RaftInstance: joined terminated commit thread. | ||
| 119 | 2024.09.28 15:28:38.333111 [ 43351 ] {} <Information> RaftInstance: sent stop signal to background append thread. | ||
| 120 | 2024.09.28 15:28:38.333112 [ 43407 ] {} <Information> RaftInstance: bg append_entries thread terminated | ||
| 121 | 2024.09.28 15:28:38.333193 [ 43351 ] {} <Information> RaftInstance: clean up auto-forwarding queue: 0 elems | ||
| 122 | 2024.09.28 15:28:38.334226 [ 43351 ] {} <Information> RaftInstance: clean up auto-forwarding clients | ||
| 123 | 2024.09.28 15:28:38.334235 [ 43351 ] {} <Information> RaftInstance: raft_server shutdown completed. | ||
| 124 | 2024.09.28 15:28:38.334239 [ 43351 ] {} <Information> RaftInstance: manually create a snapshot on 0 | ||
| 125 | 2024.09.28 15:28:38.334243 [ 43351 ] {} <Information> RaftInstance: creating a snapshot for index 0 | ||
| 126 | 2024.09.28 15:28:38.334248 [ 43351 ] {} <Information> RaftInstance: create snapshot idx 0 log_term 0 | ||
| 127 | 2024.09.28 15:28:38.334253 [ 43351 ] {} <Debug> KeeperStateMachine: Creating snapshot 0 | ||
| 128 | 2024.09.28 15:28:38.334268 [ 43351 ] {} <Information> KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. | ||
| 129 | 2024.09.28 15:28:38.336728 [ 43351 ] {} <Debug> KeeperStateMachine: Created persistent snapshot 0 with path snapshot_0.bin.zstd | ||
| 130 | 2024.09.28 15:28:38.336737 [ 43351 ] {} <Trace> KeeperStateMachine: Clearing garbage after snapshot | ||
| 131 | 2024.09.28 15:28:38.336740 [ 43351 ] {} <Trace> KeeperStateMachine: Cleared garbage after snapshot | ||
| 132 | 2024.09.28 15:28:38.336747 [ 43351 ] {} <Information> RaftInstance: snapshot idx 0 log_term 0 created, compact the log store if needed | ||
| 133 | 2024.09.28 15:28:38.336752 [ 43351 ] {} <Information> KeeperStateMachine: Uploading snapshot snapshot_0.bin.zstd during shutdown because 'upload_snapshot_on_exit' is enabled. | ||
| 134 | 2024.09.28 15:28:38.336758 [ 43351 ] {} <Information> RaftInstance: create snapshot idx 0 log_term 0 done: 2506 us elapsed | ||
| 135 | 2024.09.28 15:28:38.336818 [ 43400 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 5 | ||
| 136 | 2024.09.28 15:28:38.336886 [ 43399 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 3 | ||
| 137 | 2024.09.28 15:28:38.336871 [ 43404 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 7 | ||
| 138 | 2024.09.28 15:28:38.336896 [ 43403 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 4 | ||
| 139 | 2024.09.28 15:28:38.336970 [ 43405 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 2 | ||
| 140 | 2024.09.28 15:28:38.336999 [ 43402 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 1 | ||
| 141 | 2024.09.28 15:28:38.337042 [ 43398 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 0 | ||
| 142 | 2024.09.28 15:28:38.336820 [ 43401 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 5 | ||
| 143 | 2024.09.28 15:28:38.337302 [ 43351 ] {} <Debug> KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 | ||
| 144 | 2024.09.28 15:28:38.337321 [ 43351 ] {} <Information> KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down | ||
| 145 | 2024.09.28 15:28:38.337326 [ 43351 ] {} <Debug> KeeperDispatcher: Dispatcher shut down | ||
| 146 | 2024.09.28 15:28:38.337343 [ 43351 ] {} <Trace> RaftInstance: asio rpc session destroyed: 0x7f545873c918 | ||
| 147 | 2024.09.28 15:28:38.337387 [ 43351 ] {} <Trace> RaftInstance: asio rpc session destroyed: 0x7f5458e70018 | ||
| 148 | 2024.09.28 15:28:38.347523 [ 43351 ] {} <Warning> KeeperLogStore: Changelog is shut down | ||
| 149 | 2024.09.28 15:28:38.355133 [ 43351 ] {} <Error> Application: Code: 210. DB::Exception: Listen [::1]:39003 failed: Poco::Exception. Code: 1000, e.code() = 98, Net Exception: Address already in use: [::1]:39003 (version 23.8.7.24 (official build)). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): | ||
| 150 | |||
| 151 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 152 | 1. DB::Exception::Exception<String const&, int&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<int&>::type, std::type_identity<String>::type>, String const&, int&, String&&) @ 0x000000000c6cf2f8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 153 | 2. DB::Keeper::createServer(String const&, char const*, bool, std::function<void (unsigned short)>&&) const @ 0x000000000c8a3176 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 154 | 3. DB::Keeper::main(std::vector<String, std::allocator<String>> const&) @ 0x000000000c8a680d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 155 | 4. Poco::Util::Application::run() @ 0x0000000015b6da26 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 156 | 5. DB::Keeper::run() @ 0x000000000c8a375e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 157 | 6. Poco::Util::ServerApplication::run(int, char**) @ 0x0000000015b7cb39 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 158 | 7. mainEntryClickHouseKeeper(int, char**) @ 0x000000000c8a2918 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 159 | 8. main @ 0x000000000715572f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 160 | 9. ? @ 0x00007f54593f5d90 in ? | ||
| 161 | 10. ? @ 0x00007f54593f5e40 in ? | ||
| 162 | 11. _start @ 0x000000000634fa2e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 163 | (version 23.8.7.24 (official build)) | ||
| 164 | 2024.09.28 15:28:38.355194 [ 43351 ] {} <Error> Application: DB::Exception: Listen [::1]:39003 failed: Poco::Exception. Code: 1000, e.code() = 98, Net Exception: Address already in use: [::1]:39003 (version 23.8.7.24 (official build)) | ||
| 165 | 2024.09.28 15:28:38.355200 [ 43351 ] {} <Information> Application: shutting down | ||
| 166 | 2024.09.28 15:28:38.355202 [ 43351 ] {} <Debug> Application: Uninitializing subsystem: Logging Subsystem | ||
| 167 | 2024.09.28 15:28:38.355254 [ 43358 ] {} <Trace> BaseDaemon: Received signal -2 | ||
| 168 | 2024.09.28 15:28:38.355273 [ 43358 ] {} <Information> BaseDaemon: Stop SignalListener thread | ||