2024.12.18 23:38:18.050568 [ 1 ] {} Application: Will watch for the process with pid 9279 2024.12.18 23:38:18.050829 [ 1 ] {} Application: Forked a child process to watch 2024.12.18 23:38:18.205731 [ 1 ] {} Application: Starting ClickHouse 23.8.7.1 (revision: 54477, git hash: b6a391579f09dde47a1aa5602e154e7fcde80d1e, build id: ), PID 9279 2024.12.18 23:38:18.205885 [ 1 ] {} Application: starting up 2024.12.18 23:38:18.206226 [ 1 ] {} Application: OS name: SunOS, version: 5.11, architecture: i86pc 2024.12.18 23:38:18.374614 [ 1 ] {} Application: Available RAM: 31.32 GiB; physical cores: 8; logical cores: 8. 2024.12.18 23:38:18.379213 [ 1 ] {} Application: rlimit on number of file descriptors is 65536 2024.12.18 23:38:18.379228 [ 1 ] {} Application: Initializing DateLUT. 2024.12.18 23:38:18.379239 [ 1 ] {} Application: Initialized DateLUT with time zone 'UTC'. 2024.12.18 23:38:18.379285 [ 1 ] {} Context: Setting up /var/tmp/omicron_tmp/clickward_test/clickhouse-1/data/tmp/ to store temporary data in it 2024.12.18 23:38:18.379603 [ 1 ] {} Application: Initializing interserver credentials. 2024.12.18 23:38:18.381613 [ 1 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/clickward_test/clickhouse-1/clickhouse-config.xml' 2024.12.18 23:38:18.382633 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/clickward_test/clickhouse-1/clickhouse-config.xml', performing update on configuration 2024.12.18 23:38:18.383829 [ 1 ] {} Application: Setting max_server_memory_usage was set to 28.18 GiB (31.32 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.12.18 23:38:18.383844 [ 1 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.66 GiB (31.32 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.12.18 23:38:18.383863 [ 1 ] {} Application: Merges and mutations memory limit is set to 15.66 GiB 2024.12.18 23:38:18.391174 [ 1 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2024.12.18 23:38:18.392530 [ 1 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads 2024.12.18 23:38:18.401396 [ 1 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2024.12.18 23:38:18.402969 [ 1 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2024.12.18 23:38:18.404941 [ 1 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.12.18 23:38:18.405022 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/clickward_test/clickhouse-1/clickhouse-config.xml', performed update on configuration 2024.12.18 23:38:18.407617 [ 1 ] {} Application: Listening for replica communication (interserver): http://[::1]:29401 2024.12.18 23:38:18.408523 [ 1 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/clickward_test/clickhouse-1/clickhouse-config.xml' 2024.12.18 23:38:18.409284 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/clickward_test/clickhouse-1/clickhouse-config.xml', performing update on configuration 2024.12.18 23:38:18.418952 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/clickward_test/clickhouse-1/clickhouse-config.xml', performed update on configuration 2024.12.18 23:38:18.419550 [ 1 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /var/tmp/omicron_tmp/clickward_test/clickhouse-1/clickhouse-config.xml 2024.12.18 23:38:18.421093 [ 1 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2024.12.18 23:38:18.421904 [ 1 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2024.12.18 23:38:18.422635 [ 1 ] {} Context: Initialized background executor for fetches with num_threads=8, num_tasks=8 2024.12.18 23:38:18.423393 [ 1 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2024.12.18 23:38:18.424695 [ 1 ] {} DNSCacheUpdater: Update period 15 seconds 2024.12.18 23:38:18.424726 [ 1 ] {} Application: Loading metadata from /var/tmp/omicron_tmp/clickward_test/clickhouse-1/data/ 2024.12.18 23:38:18.424732 [ 178 ] {} DNSResolver: Updating DNS cache 2024.12.18 23:38:18.424775 [ 178 ] {} DNSResolver: Updated DNS cache 2024.12.18 23:38:18.433379 [ 1 ] {} DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total. 2024.12.18 23:38:18.433397 [ 1 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 9.9093e-05 sec 2024.12.18 23:38:18.433418 [ 1 ] {} ReferentialDeps: No tables 2024.12.18 23:38:18.433428 [ 1 ] {} LoadingDeps: No tables 2024.12.18 23:38:18.434303 [ 1 ] {} DatabaseAtomic (system): Starting up tables. 2024.12.18 23:38:18.436832 [ 1 ] {} SystemLog: Not creating system.query_log since corresponding section 'query_log' is missing from config 2024.12.18 23:38:18.436847 [ 1 ] {} SystemLog: Not creating system.query_thread_log since corresponding section 'query_thread_log' is missing from config 2024.12.18 23:38:18.436895 [ 1 ] {} SystemLog: Not creating system.part_log since corresponding section 'part_log' is missing from config 2024.12.18 23:38:18.436911 [ 1 ] {} SystemLog: Not creating system.trace_log since corresponding section 'trace_log' is missing from config 2024.12.18 23:38:18.436917 [ 1 ] {} SystemLog: Not creating system.crash_log since corresponding section 'crash_log' is missing from config 2024.12.18 23:38:18.436951 [ 1 ] {} SystemLog: Not creating system.text_log since corresponding section 'text_log' is missing from config 2024.12.18 23:38:18.436966 [ 1 ] {} SystemLog: Creating system.metric_log from metric_log 2024.12.18 23:38:18.452089 [ 1 ] {} SystemLog: Not creating system.filesystem_cache_log since corresponding section 'filesystem_cache_log' is missing from config 2024.12.18 23:38:18.452147 [ 1 ] {} SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config 2024.12.18 23:38:18.452163 [ 1 ] {} SystemLog: Creating system.asynchronous_metric_log from asynchronous_metric_log 2024.12.18 23:38:18.452378 [ 1 ] {} SystemLog: Creating system.opentelemetry_span_log from opentelemetry_span_log 2024.12.18 23:38:18.456754 [ 1 ] {} SystemLog: Not creating system.query_views_log since corresponding section 'query_views_log' is missing from config 2024.12.18 23:38:18.456860 [ 1 ] {} SystemLog: Not creating system.zookeeper_log since corresponding section 'zookeeper_log' is missing from config 2024.12.18 23:38:18.456891 [ 1 ] {} SystemLog: Not creating system.session_log since corresponding section 'session_log' is missing from config 2024.12.18 23:38:18.456907 [ 1 ] {} SystemLog: Not creating system.transactions_info_log since corresponding section 'transactions_info_log' is missing from config 2024.12.18 23:38:18.456963 [ 1 ] {} SystemLog: Not creating system.processors_profile_log since corresponding section 'processors_profile_log' is missing from config 2024.12.18 23:38:18.456989 [ 1 ] {} SystemLog: Not creating system.asynchronous_insert_log since corresponding section 'asynchronous_insert_log' is missing from config 2024.12.18 23:38:18.496017 [ 1 ] {} DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal. 2024.12.18 23:38:18.496467 [ 1 ] {} DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total. 2024.12.18 23:38:18.496483 [ 1 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 3.6402e-05 sec 2024.12.18 23:38:18.496490 [ 1 ] {} ReferentialDeps: No tables 2024.12.18 23:38:18.496495 [ 1 ] {} LoadingDeps: No tables 2024.12.18 23:38:18.496509 [ 1 ] {} DatabaseAtomic (default): Starting up tables. 2024.12.18 23:38:18.496705 [ 1 ] {} UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/tmp/omicron_tmp/clickward_test/clickhouse-1/data/user_defined/ 2024.12.18 23:38:18.496748 [ 1 ] {} UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded 2024.12.18 23:38:18.496755 [ 1 ] {} Application: Loaded metadata. 2024.12.18 23:38:18.496762 [ 1 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2024.12.18 23:38:18.496767 [ 1 ] {} Application: TaskStats is not implemented for this OS. IO accounting will be disabled. 2024.12.18 23:38:18.496870 [ 1 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.12.18 23:38:18.497029 [ 1 ] {} AsynchronousMetrics: MemoryTracking: was 13.98 MiB, peak 16.16 MiB, free memory in arenas 0.00 B, will set to 108.09 MiB (RSS), difference: 94.11 MiB 2024.12.18 23:38:18.499154 [ 1 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 2.7897e-05 sec. 2024.12.18 23:38:18.501340 [ 1 ] {} Application: Listening for http://[::1]:29301 2024.12.18 23:38:18.501358 [ 252 ] {} DDLWorker: Starting DDLWorker thread 2024.12.18 23:38:18.501384 [ 253 ] {} DDLWorker: Started DDLWorker cleanup thread 2024.12.18 23:38:18.501403 [ 252 ] {} DDLWorker: Initializing DDLWorker thread 2024.12.18 23:38:18.501490 [ 1 ] {} Application: Listening for native protocol (tcp): [::1]:29201 2024.12.18 23:38:18.547787 [ 1 ] {} Application: Ready for connections. 2024.12.18 23:38:18.604265 [ 252 ] {} virtual bool DB::DDLWorker::initializeMainThread(): Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:29002, [::1]:29001, [::1]:29003 Poco::Exception. Code: 1000, e.code() = 146, Connection refused: [::1]:29002 (version 23.8.7.1), [::1]:29002 Poco::Exception. Code: 1000, e.code() = 146, Connection refused: [::1]:29001 (version 23.8.7.1), [::1]:29001 Poco::Exception. Code: 1000, e.code() = 146, Connection refused: [::1]:29003 (version 23.8.7.1), [::1]:29003 Poco::Exception. Code: 1000, e.code() = 146, Connection refused: [::1]:29002 (version 23.8.7.1), [::1]:29002 Poco::Exception. Code: 1000, e.code() = 146, Connection refused: [::1]:29001 (version 23.8.7.1), [::1]:29001 Poco::Exception. Code: 1000, e.code() = 146, Connection refused: [::1]:29003 (version 23.8.7.1), [::1]:29003 Poco::Exception. Code: 1000, e.code() = 146, Connection refused: [::1]:29002 (version 23.8.7.1), [::1]:29002 Poco::Exception. Code: 1000, e.code() = 146, Connection refused (version 23.8.7.1), [::1]:29001 Poco::Exception. Code: 1000, e.code() = 146, Connection refused: [::1]:29003 (version 23.8.7.1), [::1]:29003 . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::Exception::Exception, std::allocator >&>(int, FormatStringHelperImpl, std::allocator >&>::type>, std::__cxx11::basic_string, std::allocator >&) @ 0x000000000aded677 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::Exception::Exception, std::allocator >&>(Coordination::Error, FormatStringHelperImpl, std::allocator >&>::type>, std::__cxx11::basic_string, std::allocator >&) @ 0x0000000015562ded in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::connect(std::vector > const&, Poco::Timespan) @ 0x0000000016bad2ca in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. Coordination::ZooKeeper::ZooKeeper(std::vector > const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional >&&) @ 0x0000000016baaecb in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x0000000016b741e9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::ZooKeeper(Poco::Util::AbstractConfiguration const&, std::__cxx11::basic_string, std::allocator > const&, std::shared_ptr) @ 0x0000000016b75a63 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. DB::Context::getZooKeeper() const @ 0x0000000014e80509 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::DDLWorker::getAndSetZooKeeper() @ 0x0000000014ebd50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::DDLWorker::initializeMainThread() @ 0x0000000014ecbd0c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::DDLWorker::runMainThread() @ 0x0000000014ebbd51 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::{lambda()#1}::operator()() @ 0x0000000014ecd995 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. ThreadPoolImpl::worker(std::_List_iterator) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32 15. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 (version 23.8.7.1) 2024.12.18 23:38:19.000234 [ 248 ] {} AsynchronousMetrics: MemoryTracking: was 108.12 MiB, peak 108.12 MiB, free memory in arenas 0.00 B, will set to 117.21 MiB (RSS), difference: 9.09 MiB 2024.12.18 23:38:20.144129 [ 3 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:40378 2024.12.18 23:38:20.144320 [ 3 ] {} TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. 2024.12.18 23:38:20.144394 [ 3 ] {} TCP-Session: 6f47ffbf-61d6-488f-a01c-5594b9bc42a8 Authenticating user 'default' from [::1]:40378 2024.12.18 23:38:20.144461 [ 3 ] {} TCP-Session: 6f47ffbf-61d6-488f-a01c-5594b9bc42a8 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.144475 [ 3 ] {} TCP-Session: 6f47ffbf-61d6-488f-a01c-5594b9bc42a8 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.144664 [ 3 ] {} ContextAccess (default): Settings: readonly = 0, allow_ddl = true, allow_introspection_functions = false 2024.12.18 23:38:20.144707 [ 3 ] {} ContextAccess (default): List of all grants: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* 2024.12.18 23:38:20.144726 [ 3 ] {} ContextAccess (default): List of all grants including implicit: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* 2024.12.18 23:38:20.145375 [ 4 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:41434 2024.12.18 23:38:20.145417 [ 5 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:53819 2024.12.18 23:38:20.145583 [ 4 ] {} TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. 2024.12.18 23:38:20.145596 [ 5 ] {} TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. 2024.12.18 23:38:20.145628 [ 4 ] {} TCP-Session: 09e6fc92-66f1-4c05-aef2-9d2e551984f5 Authenticating user 'default' from [::1]:41434 2024.12.18 23:38:20.145642 [ 5 ] {} TCP-Session: e0109645-10e3-48e6-95fb-3011656ede56 Authenticating user 'default' from [::1]:53819 2024.12.18 23:38:20.145650 [ 4 ] {} TCP-Session: 09e6fc92-66f1-4c05-aef2-9d2e551984f5 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.145664 [ 5 ] {} TCP-Session: e0109645-10e3-48e6-95fb-3011656ede56 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.145670 [ 4 ] {} TCP-Session: 09e6fc92-66f1-4c05-aef2-9d2e551984f5 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.145679 [ 5 ] {} TCP-Session: e0109645-10e3-48e6-95fb-3011656ede56 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.145843 [ 256 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:49920 2024.12.18 23:38:20.145999 [ 256 ] {} TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. 2024.12.18 23:38:20.146026 [ 256 ] {} TCP-Session: ea589be7-6cb4-4308-92cb-72258a07ccc3 Authenticating user 'default' from [::1]:49920 2024.12.18 23:38:20.146046 [ 256 ] {} TCP-Session: ea589be7-6cb4-4308-92cb-72258a07ccc3 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.146065 [ 256 ] {} TCP-Session: ea589be7-6cb4-4308-92cb-72258a07ccc3 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.146065 [ 258 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:59605 2024.12.18 23:38:20.146077 [ 257 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:61453 2024.12.18 23:38:20.146335 [ 259 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:46978 2024.12.18 23:38:20.146342 [ 257 ] {} TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. 2024.12.18 23:38:20.146348 [ 258 ] {} TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. 2024.12.18 23:38:20.146373 [ 257 ] {} TCP-Session: 43d585db-31f4-4bd7-aa31-6d346372e938 Authenticating user 'default' from [::1]:61453 2024.12.18 23:38:20.146410 [ 258 ] {} TCP-Session: f017b1be-55be-4de4-8777-39d5a4c5f660 Authenticating user 'default' from [::1]:59605 2024.12.18 23:38:20.146420 [ 257 ] {} TCP-Session: 43d585db-31f4-4bd7-aa31-6d346372e938 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.146479 [ 257 ] {} TCP-Session: 43d585db-31f4-4bd7-aa31-6d346372e938 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.146479 [ 258 ] {} TCP-Session: f017b1be-55be-4de4-8777-39d5a4c5f660 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.146489 [ 259 ] {} TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. 2024.12.18 23:38:20.146511 [ 260 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:40600 2024.12.18 23:38:20.146527 [ 259 ] {} TCP-Session: 18569ebb-e8bd-492a-b770-5f468b5df064 Authenticating user 'default' from [::1]:46978 2024.12.18 23:38:20.146522 [ 258 ] {} TCP-Session: f017b1be-55be-4de4-8777-39d5a4c5f660 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.146585 [ 259 ] {} TCP-Session: 18569ebb-e8bd-492a-b770-5f468b5df064 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.146649 [ 259 ] {} TCP-Session: 18569ebb-e8bd-492a-b770-5f468b5df064 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.146659 [ 261 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:34729 2024.12.18 23:38:20.146738 [ 260 ] {} TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. 2024.12.18 23:38:20.146778 [ 260 ] {} TCP-Session: c46ce648-59ca-4fd1-b2d9-734886b8ddff Authenticating user 'default' from [::1]:40600 2024.12.18 23:38:20.148975 [ 261 ] {} TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. 2024.12.18 23:38:20.148982 [ 260 ] {} TCP-Session: c46ce648-59ca-4fd1-b2d9-734886b8ddff Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.149011 [ 261 ] {} TCP-Session: 2ebbdf7b-363f-4430-87f8-d626ef02780d Authenticating user 'default' from [::1]:34729 2024.12.18 23:38:20.149020 [ 260 ] {} TCP-Session: c46ce648-59ca-4fd1-b2d9-734886b8ddff Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.149027 [ 261 ] {} TCP-Session: 2ebbdf7b-363f-4430-87f8-d626ef02780d Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.151087 [ 261 ] {} TCP-Session: 2ebbdf7b-363f-4430-87f8-d626ef02780d Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.168418 [ 259 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:46978). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::NetException::NetException, std::allocator >, std::__cxx11::basic_string, std::allocator > >(int, FormatStringHelperImpl, std::allocator > >::type, std::type_identity, std::allocator > >::type>, std::__cxx11::basic_string, std::allocator >&&, std::__cxx11::basic_string, std::allocator >&&) @ 0x0000000015b19afe in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000190bd7af in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. DB::TCPHandler::runImpl() @ 0x0000000015b25abc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. DB::TCPHandler::run() @ 0x0000000015b3661c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. Poco::Net::TCPServerConnection::start() @ 0x000000001954534c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. Poco::Net::TCPServerDispatcher::run() @ 0x0000000019545821 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. Poco::PooledThread::run() @ 0x00000000195aa732 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000195a81e5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 (version 23.8.7.1) 2024.12.18 23:38:20.168481 [ 259 ] {} TCP-Session: 18569ebb-e8bd-492a-b770-5f468b5df064 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.338660 [ 3 ] {} TCPHandler: Done processing connection. 2024.12.18 23:38:20.338698 [ 3 ] {} TCP-Session: 6f47ffbf-61d6-488f-a01c-5594b9bc42a8 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.338985 [ 4 ] {} TCPHandler: Done processing connection. 2024.12.18 23:38:20.339016 [ 4 ] {} TCP-Session: 09e6fc92-66f1-4c05-aef2-9d2e551984f5 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.339136 [ 257 ] {} TCPHandler: Done processing connection. 2024.12.18 23:38:20.339156 [ 257 ] {} TCP-Session: 43d585db-31f4-4bd7-aa31-6d346372e938 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.339232 [ 261 ] {} TCPHandler: Done processing connection. 2024.12.18 23:38:20.339251 [ 261 ] {} TCP-Session: 2ebbdf7b-363f-4430-87f8-d626ef02780d Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.339318 [ 256 ] {} TCPHandler: Done processing connection. 2024.12.18 23:38:20.339341 [ 256 ] {} TCP-Session: ea589be7-6cb4-4308-92cb-72258a07ccc3 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.339390 [ 258 ] {} TCPHandler: Done processing connection. 2024.12.18 23:38:20.339413 [ 258 ] {} TCP-Session: f017b1be-55be-4de4-8777-39d5a4c5f660 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.339448 [ 5 ] {} TCPHandler: Done processing connection. 2024.12.18 23:38:20.339474 [ 5 ] {} TCP-Session: e0109645-10e3-48e6-95fb-3011656ede56 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:20.339494 [ 260 ] {} TCPHandler: Done processing connection. 2024.12.18 23:38:20.339516 [ 260 ] {} TCP-Session: c46ce648-59ca-4fd1-b2d9-734886b8ddff Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.12.18 23:38:21.000229 [ 248 ] {} AsynchronousMetrics: MemoryTracking: was 117.25 MiB, peak 119.29 MiB, free memory in arenas 0.00 B, will set to 118.45 MiB (RSS), difference: 1.19 MiB 2024.12.18 23:38:23.606367 [ 252 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:29001 with session_id 5 2024.12.18 23:38:23.606925 [ 252 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.12.18 23:38:23.606948 [ 252 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.12.18 23:38:23.606954 [ 252 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.12.18 23:38:23.606994 [ 252 ] {} ZooKeeper: Initialized, hosts: [::1]:29001,[::1]:29002,[::1]:29003 2024.12.18 23:38:23.614656 [ 252 ] {} DDLWorker: Initialized DDLWorker thread 2024.12.18 23:38:23.614702 [ 252 ] {} DDLWorker: Scheduling tasks 2024.12.18 23:38:23.614710 [ 252 ] {} DDLWorker: Don't have unfinished tasks after restarting 2024.12.18 23:38:23.614721 [ 253 ] {} DDLWorker: Cleaning queue 2024.12.18 23:38:23.614956 [ 252 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=0, queue_size=0, entries=none..none, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2024.12.18 23:38:23.614969 [ 252 ] {} DDLWorker: No tasks to schedule 2024.12.18 23:38:23.614975 [ 252 ] {} DDLWorker: Waiting for queue updates 2024.12.18 23:38:25.957449 [ 245 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 496 entries to flush up to offset 496 2024.12.18 23:38:25.957565 [ 244 ] {} SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 8 2024.12.18 23:38:25.957740 [ 245 ] {} SystemLog (system.asynchronous_metric_log): Creating new table system.asynchronous_metric_log for AsynchronousMetricLog 2024.12.18 23:38:25.957749 [ 244 ] {} SystemLog (system.metric_log): Creating new table system.metric_log for MetricLog 2024.12.18 23:38:25.978231 [ 245 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.12.18 23:38:25.978572 [ 245 ] {} system.asynchronous_metric_log (c79a6df8-b664-413c-bcc4-f856746c9e94): Loading data parts 2024.12.18 23:38:25.978585 [ 244 ] {} system.metric_log (d6473194-18b1-4da9-8e9e-9bfedfaec74a): Loading data parts 2024.12.18 23:38:25.979105 [ 244 ] {} system.metric_log (d6473194-18b1-4da9-8e9e-9bfedfaec74a): There are no data parts 2024.12.18 23:38:25.979106 [ 245 ] {} system.asynchronous_metric_log (c79a6df8-b664-413c-bcc4-f856746c9e94): There are no data parts 2024.12.18 23:38:25.989431 [ 245 ] {} system.asynchronous_metric_log (c79a6df8-b664-413c-bcc4-f856746c9e94): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.12.18 23:38:25.989481 [ 245 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 138.68 GiB. 2024.12.18 23:38:25.991742 [ 245 ] {} MergedBlockOutputStream: filled checksums 202412_1_1_0 (state Temporary) 2024.12.18 23:38:25.994723 [ 245 ] {} system.asynchronous_metric_log (c79a6df8-b664-413c-bcc4-f856746c9e94): Renaming temporary part tmp_insert_202412_1_1_0 to 202412_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.12.18 23:38:25.995311 [ 245 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 496 2024.12.18 23:38:26.000216 [ 248 ] {} AsynchronousMetrics: MemoryTracking: was 123.15 MiB, peak 131.32 MiB, free memory in arenas 0.00 B, will set to 128.97 MiB (RSS), difference: 5.82 MiB 2024.12.18 23:38:26.005793 [ 244 ] {} system.metric_log (d6473194-18b1-4da9-8e9e-9bfedfaec74a): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.12.18 23:38:26.005826 [ 244 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 138.68 GiB. 2024.12.18 23:38:26.016582 [ 244 ] {} MergedBlockOutputStream: filled checksums 202412_1_1_0 (state Temporary) 2024.12.18 23:38:26.029476 [ 244 ] {} system.metric_log (d6473194-18b1-4da9-8e9e-9bfedfaec74a): Renaming temporary part tmp_insert_202412_1_1_0 to 202412_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.12.18 23:38:26.032249 [ 244 ] {} SystemLog (system.metric_log): Flushed system log up to offset 8 2024.12.18 23:38:27.000227 [ 248 ] {} AsynchronousMetrics: MemoryTracking: was 129.61 MiB, peak 137.97 MiB, free memory in arenas 0.00 B, will set to 134.52 MiB (RSS), difference: 4.91 MiB 2024.12.18 23:38:33.424886 [ 153 ] {} DNSResolver: Updating DNS cache 2024.12.18 23:38:33.424957 [ 153 ] {} DNSResolver: Updated DNS cache 2024.12.18 23:38:33.495463 [ 245 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 496 entries to flush up to offset 992 2024.12.18 23:38:33.496714 [ 245 ] {} system.asynchronous_metric_log (c79a6df8-b664-413c-bcc4-f856746c9e94): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.12.18 23:38:33.496743 [ 245 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 138.68 GiB. 2024.12.18 23:38:33.497328 [ 245 ] {} MergedBlockOutputStream: filled checksums 202412_2_2_0 (state Temporary) 2024.12.18 23:38:33.497791 [ 245 ] {} system.asynchronous_metric_log (c79a6df8-b664-413c-bcc4-f856746c9e94): Renaming temporary part tmp_insert_202412_2_2_0 to 202412_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.12.18 23:38:33.498036 [ 245 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 992 2024.12.18 23:38:33.532334 [ 244 ] {} SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 16 2024.12.18 23:38:33.553475 [ 244 ] {} system.metric_log (d6473194-18b1-4da9-8e9e-9bfedfaec74a): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.12.18 23:38:33.553511 [ 244 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 138.68 GiB. 2024.12.18 23:38:33.562368 [ 244 ] {} MergedBlockOutputStream: filled checksums 202412_2_2_0 (state Temporary) 2024.12.18 23:38:33.572818 [ 244 ] {} system.metric_log (d6473194-18b1-4da9-8e9e-9bfedfaec74a): Renaming temporary part tmp_insert_202412_2_2_0 to 202412_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.12.18 23:38:33.575776 [ 244 ] {} SystemLog (system.metric_log): Flushed system log up to offset 16 2024.12.18 23:38:34.000210 [ 248 ] {} AsynchronousMetrics: MemoryTracking: was 134.36 MiB, peak 143.14 MiB, free memory in arenas 0.00 B, will set to 135.91 MiB (RSS), difference: 1.55 MiB