2026.08.17 23:52:54.328895 [ 434108 ] {} Application: Will watch for the process with pid 434119 2026.08.17 23:52:54.328923 [ 434119 ] {} Application: Forked a child process to watch 2026.08.17 23:52:54.329012 [ 434119 ] {} SentryWriter: Sending crash reports is disabled 2026.08.17 23:52:54.329076 [ 434119 ] {} Pipe: Pipe capacity is 1.00 MiB 2026.08.17 23:52:54.359984 [ 434119 ] {} Application: Starting ClickHouse 23.8.7.24 (revision: 54477, git hash: 812b95e14ba8cf744bf1d70e6de607cf130a79fa, build id: 6484B75ECB16F4FF87A88E10249A45E1BDBDE2E5), PID 434119 2026.08.17 23:52:54.360027 [ 434119 ] {} Application: starting up 2026.08.17 23:52:54.360040 [ 434119 ] {} Application: OS name: Linux, version: 5.15.0-1015-aws, architecture: x86_64 2026.08.17 23:52:54.361675 [ 434119 ] {} Application: Available RAM: 30.74 GiB; physical cores: 16; logical cores: 16. 2026.08.17 23:52:54.362366 [ 434119 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2026.08.17 23:52:54.362374 [ 434119 ] {} AsynchronousMetrics: Scanning /sys/block 2026.08.17 23:52:54.362397 [ 434119 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2026.08.17 23:52:54.362406 [ 434119 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2026.08.17 23:52:54.467221 [ 434119 ] {} Application: Integrity check of the executable successfully passed (checksum: 63E397DB90569A93F13765E06F4A1FBF) 2026.08.17 23:52:54.470454 [ 434119 ] {} Application: Set max number of file descriptors to 524288 (was 1024). 2026.08.17 23:52:54.470460 [ 434119 ] {} Application: rlimit on number of threads is 125877 2026.08.17 23:52:54.470464 [ 434119 ] {} Application: Initializing DateLUT. 2026.08.17 23:52:54.470466 [ 434119 ] {} Application: Initialized DateLUT with time zone 'UTC'. 2026.08.17 23:52:54.470478 [ 434119 ] {} Context: Setting up /var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.434101.1-oximeter-clickward-test/clickhouse-2/data/tmp/ to store temporary data in it 2026.08.17 23:52:54.470613 [ 434119 ] {} Application: Initializing interserver credentials. 2026.08.17 23:52:54.470882 [ 434119 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.434101.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2026.08.17 23:52:54.472985 [ 434119 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.434101.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2026.08.17 23:52:54.473278 [ 434119 ] {} Application: Setting max_server_memory_usage was set to 27.67 GiB (30.74 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2026.08.17 23:52:54.473282 [ 434119 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.37 GiB (30.74 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2026.08.17 23:52:54.473284 [ 434119 ] {} Application: Merges and mutations memory limit is set to 15.37 GiB 2026.08.17 23:52:54.473480 [ 434119 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2026.08.17 23:52:54.473853 [ 434119 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads 2026.08.17 23:52:54.479868 [ 434119 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2026.08.17 23:52:54.480448 [ 434119 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2026.08.17 23:52:54.480872 [ 434119 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2026.08.17 23:52:54.480883 [ 434119 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.434101.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2026.08.17 23:52:54.482401 [ 434119 ] {} Context: Shutting down named sessions 2026.08.17 23:52:54.482409 [ 434119 ] {} Context: Shutting down database catalog 2026.08.17 23:52:54.482411 [ 434119 ] {} DatabaseCatalog: Shutting down system databases 2026.08.17 23:52:54.482414 [ 434119 ] {} Context: Shutting down DDLWorker 2026.08.17 23:52:54.482415 [ 434119 ] {} Context: Shutting down caches 2026.08.17 23:52:54.482448 [ 434119 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2026.08.17 23:52:54.482575 [ 434119 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2026.08.17 23:52:54.482614 [ 434119 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2026.08.17 23:52:54.482637 [ 434119 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2026.08.17 23:52:54.482784 [ 434119 ] {} Application: Code: 210. DB::Exception: Listen [::1]:19402 failed: Poco::Exception. Code: 1000, e.code() = 98, Net Exception: Address already in use: [::1]:19402 (version 23.8.7.24 (official build)). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, int&, String&&) @ 0x000000000c6cf2f8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::Server::createServer(Poco::Util::AbstractConfiguration&, String const&, char const*, bool, bool, std::vector>&, std::function&&) const @ 0x000000000c6cf057 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::Server::createInterserverServers(Poco::Util::AbstractConfiguration&, std::vector> const&, bool, Poco::ThreadPool&, DB::AsynchronousMetrics&, std::vector>&, bool, DB::ServerType const&) @ 0x000000000c6eacb6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. DB::Server::main(std::vector> const&) @ 0x000000000c6df0c7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. Poco::Util::Application::run() @ 0x0000000015b6da26 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. DB::Server::run() @ 0x000000000c6cf89e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. Poco::Util::ServerApplication::run(int, char**) @ 0x0000000015b7cb39 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. mainEntryClickHouseServer(int, char**) @ 0x000000000c6cc66a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. main @ 0x000000000715572f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. ? @ 0x00007fe6a0c83d90 in ? 11. ? @ 0x00007fe6a0c83e40 in ? 12. _start @ 0x000000000634fa2e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse (version 23.8.7.24 (official build)) 2026.08.17 23:52:54.482829 [ 434119 ] {} Application: DB::Exception: Listen [::1]:19402 failed: Poco::Exception. Code: 1000, e.code() = 98, Net Exception: Address already in use: [::1]:19402 (version 23.8.7.24 (official build)) 2026.08.17 23:52:54.482833 [ 434119 ] {} Application: shutting down 2026.08.17 23:52:54.482836 [ 434119 ] {} Application: Uninitializing subsystem: Logging Subsystem 2026.08.17 23:52:54.483136 [ 434120 ] {} BaseDaemon: Received signal -2 2026.08.17 23:52:54.483146 [ 434120 ] {} BaseDaemon: Stop SignalListener thread 2026.08.17 23:52:54.497260 [ 434108 ] {} Application: Child process exited normally with code 70.