2026.06.18 22:35:28.856085 [ 125781 ] {} SentryWriter: Sending crash reports is disabled 2026.06.18 22:35:28.886096 [ 125781 ] {} Application: Starting ClickHouse 23.8.7.24 (revision: 54477, git hash: 812b95e14ba8cf744bf1d70e6de607cf130a79fa, build id: 6484B75ECB16F4FF87A88E10249A45E1BDBDE2E5), PID 125781 2026.06.18 22:35:28.886143 [ 125781 ] {} Application: starting up 2026.06.18 22:35:28.886153 [ 125781 ] {} Application: OS name: Linux, version: 5.15.0-1015-aws, architecture: x86_64 2026.06.18 22:35:28.887959 [ 125781 ] {} Application: Available RAM: 30.74 GiB; physical cores: 16; logical cores: 16. 2026.06.18 22:35:28.992027 [ 125781 ] {} Application: Integrity check of the executable successfully passed (checksum: 63E397DB90569A93F13765E06F4A1FBF) 2026.06.18 22:35:28.999039 [ 125781 ] {} Application: It looks like the process has no CAP_IPC_LOCK capability, binary mlock will be disabled. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_ipc_lock=+ep /work/oxidecomputer/omicron/out/clickhouse/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems. 2026.06.18 22:35:29.013594 [ 125781 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2026.06.18 22:35:29.016435 [ 125781 ] {} Application: Setting max_server_memory_usage was set to 27.67 GiB (30.74 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2026.06.18 22:35:29.016449 [ 125781 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.37 GiB (30.74 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2026.06.18 22:35:29.016461 [ 125781 ] {} Application: Merges and mutations memory limit is set to 15.37 GiB 2026.06.18 22:35:29.016495 [ 125781 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2026.06.18 22:35:29.016925 [ 125781 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads 2026.06.18 22:35:29.024664 [ 125781 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2026.06.18 22:35:29.025223 [ 125781 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2026.06.18 22:35:29.027167 [ 125781 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2026.06.18 22:35:29.031605 [ 125781 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2026.06.18 22:35:29.033101 [ 125781 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2026.06.18 22:35:29.056042 [ 125781 ] {} Context: Initialized background executor for fetches with num_threads=8, num_tasks=8 2026.06.18 22:35:29.056246 [ 125781 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2026.06.18 22:35:29.062545 [ 125781 ] {} DNSCacheUpdater: Update period 15 seconds 2026.06.18 22:35:29.062572 [ 125781 ] {} Application: Loading metadata from /var/tmp/omicron_tmp/omicron_nexus-692f04ffbaf0ee17-test_collect_one.125184.1-clickhouse-a18uR3/datastore/ 2026.06.18 22:35:29.087937 [ 125781 ] {} DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total. 2026.06.18 22:35:29.087960 [ 125781 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 7.9571e-05 sec 2026.06.18 22:35:29.087992 [ 125781 ] {} DatabaseAtomic (system): Starting up tables. 2026.06.18 22:35:29.100386 [ 125781 ] {} DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal. 2026.06.18 22:35:29.106781 [ 125781 ] {} DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total. 2026.06.18 22:35:29.106804 [ 125781 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 6.1221e-05 sec 2026.06.18 22:35:29.106828 [ 125781 ] {} DatabaseAtomic (default): Starting up tables. 2026.06.18 22:35:29.106911 [ 125781 ] {} UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/tmp/omicron_tmp/omicron_nexus-692f04ffbaf0ee17-test_collect_one.125184.1-clickhouse-a18uR3/datastore/user_defined/ 2026.06.18 22:35:29.106941 [ 125781 ] {} Application: Tasks stats provider: procfs 2026.06.18 22:35:29.106949 [ 125781 ] {} Application: It looks like the process has no CAP_SYS_NICE capability, the setting 'os_thread_priority' will have no effect. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_sys_nice=+ep /work/oxidecomputer/omicron/out/clickhouse/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems. 2026.06.18 22:35:29.107214 [ 125781 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2026.06.18 22:35:29.108248 [ 125781 ] {} Application: Listening for http://[::1]:35223 2026.06.18 22:35:29.108285 [ 125781 ] {} Application: Listening for native protocol (tcp): [::1]:39117 2026.06.18 22:35:29.108312 [ 125781 ] {} Application: Listening for http://127.0.0.1:37665 2026.06.18 22:35:29.108334 [ 125781 ] {} Application: Listening for native protocol (tcp): 127.0.0.1:44677 2026.06.18 22:35:29.108337 [ 125781 ] {} Application: Ready for connections. 2026.06.18 22:35:34.014833 [ 127810 ] {6093bd09-608c-4756-a84d-5fc6ad933341} executeQuery: Code: 81. DB::Exception: Database oximeter does not exist. (UNKNOWN_DATABASE) (version 23.8.7.24 (official build)) (from [::1]:42948) (in query: SELECT MAX(value) AS max_version FROM oximeter.version;), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000715892d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::DatabaseCatalog::getDatabase(String const&) const @ 0x000000001170be95 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::Context::resolveStorageID(DB::StorageID, DB::Context::StorageNamespace) const @ 0x00000000116810de in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. DB::JoinedTables::getLeftTableStorage() @ 0x0000000011fde326 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000011ee92e3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000011f9c308 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x0000000011ea331e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000122e55ea in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000122e15d5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::TCPHandler::runImpl() @ 0x0000000013156f39 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::TCPHandler::run() @ 0x00000000131691b9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. Poco::Net::TCPServerConnection::start() @ 0x0000000015b5f7f4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b609f1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. Poco::PooledThread::run() @ 0x0000000015c97227 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c954fc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 16. ? @ 0x00007f5e52f2aac3 in ? 17. ? @ 0x00007f5e52fbc8d0 in ? 2026.06.18 22:35:34.017580 [ 127810 ] {6093bd09-608c-4756-a84d-5fc6ad933341} TCPHandler: Code: 81. DB::Exception: Database oximeter does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000715892d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::DatabaseCatalog::getDatabase(String const&) const @ 0x000000001170be95 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::Context::resolveStorageID(DB::StorageID, DB::Context::StorageNamespace) const @ 0x00000000116810de in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. DB::JoinedTables::getLeftTableStorage() @ 0x0000000011fde326 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000011ee92e3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000011f9c308 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x0000000011ea331e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000122e55ea in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000122e15d5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::TCPHandler::runImpl() @ 0x0000000013156f39 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::TCPHandler::run() @ 0x00000000131691b9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. Poco::Net::TCPServerConnection::start() @ 0x0000000015b5f7f4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b609f1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. Poco::PooledThread::run() @ 0x0000000015c97227 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c954fc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 16. ? @ 0x00007f5e52f2aac3 in ? 17. ? @ 0x00007f5e52fbc8d0 in ? 2026.06.18 22:35:34.057946 [ 127811 ] {93eb9692-218b-4cd3-800e-13bb13a328df} executeQuery: Code: 81. DB::Exception: Database oximeter does not exist. (UNKNOWN_DATABASE) (version 23.8.7.24 (official build)) (from [::1]:42950) (in query: SELECT MAX(value) AS max_version FROM oximeter.version;), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000715892d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::DatabaseCatalog::getDatabase(String const&) const @ 0x000000001170be95 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::Context::resolveStorageID(DB::StorageID, DB::Context::StorageNamespace) const @ 0x00000000116810de in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. DB::JoinedTables::getLeftTableStorage() @ 0x0000000011fde326 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000011ee92e3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000011f9c308 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x0000000011ea331e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000122e55ea in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000122e15d5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::TCPHandler::runImpl() @ 0x0000000013156f39 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::TCPHandler::run() @ 0x00000000131691b9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. Poco::Net::TCPServerConnection::start() @ 0x0000000015b5f7f4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b609f1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. Poco::PooledThread::run() @ 0x0000000015c97227 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c954fc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 16. ? @ 0x00007f5e52f2aac3 in ? 17. ? @ 0x00007f5e52fbc8d0 in ? 2026.06.18 22:35:34.058017 [ 127811 ] {93eb9692-218b-4cd3-800e-13bb13a328df} TCPHandler: Code: 81. DB::Exception: Database oximeter does not exist. (UNKNOWN_DATABASE), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&&) @ 0x000000000715892d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::DatabaseCatalog::getDatabase(String const&) const @ 0x000000001170be95 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::Context::resolveStorageID(DB::StorageID, DB::Context::StorageNamespace) const @ 0x00000000116810de in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. DB::JoinedTables::getLeftTableStorage() @ 0x0000000011fde326 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::shared_ptr const&, std::shared_ptr const&, std::optional, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000011ee92e3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::shared_ptr const&, std::shared_ptr, DB::SelectQueryOptions const&, std::vector> const&) @ 0x0000000011f9c308 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. DB::InterpreterFactory::get(std::shared_ptr&, std::shared_ptr, DB::SelectQueryOptions const&) @ 0x0000000011ea331e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. DB::executeQueryImpl(char const*, char const*, std::shared_ptr, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x00000000122e55ea in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::executeQuery(String const&, std::shared_ptr, bool, DB::QueryProcessingStage::Enum) @ 0x00000000122e15d5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::TCPHandler::runImpl() @ 0x0000000013156f39 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::TCPHandler::run() @ 0x00000000131691b9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. Poco::Net::TCPServerConnection::start() @ 0x0000000015b5f7f4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b609f1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. Poco::PooledThread::run() @ 0x0000000015c97227 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c954fc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 16. ? @ 0x00007f5e52f2aac3 in ? 17. ? @ 0x00007f5e52fbc8d0 in ? 2026.06.18 22:35:34.091768 [ 127812 ] {04ba3900-e44c-4e77-9cbd-3d41cb78745e} DatabaseAtomic (oximeter): Metadata processed, database oximeter has 0 tables and 0 dictionaries in total. 2026.06.18 22:35:34.091789 [ 127812 ] {04ba3900-e44c-4e77-9cbd-3d41cb78745e} TablesLoader: Parsed metadata of 0 tables in 1 databases in 8.068e-05 sec 2026.06.18 22:35:34.091823 [ 127812 ] {04ba3900-e44c-4e77-9cbd-3d41cb78745e} DatabaseAtomic (oximeter): Starting up tables.