| 1 | 2026.08.17 23:52:05.845030 [ 423882 ] {} <Information> Application: Will watch for the process with pid 423927 | ||
| 2 | 2026.08.17 23:52:05.845087 [ 423927 ] {} <Information> Application: Forked a child process to watch | ||
| 3 | 2026.08.17 23:52:05.845216 [ 423927 ] {} <Information> SentryWriter: Sending crash reports is disabled | ||
| 4 | 2026.08.17 23:52:05.845295 [ 423927 ] {} <Trace> Pipe: Pipe capacity is 1.00 MiB | ||
| 5 | 2026.08.17 23:52:05.878692 [ 423927 ] {} <Information> Application: Starting ClickHouse 23.8.7.24 (revision: 54477, git hash: 812b95e14ba8cf744bf1d70e6de607cf130a79fa, build id: 6484B75ECB16F4FF87A88E10249A45E1BDBDE2E5), PID 423927 | ||
| 6 | 2026.08.17 23:52:05.878749 [ 423927 ] {} <Information> Application: starting up | ||
| 7 | 2026.08.17 23:52:05.878766 [ 423927 ] {} <Information> Application: OS name: Linux, version: 5.15.0-1015-aws, architecture: x86_64 | ||
| 8 | 2026.08.17 23:52:05.881369 [ 423927 ] {} <Information> Application: Available RAM: 30.74 GiB; physical cores: 16; logical cores: 16. | ||
| 9 | 2026.08.17 23:52:05.881868 [ 423927 ] {} <Trace> AsynchronousMetrics: Scanning /sys/class/thermal | ||
| 10 | 2026.08.17 23:52:05.881878 [ 423927 ] {} <Trace> AsynchronousMetrics: Scanning /sys/block | ||
| 11 | 2026.08.17 23:52:05.881903 [ 423927 ] {} <Trace> AsynchronousMetrics: Scanning /sys/devices/system/edac | ||
| 12 | 2026.08.17 23:52:05.881915 [ 423927 ] {} <Trace> AsynchronousMetrics: Scanning /sys/class/hwmon | ||
| 13 | 2026.08.17 23:52:05.986929 [ 423927 ] {} <Information> Application: Integrity check of the executable successfully passed (checksum: 63E397DB90569A93F13765E06F4A1FBF) | ||
| 14 | 2026.08.17 23:52:05.989990 [ 423927 ] {} <Debug> Application: Set max number of file descriptors to 524288 (was 1024). | ||
| 15 | 2026.08.17 23:52:05.990001 [ 423927 ] {} <Debug> Application: rlimit on number of threads is 125877 | ||
| 16 | 2026.08.17 23:52:05.990007 [ 423927 ] {} <Debug> Application: Initializing DateLUT. | ||
| 17 | 2026.08.17 23:52:05.990009 [ 423927 ] {} <Trace> Application: Initialized DateLUT with time zone 'UTC'. | ||
| 18 | 2026.08.17 23:52:05.990023 [ 423927 ] {} <Debug> Context: Setting up /var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/data/tmp/ to store temporary data in it | ||
| 19 | 2026.08.17 23:52:05.990151 [ 423927 ] {} <Debug> Application: Initializing interserver credentials. | ||
| 20 | 2026.08.17 23:52:05.990348 [ 423927 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' | ||
| 21 | 2026.08.17 23:52:05.990739 [ 423927 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration | ||
| 22 | 2026.08.17 23:52:05.991037 [ 423927 ] {} <Information> Application: Setting max_server_memory_usage was set to 27.67 GiB (30.74 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) | ||
| 23 | 2026.08.17 23:52:05.991040 [ 423927 ] {} <Information> Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.37 GiB (30.74 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) | ||
| 24 | 2026.08.17 23:52:05.991042 [ 423927 ] {} <Information> Application: Merges and mutations memory limit is set to 15.37 GiB | ||
| 25 | 2026.08.17 23:52:05.991240 [ 423927 ] {} <Information> BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads | ||
| 26 | 2026.08.17 23:52:05.991790 [ 423927 ] {} <Information> BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads | ||
| 27 | 2026.08.17 23:52:05.994204 [ 423927 ] {} <Information> BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads | ||
| 28 | 2026.08.17 23:52:05.998068 [ 423927 ] {} <Information> BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads | ||
| 29 | 2026.08.17 23:52:05.998600 [ 423927 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. | ||
| 30 | 2026.08.17 23:52:05.999218 [ 423927 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration | ||
| 31 | 2026.08.17 23:52:05.999368 [ 423927 ] {} <Information> Application: Listening for replica communication (interserver): http://[::1]:19402 | ||
| 32 | 2026.08.17 23:52:05.999546 [ 423927 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' | ||
| 33 | 2026.08.17 23:52:05.999911 [ 423927 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration | ||
| 34 | 2026.08.17 23:52:06.000427 [ 423927 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration | ||
| 35 | 2026.08.17 23:52:06.001388 [ 423927 ] {} <Debug> Access(user directories): Added users_xml access storage 'users_xml', path: /var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml | ||
| 36 | 2026.08.17 23:52:06.001735 [ 423927 ] {} <Information> Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin | ||
| 37 | 2026.08.17 23:52:06.001951 [ 423927 ] {} <Information> Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 | ||
| 38 | 2026.08.17 23:52:06.002121 [ 423927 ] {} <Information> Context: Initialized background executor for fetches with num_threads=8, num_tasks=8 | ||
| 39 | 2026.08.17 23:52:06.003622 [ 423927 ] {} <Information> Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 | ||
| 40 | 2026.08.17 23:52:06.005660 [ 423927 ] {} <Information> DNSCacheUpdater: Update period 15 seconds | ||
| 41 | 2026.08.17 23:52:06.005677 [ 423927 ] {} <Information> Application: Loading metadata from /var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/data/ | ||
| 42 | 2026.08.17 23:52:06.005987 [ 424297 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 43 | 2026.08.17 23:52:06.006180 [ 424297 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 44 | 2026.08.17 23:52:06.021896 [ 423927 ] {} <Information> DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total. | ||
| 45 | 2026.08.17 23:52:06.021908 [ 423927 ] {} <Information> TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.001790661 sec | ||
| 46 | 2026.08.17 23:52:06.021913 [ 423927 ] {} <Trace> ReferentialDeps: No tables | ||
| 47 | 2026.08.17 23:52:06.021915 [ 423927 ] {} <Trace> LoadingDeps: No tables | ||
| 48 | 2026.08.17 23:52:06.021938 [ 423927 ] {} <Information> DatabaseAtomic (system): Starting up tables. | ||
| 49 | 2026.08.17 23:52:06.021945 [ 423927 ] {} <Debug> SystemLog: Not creating system.query_log since corresponding section 'query_log' is missing from config | ||
| 50 | 2026.08.17 23:52:06.021950 [ 423927 ] {} <Debug> SystemLog: Not creating system.query_thread_log since corresponding section 'query_thread_log' is missing from config | ||
| 51 | 2026.08.17 23:52:06.021953 [ 423927 ] {} <Debug> SystemLog: Not creating system.part_log since corresponding section 'part_log' is missing from config | ||
| 52 | 2026.08.17 23:52:06.021957 [ 423927 ] {} <Debug> SystemLog: Not creating system.trace_log since corresponding section 'trace_log' is missing from config | ||
| 53 | 2026.08.17 23:52:06.021960 [ 423927 ] {} <Debug> SystemLog: Not creating system.crash_log since corresponding section 'crash_log' is missing from config | ||
| 54 | 2026.08.17 23:52:06.021966 [ 423927 ] {} <Debug> SystemLog: Not creating system.text_log since corresponding section 'text_log' is missing from config | ||
| 55 | 2026.08.17 23:52:06.021970 [ 423927 ] {} <Debug> SystemLog: Creating system.metric_log from metric_log | ||
| 56 | 2026.08.17 23:52:06.022969 [ 423927 ] {} <Debug> SystemLog: Not creating system.filesystem_cache_log since corresponding section 'filesystem_cache_log' is missing from config | ||
| 57 | 2026.08.17 23:52:06.024193 [ 423927 ] {} <Debug> SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config | ||
| 58 | 2026.08.17 23:52:06.024199 [ 423927 ] {} <Debug> SystemLog: Creating system.asynchronous_metric_log from asynchronous_metric_log | ||
| 59 | 2026.08.17 23:52:06.024275 [ 423927 ] {} <Debug> SystemLog: Creating system.opentelemetry_span_log from opentelemetry_span_log | ||
| 60 | 2026.08.17 23:52:06.024381 [ 423927 ] {} <Debug> SystemLog: Not creating system.query_views_log since corresponding section 'query_views_log' is missing from config | ||
| 61 | 2026.08.17 23:52:06.024385 [ 423927 ] {} <Debug> SystemLog: Not creating system.zookeeper_log since corresponding section 'zookeeper_log' is missing from config | ||
| 62 | 2026.08.17 23:52:06.024388 [ 423927 ] {} <Debug> SystemLog: Not creating system.session_log since corresponding section 'session_log' is missing from config | ||
| 63 | 2026.08.17 23:52:06.024391 [ 423927 ] {} <Debug> SystemLog: Not creating system.transactions_info_log since corresponding section 'transactions_info_log' is missing from config | ||
| 64 | 2026.08.17 23:52:06.024394 [ 423927 ] {} <Debug> SystemLog: Not creating system.processors_profile_log since corresponding section 'processors_profile_log' is missing from config | ||
| 65 | 2026.08.17 23:52:06.024397 [ 423927 ] {} <Debug> SystemLog: Not creating system.asynchronous_insert_log since corresponding section 'asynchronous_insert_log' is missing from config | ||
| 66 | 2026.08.17 23:52:06.030651 [ 423927 ] {} <Information> DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal. | ||
| 67 | 2026.08.17 23:52:06.037094 [ 423927 ] {} <Information> DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total. | ||
| 68 | 2026.08.17 23:52:06.037100 [ 423927 ] {} <Information> TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.001232031 sec | ||
| 69 | 2026.08.17 23:52:06.037103 [ 423927 ] {} <Trace> ReferentialDeps: No tables | ||
| 70 | 2026.08.17 23:52:06.037105 [ 423927 ] {} <Trace> LoadingDeps: No tables | ||
| 71 | 2026.08.17 23:52:06.037114 [ 423927 ] {} <Information> DatabaseAtomic (default): Starting up tables. | ||
| 72 | 2026.08.17 23:52:06.037154 [ 423927 ] {} <Information> UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/data/user_defined/ | ||
| 73 | 2026.08.17 23:52:06.037163 [ 423927 ] {} <Debug> UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded | ||
| 74 | 2026.08.17 23:52:06.037165 [ 423927 ] {} <Debug> Application: Loaded metadata. | ||
| 75 | 2026.08.17 23:52:06.037179 [ 423927 ] {} <Information> Application: Tasks stats provider: procfs | ||
| 76 | 2026.08.17 23:52:06.037181 [ 423927 ] {} <Information> Application: It looks like the process has no CAP_SYS_NICE capability, the setting 'os_thread_priority' will have no effect. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_sys_nice=+ep /work/oxidecomputer/omicron/out/clickhouse/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems. | ||
| 77 | 2026.08.17 23:52:06.037256 [ 423927 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. | ||
| 78 | 2026.08.17 23:52:06.037683 [ 423927 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 12.58 MiB, peak 13.26 MiB, free memory in arenas 16.26 MiB, will set to 380.73 MiB (RSS), difference: 368.15 MiB | ||
| 79 | 2026.08.17 23:52:06.038007 [ 423927 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 6.95e-06 sec. | ||
| 80 | 2026.08.17 23:52:06.039540 [ 423927 ] {} <Information> Application: Listening for http://[::1]:19302 | ||
| 81 | 2026.08.17 23:52:06.039539 [ 425084 ] {} <Debug> DDLWorker: Started DDLWorker cleanup thread | ||
| 82 | 2026.08.17 23:52:06.039526 [ 425085 ] {} <Debug> DDLWorker: Starting DDLWorker thread | ||
| 83 | 2026.08.17 23:52:06.039562 [ 423927 ] {} <Information> Application: Listening for native protocol (tcp): [::1]:19202 | ||
| 84 | 2026.08.17 23:52:06.039566 [ 425085 ] {} <Debug> DDLWorker: Initializing DDLWorker thread | ||
| 85 | 2026.08.17 23:52:06.039574 [ 423927 ] {} <Information> Application: Ready for connections. | ||
| 86 | 2026.08.17 23:52:06.045862 [ 425085 ] {} <Error> virtual bool DB::DDLWorker::initializeMainThread(): Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001, [::1]:19002 | ||
| 87 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 88 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 89 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19002 | ||
| 90 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 91 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 92 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19002 | ||
| 93 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 94 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 95 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19002 | ||
| 96 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 97 | |||
| 98 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 99 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 100 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 101 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 102 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 103 | 5. zkutil::ZooKeeper::ZooKeeper(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f66f9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 104 | 6. DB::Context::getZooKeeper() const @ 0x000000001166afca in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 105 | 7. DB::DDLWorker::getAndSetZooKeeper() @ 0x00000000116ec1ed in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 106 | 8. DB::DDLWorker::initializeMainThread() @ 0x00000000116fc81b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 107 | 9. DB::DDLWorker::runMainThread() @ 0x00000000116e7280 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 108 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 109 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 110 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 111 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 112 | (version 23.8.7.24 (official build)) | ||
| 113 | 2026.08.17 23:52:06.211382 [ 423965 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41596 | ||
| 114 | 2026.08.17 23:52:06.211470 [ 423965 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 115 | 2026.08.17 23:52:06.211486 [ 423965 ] {} <Debug> TCP-Session: 090535ed-245b-4ea6-b8b8-cd4edda83a15 Authenticating user 'default' from [::1]:41596 | ||
| 116 | 2026.08.17 23:52:06.211497 [ 423965 ] {} <Debug> TCP-Session: 090535ed-245b-4ea6-b8b8-cd4edda83a15 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 117 | 2026.08.17 23:52:06.211500 [ 423965 ] {} <Debug> TCP-Session: 090535ed-245b-4ea6-b8b8-cd4edda83a15 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 118 | 2026.08.17 23:52:06.211574 [ 423965 ] {} <Trace> ContextAccess (default): Settings: readonly = 0, allow_ddl = true, allow_introspection_functions = false | ||
| 119 | 2026.08.17 23:52:06.211585 [ 423965 ] {} <Trace> ContextAccess (default): List of all grants: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* | ||
| 120 | 2026.08.17 23:52:06.211588 [ 423965 ] {} <Trace> ContextAccess (default): List of all grants including implicit: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* | ||
| 121 | 2026.08.17 23:52:06.211921 [ 423966 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41598 | ||
| 122 | 2026.08.17 23:52:06.211958 [ 423967 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41600 | ||
| 123 | 2026.08.17 23:52:06.212098 [ 423967 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 124 | 2026.08.17 23:52:06.212098 [ 423966 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 125 | 2026.08.17 23:52:06.212140 [ 425231 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41604 | ||
| 126 | 2026.08.17 23:52:06.212156 [ 423967 ] {} <Debug> TCP-Session: 96093916-4a2e-42d4-9d27-a5a734b1d1da Authenticating user 'default' from [::1]:41600 | ||
| 127 | 2026.08.17 23:52:06.212158 [ 423966 ] {} <Debug> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Authenticating user 'default' from [::1]:41598 | ||
| 128 | 2026.08.17 23:52:06.212174 [ 423967 ] {} <Debug> TCP-Session: 96093916-4a2e-42d4-9d27-a5a734b1d1da Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 129 | 2026.08.17 23:52:06.212179 [ 423967 ] {} <Debug> TCP-Session: 96093916-4a2e-42d4-9d27-a5a734b1d1da Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 130 | 2026.08.17 23:52:06.212174 [ 423966 ] {} <Debug> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 131 | 2026.08.17 23:52:06.212178 [ 425230 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41602 | ||
| 132 | 2026.08.17 23:52:06.212187 [ 423966 ] {} <Debug> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 133 | 2026.08.17 23:52:06.212208 [ 425231 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 134 | 2026.08.17 23:52:06.212239 [ 425231 ] {} <Debug> TCP-Session: 3ce3e6d2-eb84-475a-8248-b7a1655e9fa3 Authenticating user 'default' from [::1]:41604 | ||
| 135 | 2026.08.17 23:52:06.212247 [ 425231 ] {} <Debug> TCP-Session: 3ce3e6d2-eb84-475a-8248-b7a1655e9fa3 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 136 | 2026.08.17 23:52:06.212249 [ 425231 ] {} <Debug> TCP-Session: 3ce3e6d2-eb84-475a-8248-b7a1655e9fa3 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 137 | 2026.08.17 23:52:06.212264 [ 425232 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41606 | ||
| 138 | 2026.08.17 23:52:06.212272 [ 425230 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 139 | 2026.08.17 23:52:06.212294 [ 425230 ] {} <Debug> TCP-Session: 5ce34993-a2a7-45fc-b73c-996557010585 Authenticating user 'default' from [::1]:41602 | ||
| 140 | 2026.08.17 23:52:06.212303 [ 425230 ] {} <Debug> TCP-Session: 5ce34993-a2a7-45fc-b73c-996557010585 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 141 | 2026.08.17 23:52:06.212305 [ 425230 ] {} <Debug> TCP-Session: 5ce34993-a2a7-45fc-b73c-996557010585 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 142 | 2026.08.17 23:52:06.212347 [ 425232 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 143 | 2026.08.17 23:52:06.212342 [ 425233 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41608 | ||
| 144 | 2026.08.17 23:52:06.212360 [ 425232 ] {} <Debug> TCP-Session: 539fb0ac-5129-41b5-ab71-a47c35d7361b Authenticating user 'default' from [::1]:41606 | ||
| 145 | 2026.08.17 23:52:06.212367 [ 425232 ] {} <Debug> TCP-Session: 539fb0ac-5129-41b5-ab71-a47c35d7361b Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 146 | 2026.08.17 23:52:06.212369 [ 425232 ] {} <Debug> TCP-Session: 539fb0ac-5129-41b5-ab71-a47c35d7361b Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 147 | 2026.08.17 23:52:06.212421 [ 425233 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 148 | 2026.08.17 23:52:06.212434 [ 425233 ] {} <Debug> TCP-Session: 8a0cd5be-941b-46c7-a52b-0823b2f5ea08 Authenticating user 'default' from [::1]:41608 | ||
| 149 | 2026.08.17 23:52:06.212440 [ 425233 ] {} <Debug> TCP-Session: 8a0cd5be-941b-46c7-a52b-0823b2f5ea08 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 150 | 2026.08.17 23:52:06.212442 [ 425233 ] {} <Debug> TCP-Session: 8a0cd5be-941b-46c7-a52b-0823b2f5ea08 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 151 | 2026.08.17 23:52:06.212449 [ 425235 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41612 | ||
| 152 | 2026.08.17 23:52:06.212480 [ 425234 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41610 | ||
| 153 | 2026.08.17 23:52:06.212517 [ 425235 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 154 | 2026.08.17 23:52:06.212530 [ 425235 ] {} <Debug> TCP-Session: 048a2ffe-8b3b-4e2b-876e-25dc0a70b22e Authenticating user 'default' from [::1]:41612 | ||
| 155 | 2026.08.17 23:52:06.212533 [ 425235 ] {} <Debug> TCP-Session: 048a2ffe-8b3b-4e2b-876e-25dc0a70b22e Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 156 | 2026.08.17 23:52:06.212535 [ 425235 ] {} <Debug> TCP-Session: 048a2ffe-8b3b-4e2b-876e-25dc0a70b22e Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 157 | 2026.08.17 23:52:06.212565 [ 425234 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 158 | 2026.08.17 23:52:06.212578 [ 425234 ] {} <Debug> TCP-Session: ccc75a31-f415-488c-8e17-66e501fe6f45 Authenticating user 'default' from [::1]:41610 | ||
| 159 | 2026.08.17 23:52:06.212584 [ 425234 ] {} <Debug> TCP-Session: ccc75a31-f415-488c-8e17-66e501fe6f45 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 160 | 2026.08.17 23:52:06.212586 [ 425234 ] {} <Debug> TCP-Session: ccc75a31-f415-488c-8e17-66e501fe6f45 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 161 | 2026.08.17 23:52:06.213049 [ 423965 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 162 | 2026.08.17 23:52:06.213888 [ 423965 ] {} <Debug> TCP-Session: 090535ed-245b-4ea6-b8b8-cd4edda83a15 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 163 | 2026.08.17 23:52:07.000390 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 380.81 MiB, peak 382.83 MiB, free memory in arenas 18.50 MiB, will set to 384.24 MiB (RSS), difference: 3.43 MiB | ||
| 164 | 2026.08.17 23:52:11.049472 [ 425085 ] {} <Information> ZooKeeperClient: Connected to ZooKeeper at [::1]:19003 with session_id 5 | ||
| 165 | 2026.08.17 23:52:11.049706 [ 425085 ] {} <Information> ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled | ||
| 166 | 2026.08.17 23:52:11.049709 [ 425085 ] {} <Information> ZooKeeperClient: Keeper feature flag MULTI_READ: enabled | ||
| 167 | 2026.08.17 23:52:11.049711 [ 425085 ] {} <Information> ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled | ||
| 168 | 2026.08.17 23:52:11.049715 [ 425085 ] {} <Trace> ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003 | ||
| 169 | 2026.08.17 23:52:11.055662 [ 425085 ] {} <Debug> DDLWorker: Initialized DDLWorker thread | ||
| 170 | 2026.08.17 23:52:11.055668 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 171 | 2026.08.17 23:52:11.055671 [ 425085 ] {} <Trace> DDLWorker: Don't have unfinished tasks after restarting | ||
| 172 | 2026.08.17 23:52:11.055675 [ 425084 ] {} <Debug> DDLWorker: Cleaning queue | ||
| 173 | 2026.08.17 23:52:11.055767 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=1, queue_size=1, entries=query-0000000000..query-0000000000, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none | ||
| 174 | 2026.08.17 23:52:11.055771 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000000 | ||
| 175 | 2026.08.17 23:52:11.055774 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000000 | ||
| 176 | 2026.08.17 23:52:11.056051 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000000 (CREATE DATABASE IF NOT EXISTS oximeter UUID 'c0a94260-6234-449c-8c74-f5c4edf4ee5c') | ||
| 177 | 2026.08.17 23:52:11.062734 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID 'c0a94260-6234-449c-8c74-f5c4edf4ee5c' | ||
| 178 | 2026.08.17 23:52:11.062817 [ 425085 ] {b5a10a29-5bf3-411f-b5b2-fbff384b18f3} <Trace> executeQuery: Query span trace_id for opentelemetry log: 72382db7-1ff4-3af4-9280-ff69ce065edc | ||
| 179 | 2026.08.17 23:52:11.062857 [ 425085 ] {b5a10a29-5bf3-411f-b5b2-fbff384b18f3} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: a280c8a5-755d-479b-8666-3ff95c6b5df2) /* ddl_entry=query-0000000000 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'c0a94260-6234-449c-8c74-f5c4edf4ee5c' (stage: Complete) | ||
| 180 | 2026.08.17 23:52:11.068789 [ 425085 ] {b5a10a29-5bf3-411f-b5b2-fbff384b18f3} <Information> DatabaseAtomic (oximeter): Metadata processed, database oximeter has 0 tables and 0 dictionaries in total. | ||
| 181 | 2026.08.17 23:52:11.068797 [ 425085 ] {b5a10a29-5bf3-411f-b5b2-fbff384b18f3} <Information> TablesLoader: Parsed metadata of 0 tables in 1 databases in 3.139e-05 sec | ||
| 182 | 2026.08.17 23:52:11.068800 [ 425085 ] {b5a10a29-5bf3-411f-b5b2-fbff384b18f3} <Trace> ReferentialDeps: No tables | ||
| 183 | 2026.08.17 23:52:11.068803 [ 425085 ] {b5a10a29-5bf3-411f-b5b2-fbff384b18f3} <Trace> LoadingDeps: No tables | ||
| 184 | 2026.08.17 23:52:11.068815 [ 425085 ] {b5a10a29-5bf3-411f-b5b2-fbff384b18f3} <Information> DatabaseAtomic (oximeter): Starting up tables. | ||
| 185 | 2026.08.17 23:52:11.068872 [ 425085 ] {b5a10a29-5bf3-411f-b5b2-fbff384b18f3} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000000 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'c0a94260-6234-449c-8c74-f5c4edf4ee5c' | ||
| 186 | 2026.08.17 23:52:11.075959 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 187 | 2026.08.17 23:52:11.677927 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 188 | 2026.08.17 23:52:11.677929 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 189 | 2026.08.17 23:52:11.678027 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=2, queue_size=2, entries=query-0000000000..query-0000000001, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000000, last_skipped_entry_name=none | ||
| 190 | 2026.08.17 23:52:11.678032 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000001 | ||
| 191 | 2026.08.17 23:52:11.678035 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000001 | ||
| 192 | 2026.08.17 23:52:11.678317 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000001 (CREATE TABLE IF NOT EXISTS oximeter.version UUID '157c979f-eec8-4d9d-8340-ef2e89475af4' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)) | ||
| 193 | 2026.08.17 23:52:11.692026 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID '157c979f-eec8-4d9d-8340-ef2e89475af4' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) | ||
| 194 | 2026.08.17 23:52:11.692092 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Trace> executeQuery: Query span trace_id for opentelemetry log: 204ea5ef-62f4-db6b-c243-a5166fd03c0c | ||
| 195 | 2026.08.17 23:52:11.692196 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c15a2d35-8b50-4b64-aa19-7f271e0a411f) /* ddl_entry=query-0000000001 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '157c979f-eec8-4d9d-8340-ef2e89475af4' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) | ||
| 196 | 2026.08.17 23:52:11.692749 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1 | ||
| 197 | 2026.08.17 23:52:11.697202 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Debug> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Loading data parts | ||
| 198 | 2026.08.17 23:52:11.698995 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Debug> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): There are no data parts | ||
| 199 | 2026.08.17 23:52:11.722454 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Debug> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Creating table /clickhouse/tables/1/version | ||
| 200 | 2026.08.17 23:52:11.767522 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Debug> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Creating shared ID for table oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4) | ||
| 201 | 2026.08.17 23:52:11.767554 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Debug> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Shared ID for table oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4) doesn't exist in ZooKeeper on path /clickhouse/tables/1/version/table_shared_id | ||
| 202 | 2026.08.17 23:52:11.767557 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Debug> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Got candidate ID 157c979f-eec8-4d9d-8340-ef2e89475af4, will try to create it in ZooKeeper on path /clickhouse/tables/1/version/table_shared_id | ||
| 203 | 2026.08.17 23:52:11.778479 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Debug> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Initializing table shared ID with 157c979f-eec8-4d9d-8340-ef2e89475af4 | ||
| 204 | 2026.08.17 23:52:11.786786 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Starting up table | ||
| 205 | 2026.08.17 23:52:11.802772 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Information> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): LeaderElection: leader suddenly changed or new node appeared, will retry | ||
| 206 | 2026.08.17 23:52:11.802854 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Information> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Became leader | ||
| 207 | 2026.08.17 23:52:11.802859 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Trace> oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 208 | 2026.08.17 23:52:11.802893 [ 424317 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Activating replica. | ||
| 209 | 2026.08.17 23:52:11.802904 [ 424317 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 210 | 2026.08.17 23:52:11.812554 [ 424317 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 211 | 2026.08.17 23:52:11.812589 [ 424317 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Queue initialized | ||
| 212 | 2026.08.17 23:52:11.812592 [ 424317 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue | ||
| 213 | 2026.08.17 23:52:11.812661 [ 424317 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 214 | 2026.08.17 23:52:11.812691 [ 424317 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Loaded queue | ||
| 215 | 2026.08.17 23:52:11.818952 [ 424317 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 216 | 2026.08.17 23:52:11.819040 [ 424366 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 6222ms | ||
| 217 | 2026.08.17 23:52:11.819080 [ 425085 ] {a54e2644-4055-4b06-97fa-170be17b7641} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000001 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '157c979f-eec8-4d9d-8340-ef2e89475af4' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) | ||
| 218 | 2026.08.17 23:52:11.830376 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 219 | 2026.08.17 23:52:11.967685 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 220 | 2026.08.17 23:52:11.967691 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 221 | 2026.08.17 23:52:11.967767 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=3, queue_size=3, entries=query-0000000000..query-0000000002, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000001, last_skipped_entry_name=none | ||
| 222 | 2026.08.17 23:52:11.967771 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000002 | ||
| 223 | 2026.08.17 23:52:11.967774 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000002 | ||
| 224 | 2026.08.17 23:52:11.968090 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000002 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '24dea9d7-064d-49c2-9599-9587402bf78f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) | ||
| 225 | 2026.08.17 23:52:11.999807 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '24dea9d7-064d-49c2-9599-9587402bf78f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) | ||
| 226 | 2026.08.17 23:52:11.999874 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Trace> executeQuery: Query span trace_id for opentelemetry log: 8180f263-a2c5-6d72-6d5e-e874f0144e75 | ||
| 227 | 2026.08.17 23:52:12.000020 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5a817b06-0a26-4618-b28b-2d3e91b76496) /* ddl_entry=query-0000000002 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '24dea9d7-064d-49c2-9599-9587402bf78f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) | ||
| 228 | 2026.08.17 23:52:12.006827 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Loading data parts | ||
| 229 | 2026.08.17 23:52:12.008267 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): There are no data parts | ||
| 230 | 2026.08.17 23:52:12.022848 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): This table /clickhouse/tables/1/measurements_cumulativef64_local is already created, will add new replica | ||
| 231 | 2026.08.17 23:52:12.023421 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Creating replica /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2 | ||
| 232 | 2026.08.17 23:52:12.114140 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Creating shared ID for table oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) | ||
| 233 | 2026.08.17 23:52:12.114228 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Initializing table shared ID with 24dea9d7-064d-49c2-9599-9587402bf78f | ||
| 234 | 2026.08.17 23:52:12.117724 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Starting up table | ||
| 235 | 2026.08.17 23:52:12.117807 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Information> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Became leader | ||
| 236 | 2026.08.17 23:52:12.117817 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 237 | 2026.08.17 23:52:12.117863 [ 424398 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Activating replica. | ||
| 238 | 2026.08.17 23:52:12.117895 [ 424398 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 239 | 2026.08.17 23:52:12.127463 [ 424398 ] {} <Information> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Replica 1 has log pointer '0', approximate 1 queue lag and 0 queue size | ||
| 240 | 2026.08.17 23:52:12.127480 [ 424398 ] {} <Information> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Will mimic 1 | ||
| 241 | 2026.08.17 23:52:12.132392 [ 424398 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Queued 0 parts to be fetched, 0 parts ignored | ||
| 242 | 2026.08.17 23:52:12.132399 [ 424398 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Copied 0 queue entries, 0 entries ignored | ||
| 243 | 2026.08.17 23:52:12.132437 [ 424398 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Parts in ZooKeeper after mimic: | ||
| 244 | 2026.08.17 23:52:12.132439 [ 424398 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Enqueued fetches after mimic: | ||
| 245 | 2026.08.17 23:52:12.136606 [ 424398 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 246 | 2026.08.17 23:52:12.136650 [ 424398 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 247 | 2026.08.17 23:52:12.136655 [ 424398 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue | ||
| 248 | 2026.08.17 23:52:12.136679 [ 424398 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 249 | 2026.08.17 23:52:12.136707 [ 424398 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 250 | 2026.08.17 23:52:12.136930 [ 424398 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 251 | 2026.08.17 23:52:12.137035 [ 424314 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 6468ms | ||
| 252 | 2026.08.17 23:52:12.137112 [ 425085 ] {ecef796c-33dd-4415-b29e-728330ee230e} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000002 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '24dea9d7-064d-49c2-9599-9587402bf78f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) | ||
| 253 | 2026.08.17 23:52:12.141100 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 254 | 2026.08.17 23:52:12.248905 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 255 | 2026.08.17 23:52:12.248908 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 256 | 2026.08.17 23:52:12.248995 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=4, queue_size=4, entries=query-0000000000..query-0000000003, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000002, last_skipped_entry_name=none | ||
| 257 | 2026.08.17 23:52:12.248999 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000003 | ||
| 258 | 2026.08.17 23:52:12.249001 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000003 | ||
| 259 | 2026.08.17 23:52:12.249331 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000003 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '26440754-ec6a-43fc-b101-925af35ef3c9' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 260 | 2026.08.17 23:52:12.261311 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '26440754-ec6a-43fc-b101-925af35ef3c9' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 261 | 2026.08.17 23:52:12.261366 [ 425085 ] {5d735629-12ed-4c07-8bed-8373e4ebc540} <Trace> executeQuery: Query span trace_id for opentelemetry log: 3cfe1541-76c2-719b-bb47-1d1a651a6671 | ||
| 262 | 2026.08.17 23:52:12.261448 [ 425085 ] {5d735629-12ed-4c07-8bed-8373e4ebc540} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4f14b02b-fd28-4a32-a989-a07041e49557) /* ddl_entry=query-0000000003 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '26440754-ec6a-43fc-b101-925af35ef3c9' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 263 | 2026.08.17 23:52:12.262372 [ 425085 ] {5d735629-12ed-4c07-8bed-8373e4ebc540} <Debug> StorageDistributed (measurements_cumulativef64): Auto-increment is 0 | ||
| 264 | 2026.08.17 23:52:12.269421 [ 425085 ] {5d735629-12ed-4c07-8bed-8373e4ebc540} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000003 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '26440754-ec6a-43fc-b101-925af35ef3c9' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 265 | 2026.08.17 23:52:12.273097 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 266 | 2026.08.17 23:52:12.363923 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 267 | 2026.08.17 23:52:12.363927 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 268 | 2026.08.17 23:52:12.364032 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=5, queue_size=5, entries=query-0000000000..query-0000000004, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000003, last_skipped_entry_name=none | ||
| 269 | 2026.08.17 23:52:12.364037 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000004 | ||
| 270 | 2026.08.17 23:52:12.364039 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000004 | ||
| 271 | 2026.08.17 23:52:12.364328 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000004 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '2d79911c-8882-4309-a914-7e64c31972ae' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) | ||
| 272 | 2026.08.17 23:52:12.375876 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '2d79911c-8882-4309-a914-7e64c31972ae' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 273 | 2026.08.17 23:52:12.375927 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Trace> executeQuery: Query span trace_id for opentelemetry log: 33b4e22f-025a-a14b-ce4f-153b2a2ab065 | ||
| 274 | 2026.08.17 23:52:12.376020 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5068d503-88f2-4b81-a6ab-4061a167a7ff) /* ddl_entry=query-0000000004 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '2d79911c-8882-4309-a914-7e64c31972ae' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) | ||
| 275 | 2026.08.17 23:52:12.380414 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Loading data parts | ||
| 276 | 2026.08.17 23:52:12.380530 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): There are no data parts | ||
| 277 | 2026.08.17 23:52:12.389371 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Creating table /clickhouse/tables/1/fields_i64_local | ||
| 278 | 2026.08.17 23:52:12.402878 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Information> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): It looks like the table /clickhouse/tables/1/fields_i64_local was created by another server at the same moment, will retry | ||
| 279 | 2026.08.17 23:52:12.402950 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): This table /clickhouse/tables/1/fields_i64_local is already created, will add new replica | ||
| 280 | 2026.08.17 23:52:12.403385 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Creating replica /clickhouse/tables/1/fields_i64_local/replicas/2 | ||
| 281 | 2026.08.17 23:52:12.437681 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Creating shared ID for table oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) | ||
| 282 | 2026.08.17 23:52:12.437714 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Initializing table shared ID with 2d79911c-8882-4309-a914-7e64c31972ae | ||
| 283 | 2026.08.17 23:52:12.444773 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Starting up table | ||
| 284 | 2026.08.17 23:52:12.444869 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Information> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Became leader | ||
| 285 | 2026.08.17 23:52:12.444873 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 286 | 2026.08.17 23:52:12.444905 [ 424337 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Activating replica. | ||
| 287 | 2026.08.17 23:52:12.444921 [ 424337 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 288 | 2026.08.17 23:52:12.450817 [ 424337 ] {} <Information> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Replica 1 has log pointer '', approximate 1 queue lag and 0 queue size | ||
| 289 | 2026.08.17 23:52:12.450823 [ 424337 ] {} <Information> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Will mimic 1 | ||
| 290 | 2026.08.17 23:52:12.459317 [ 424337 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Queued 0 parts to be fetched, 0 parts ignored | ||
| 291 | 2026.08.17 23:52:12.459323 [ 424337 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Copied 0 queue entries, 0 entries ignored | ||
| 292 | 2026.08.17 23:52:12.459353 [ 424337 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Parts in ZooKeeper after mimic: | ||
| 293 | 2026.08.17 23:52:12.459357 [ 424337 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Enqueued fetches after mimic: | ||
| 294 | 2026.08.17 23:52:12.463297 [ 424337 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 295 | 2026.08.17 23:52:12.463345 [ 424337 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 296 | 2026.08.17 23:52:12.463349 [ 424337 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue | ||
| 297 | 2026.08.17 23:52:12.463375 [ 424337 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 298 | 2026.08.17 23:52:12.463405 [ 424337 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 299 | 2026.08.17 23:52:12.463608 [ 424337 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 300 | 2026.08.17 23:52:12.463690 [ 424406 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 6339ms | ||
| 301 | 2026.08.17 23:52:12.463747 [ 425085 ] {723347e7-8752-4dd0-905a-b2db7c5ba62f} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000004 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '2d79911c-8882-4309-a914-7e64c31972ae' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 302 | 2026.08.17 23:52:12.472906 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 303 | 2026.08.17 23:52:12.529103 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 304 | 2026.08.17 23:52:12.529121 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 305 | 2026.08.17 23:52:12.529200 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=6, queue_size=6, entries=query-0000000000..query-0000000005, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000004, last_skipped_entry_name=none | ||
| 306 | 2026.08.17 23:52:12.529204 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000005 | ||
| 307 | 2026.08.17 23:52:12.529212 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000005 | ||
| 308 | 2026.08.17 23:52:12.529499 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000005 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '043624db-6f37-4b68-9c98-02ab5ccfc042' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 309 | 2026.08.17 23:52:12.541329 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '043624db-6f37-4b68-9c98-02ab5ccfc042' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 310 | 2026.08.17 23:52:12.541383 [ 425085 ] {ad6cfdc8-16c5-4c81-8f0a-dad9c76b91ee} <Trace> executeQuery: Query span trace_id for opentelemetry log: 282fbfc0-8e7d-73c6-e01c-fa5e0ad2a972 | ||
| 311 | 2026.08.17 23:52:12.541462 [ 425085 ] {ad6cfdc8-16c5-4c81-8f0a-dad9c76b91ee} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 092bb05c-359b-4ef3-8538-bc83d2646b53) /* ddl_entry=query-0000000005 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '043624db-6f37-4b68-9c98-02ab5ccfc042' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 312 | 2026.08.17 23:52:12.541889 [ 425085 ] {ad6cfdc8-16c5-4c81-8f0a-dad9c76b91ee} <Debug> StorageDistributed (fields_i64): Auto-increment is 0 | ||
| 313 | 2026.08.17 23:52:12.546526 [ 425085 ] {ad6cfdc8-16c5-4c81-8f0a-dad9c76b91ee} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000005 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '043624db-6f37-4b68-9c98-02ab5ccfc042' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 314 | 2026.08.17 23:52:12.550124 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 315 | 2026.08.17 23:52:12.662506 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 316 | 2026.08.17 23:52:12.662508 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 317 | 2026.08.17 23:52:12.662583 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=7, queue_size=7, entries=query-0000000000..query-0000000006, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000005, last_skipped_entry_name=none | ||
| 318 | 2026.08.17 23:52:12.662587 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000006 | ||
| 319 | 2026.08.17 23:52:12.662589 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000006 | ||
| 320 | 2026.08.17 23:52:12.662838 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000006 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'eaa5beef-895d-41af-915b-bd6fb56613c4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) | ||
| 321 | 2026.08.17 23:52:12.675208 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'eaa5beef-895d-41af-915b-bd6fb56613c4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 322 | 2026.08.17 23:52:12.675254 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Trace> executeQuery: Query span trace_id for opentelemetry log: 379250d6-bc2d-effb-5fec-0dcccec218d1 | ||
| 323 | 2026.08.17 23:52:12.675334 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: afbd441a-763b-4867-8336-bb878b20433c) /* ddl_entry=query-0000000006 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'eaa5beef-895d-41af-915b-bd6fb56613c4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) | ||
| 324 | 2026.08.17 23:52:12.679956 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Loading data parts | ||
| 325 | 2026.08.17 23:52:12.680169 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): There are no data parts | ||
| 326 | 2026.08.17 23:52:12.692983 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Creating table /clickhouse/tables/1/fields_uuid_local | ||
| 327 | 2026.08.17 23:52:12.707956 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Information> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): It looks like the table /clickhouse/tables/1/fields_uuid_local was created by another server at the same moment, will retry | ||
| 328 | 2026.08.17 23:52:12.708087 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): This table /clickhouse/tables/1/fields_uuid_local is already created, will add new replica | ||
| 329 | 2026.08.17 23:52:12.708651 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Creating replica /clickhouse/tables/1/fields_uuid_local/replicas/2 | ||
| 330 | 2026.08.17 23:52:12.751737 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Creating shared ID for table oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) | ||
| 331 | 2026.08.17 23:52:12.751790 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Initializing table shared ID with eaa5beef-895d-41af-915b-bd6fb56613c4 | ||
| 332 | 2026.08.17 23:52:12.757254 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Starting up table | ||
| 333 | 2026.08.17 23:52:12.757312 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Information> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Became leader | ||
| 334 | 2026.08.17 23:52:12.757315 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 335 | 2026.08.17 23:52:12.757338 [ 424371 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Activating replica. | ||
| 336 | 2026.08.17 23:52:12.757351 [ 424371 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 337 | 2026.08.17 23:52:12.764857 [ 424371 ] {} <Information> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Replica 1 has log pointer '0', approximate 1 queue lag and 0 queue size | ||
| 338 | 2026.08.17 23:52:12.764864 [ 424371 ] {} <Information> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Will mimic 1 | ||
| 339 | 2026.08.17 23:52:12.770230 [ 424371 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Queued 0 parts to be fetched, 0 parts ignored | ||
| 340 | 2026.08.17 23:52:12.770239 [ 424371 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Copied 0 queue entries, 0 entries ignored | ||
| 341 | 2026.08.17 23:52:12.770274 [ 424371 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Parts in ZooKeeper after mimic: | ||
| 342 | 2026.08.17 23:52:12.770277 [ 424371 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Enqueued fetches after mimic: | ||
| 343 | 2026.08.17 23:52:12.775071 [ 424371 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 344 | 2026.08.17 23:52:12.775127 [ 424371 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 345 | 2026.08.17 23:52:12.775148 [ 424371 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue | ||
| 346 | 2026.08.17 23:52:12.775181 [ 424371 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 347 | 2026.08.17 23:52:12.775210 [ 424371 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 348 | 2026.08.17 23:52:12.775438 [ 424371 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 349 | 2026.08.17 23:52:12.775511 [ 424346 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 6547ms | ||
| 350 | 2026.08.17 23:52:12.775556 [ 425085 ] {692ac47c-c95d-4d30-8309-c3ca527c669b} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000006 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'eaa5beef-895d-41af-915b-bd6fb56613c4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 351 | 2026.08.17 23:52:12.779372 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 352 | 2026.08.17 23:52:12.826470 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 353 | 2026.08.17 23:52:12.826474 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 354 | 2026.08.17 23:52:12.828121 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=8, queue_size=8, entries=query-0000000000..query-0000000007, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000006, last_skipped_entry_name=none | ||
| 355 | 2026.08.17 23:52:12.828125 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000007 | ||
| 356 | 2026.08.17 23:52:12.828128 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000007 | ||
| 357 | 2026.08.17 23:52:12.828352 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000007 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '9aa0f265-14c6-42dd-8a43-e4bc546a6053' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 358 | 2026.08.17 23:52:12.838005 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '9aa0f265-14c6-42dd-8a43-e4bc546a6053' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 359 | 2026.08.17 23:52:12.838057 [ 425085 ] {15916442-ed02-4c2f-ba64-ca26a65347c8} <Trace> executeQuery: Query span trace_id for opentelemetry log: ea78707a-6c67-f803-b167-bd71d8be8186 | ||
| 360 | 2026.08.17 23:52:12.838129 [ 425085 ] {15916442-ed02-4c2f-ba64-ca26a65347c8} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 23661bc2-14a7-494a-94cb-d7e9d83f0678) /* ddl_entry=query-0000000007 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '9aa0f265-14c6-42dd-8a43-e4bc546a6053' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 361 | 2026.08.17 23:52:12.838555 [ 425085 ] {15916442-ed02-4c2f-ba64-ca26a65347c8} <Debug> StorageDistributed (fields_uuid): Auto-increment is 0 | ||
| 362 | 2026.08.17 23:52:12.843592 [ 425085 ] {15916442-ed02-4c2f-ba64-ca26a65347c8} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000007 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '9aa0f265-14c6-42dd-8a43-e4bc546a6053' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 363 | 2026.08.17 23:52:12.851733 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 364 | 2026.08.17 23:52:12.939409 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 365 | 2026.08.17 23:52:12.939412 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 366 | 2026.08.17 23:52:12.939487 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=9, queue_size=9, entries=query-0000000000..query-0000000008, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000007, last_skipped_entry_name=none | ||
| 367 | 2026.08.17 23:52:12.939491 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000008 | ||
| 368 | 2026.08.17 23:52:12.939494 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000008 | ||
| 369 | 2026.08.17 23:52:12.939873 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000008 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '05a0062d-b532-435a-91d7-b9da99374f1d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)) | ||
| 370 | 2026.08.17 23:52:12.949593 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '05a0062d-b532-435a-91d7-b9da99374f1d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) | ||
| 371 | 2026.08.17 23:52:12.949648 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Trace> executeQuery: Query span trace_id for opentelemetry log: e81593ca-7d25-7828-5db4-551f33b77ef3 | ||
| 372 | 2026.08.17 23:52:12.949764 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8842ae81-e109-4c7a-8418-94395b79df83) /* ddl_entry=query-0000000008 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '05a0062d-b532-435a-91d7-b9da99374f1d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) | ||
| 373 | 2026.08.17 23:52:12.953848 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Loading data parts | ||
| 374 | 2026.08.17 23:52:12.953962 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): There are no data parts | ||
| 375 | 2026.08.17 23:52:12.958312 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Creating table /clickhouse/tables/1/timeseries_schema_local | ||
| 376 | 2026.08.17 23:52:12.998687 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Creating shared ID for table oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) | ||
| 377 | 2026.08.17 23:52:12.998716 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Shared ID for table oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) doesn't exist in ZooKeeper on path /clickhouse/tables/1/timeseries_schema_local/table_shared_id | ||
| 378 | 2026.08.17 23:52:12.998719 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Got candidate ID 05a0062d-b532-435a-91d7-b9da99374f1d, will try to create it in ZooKeeper on path /clickhouse/tables/1/timeseries_schema_local/table_shared_id | ||
| 379 | 2026.08.17 23:52:13.007366 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Initializing table shared ID with 05a0062d-b532-435a-91d7-b9da99374f1d | ||
| 380 | 2026.08.17 23:52:13.012887 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Starting up table | ||
| 381 | 2026.08.17 23:52:13.017452 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Information> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Became leader | ||
| 382 | 2026.08.17 23:52:13.017459 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 383 | 2026.08.17 23:52:13.017497 [ 424380 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Activating replica. | ||
| 384 | 2026.08.17 23:52:13.017516 [ 424380 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 385 | 2026.08.17 23:52:13.025179 [ 424380 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 386 | 2026.08.17 23:52:13.025205 [ 424380 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 387 | 2026.08.17 23:52:13.025210 [ 424380 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue | ||
| 388 | 2026.08.17 23:52:13.025244 [ 424380 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 389 | 2026.08.17 23:52:13.025270 [ 424380 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 390 | 2026.08.17 23:52:13.034173 [ 424380 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 391 | 2026.08.17 23:52:13.034275 [ 424418 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 6544ms | ||
| 392 | 2026.08.17 23:52:13.034343 [ 425085 ] {4fc6a464-88cc-4576-a6c0-6be15e194668} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000008 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '05a0062d-b532-435a-91d7-b9da99374f1d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) | ||
| 393 | 2026.08.17 23:52:13.046813 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 394 | 2026.08.17 23:52:13.108160 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 395 | 2026.08.17 23:52:13.108164 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 396 | 2026.08.17 23:52:13.108288 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=10, queue_size=10, entries=query-0000000000..query-0000000009, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000008, last_skipped_entry_name=none | ||
| 397 | 2026.08.17 23:52:13.108293 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000009 | ||
| 398 | 2026.08.17 23:52:13.108296 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000009 | ||
| 399 | 2026.08.17 23:52:13.108655 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000009 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'e7ae042c-f627-4acc-8fc7-b9453761784f' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 400 | 2026.08.17 23:52:13.119442 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'e7ae042c-f627-4acc-8fc7-b9453761784f' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 401 | 2026.08.17 23:52:13.119508 [ 425085 ] {d7653dbe-a2b0-434d-869c-79ce26dc7682} <Trace> executeQuery: Query span trace_id for opentelemetry log: 4f2d7010-71a7-d310-28c8-535cafa3c1c9 | ||
| 402 | 2026.08.17 23:52:13.119644 [ 425085 ] {d7653dbe-a2b0-434d-869c-79ce26dc7682} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ba34d095-e353-42cb-bfc7-790d09f3d772) /* ddl_entry=query-0000000009 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'e7ae042c-f627-4acc-8fc7-b9453761784f' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 403 | 2026.08.17 23:52:13.120111 [ 425085 ] {d7653dbe-a2b0-434d-869c-79ce26dc7682} <Debug> StorageDistributed (timeseries_schema): Auto-increment is 0 | ||
| 404 | 2026.08.17 23:52:13.126479 [ 425085 ] {d7653dbe-a2b0-434d-869c-79ce26dc7682} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000009 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'e7ae042c-f627-4acc-8fc7-b9453761784f' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 405 | 2026.08.17 23:52:13.136156 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 406 | 2026.08.17 23:52:13.216480 [ 423966 ] {} <Trace> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 407 | 2026.08.17 23:52:13.216580 [ 423966 ] {3d91567c-f24a-4b60-bea3-921c530c8000} <Trace> executeQuery: Query span trace_id for opentelemetry log: 4056e1e1-67cc-3fba-76f8-e66e2c93d06d | ||
| 408 | 2026.08.17 23:52:13.216631 [ 423966 ] {3d91567c-f24a-4b60-bea3-921c530c8000} <Debug> executeQuery: (from [::1]:41598) SELECT name FROM system.tables WHERE database = 'oximeter' AND engine = 'ReplicatedMergeTree' (stage: Complete) | ||
| 409 | 2026.08.17 23:52:13.216845 [ 423966 ] {3d91567c-f24a-4b60-bea3-921c530c8000} <Trace> ContextAccess (default): Access granted: SELECT(database, name, engine) ON system.tables | ||
| 410 | 2026.08.17 23:52:13.216949 [ 423966 ] {3d91567c-f24a-4b60-bea3-921c530c8000} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 411 | 2026.08.17 23:52:13.217135 [ 429500 ] {3d91567c-f24a-4b60-bea3-921c530c8000} <Trace> ContextAccess (default): Access granted: SHOW TABLES ON *.* | ||
| 412 | 2026.08.17 23:52:13.217281 [ 423966 ] {3d91567c-f24a-4b60-bea3-921c530c8000} <Debug> executeQuery: Read 9 rows, 631.00 B in 0.000691 sec., 13024.602026049204 rows/sec., 891.77 KiB/sec. | ||
| 413 | 2026.08.17 23:52:13.217300 [ 423966 ] {3d91567c-f24a-4b60-bea3-921c530c8000} <Debug> TCPHandler: Processed in 0.000897521 sec. | ||
| 414 | 2026.08.17 23:52:13.262865 [ 424310 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 | ||
| 415 | 2026.08.17 23:52:13.271441 [ 424310 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] | ||
| 416 | 2026.08.17 23:52:13.271460 [ 424310 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 417 | 2026.08.17 23:52:13.271781 [ 424488 ] {} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Fetching part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/1 | ||
| 418 | 2026.08.17 23:52:13.271893 [ 424488 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ftimeseries_schema_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false | ||
| 419 | 2026.08.17 23:52:13.271949 [ 424488 ] {} <Trace> HTTPSessionAdapter: Created HTTP(S) session with ::1:19401 (::1:19401) | ||
| 420 | 2026.08.17 23:52:13.273123 [ 424488 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 421 | 2026.08.17 23:52:13.273141 [ 424488 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.96 GiB. | ||
| 422 | 2026.08.17 23:52:13.273148 [ 424488 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 423 | 2026.08.17 23:52:13.273156 [ 424488 ] {} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (Fetcher): Downloading part all_0_0_0 onto disk default. | ||
| 424 | 2026.08.17 23:52:13.273759 [ 424488 ] {} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (Fetcher): Download of part all_0_0_0 onto disk default finished. | ||
| 425 | 2026.08.17 23:52:13.275291 [ 424488 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 426 | 2026.08.17 23:52:13.275339 [ 424488 ] {} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Committing part all_0_0_0 to zookeeper | ||
| 427 | 2026.08.17 23:52:13.282795 [ 424488 ] {} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Part all_0_0_0 committed to zookeeper | ||
| 428 | 2026.08.17 23:52:13.282820 [ 424488 ] {} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Fetched part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/1 | ||
| 429 | 2026.08.17 23:52:13.282879 [ 424417 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=72991254528, merge_with_ttl_allowedtrue) | ||
| 430 | 2026.08.17 23:52:13.282898 [ 424417 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 7990ms | ||
| 431 | 2026.08.17 23:52:13.300563 [ 424331 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 | ||
| 432 | 2026.08.17 23:52:13.312551 [ 424331 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] | ||
| 433 | 2026.08.17 23:52:13.312559 [ 424331 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 434 | 2026.08.17 23:52:13.312817 [ 424471 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1 | ||
| 435 | 2026.08.17 23:52:13.312959 [ 424471 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false | ||
| 436 | 2026.08.17 23:52:13.313264 [ 424471 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 437 | 2026.08.17 23:52:13.313274 [ 424471 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.96 GiB. | ||
| 438 | 2026.08.17 23:52:13.313278 [ 424471 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 439 | 2026.08.17 23:52:13.313286 [ 424471 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Downloading part all_0_0_0 onto disk default. | ||
| 440 | 2026.08.17 23:52:13.313704 [ 424471 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Download of part all_0_0_0 onto disk default finished. | ||
| 441 | 2026.08.17 23:52:13.313715 [ 424471 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 442 | 2026.08.17 23:52:13.313736 [ 424471 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Committing part all_0_0_0 to zookeeper | ||
| 443 | 2026.08.17 23:52:13.329654 [ 424471 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Part all_0_0_0 committed to zookeeper | ||
| 444 | 2026.08.17 23:52:13.329683 [ 424471 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1 | ||
| 445 | 2026.08.17 23:52:13.329736 [ 424353 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=72990869504, merge_with_ttl_allowedtrue) | ||
| 446 | 2026.08.17 23:52:13.329751 [ 424353 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 7904ms | ||
| 447 | 2026.08.17 23:52:13.335766 [ 424402 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 | ||
| 448 | 2026.08.17 23:52:13.350921 [ 424402 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] | ||
| 449 | 2026.08.17 23:52:13.350935 [ 424402 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 450 | 2026.08.17 23:52:13.351246 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1 | ||
| 451 | 2026.08.17 23:52:13.351324 [ 424487 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false | ||
| 452 | 2026.08.17 23:52:13.351622 [ 424487 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 453 | 2026.08.17 23:52:13.351635 [ 424487 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.96 GiB. | ||
| 454 | 2026.08.17 23:52:13.351641 [ 424487 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 455 | 2026.08.17 23:52:13.351649 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Downloading part all_0_0_0 onto disk default. | ||
| 456 | 2026.08.17 23:52:13.352058 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Download of part all_0_0_0 onto disk default finished. | ||
| 457 | 2026.08.17 23:52:13.352068 [ 424487 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 458 | 2026.08.17 23:52:13.352093 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Committing part all_0_0_0 to zookeeper | ||
| 459 | 2026.08.17 23:52:13.367029 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Part all_0_0_0 committed to zookeeper | ||
| 460 | 2026.08.17 23:52:13.367058 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1 | ||
| 461 | 2026.08.17 23:52:13.367124 [ 424309 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=72990511104, merge_with_ttl_allowedtrue) | ||
| 462 | 2026.08.17 23:52:13.367160 [ 424309 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 8227ms | ||
| 463 | 2026.08.17 23:52:13.379248 [ 424352 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 | ||
| 464 | 2026.08.17 23:52:13.394238 [ 424352 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] | ||
| 465 | 2026.08.17 23:52:13.394253 [ 424352 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 466 | 2026.08.17 23:52:13.394529 [ 424469 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Fetching part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1 | ||
| 467 | 2026.08.17 23:52:13.394647 [ 424469 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false | ||
| 468 | 2026.08.17 23:52:13.416127 [ 424469 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 469 | 2026.08.17 23:52:13.417025 [ 424469 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.95 GiB. | ||
| 470 | 2026.08.17 23:52:13.417039 [ 424469 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 471 | 2026.08.17 23:52:13.417049 [ 424469 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Downloading part all_0_0_0 onto disk default. | ||
| 472 | 2026.08.17 23:52:13.417550 [ 424469 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Download of part all_0_0_0 onto disk default finished. | ||
| 473 | 2026.08.17 23:52:13.417563 [ 424469 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 474 | 2026.08.17 23:52:13.417593 [ 424469 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Committing part all_0_0_0 to zookeeper | ||
| 475 | 2026.08.17 23:52:13.421295 [ 424469 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Part all_0_0_0 committed to zookeeper | ||
| 476 | 2026.08.17 23:52:13.421324 [ 424469 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Fetched part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1 | ||
| 477 | 2026.08.17 23:52:13.421376 [ 424305 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=72989974528, merge_with_ttl_allowedtrue) | ||
| 478 | 2026.08.17 23:52:13.421388 [ 424305 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 7809ms | ||
| 479 | 2026.08.17 23:52:13.424673 [ 423966 ] {} <Trace> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 480 | 2026.08.17 23:52:13.424755 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> executeQuery: Query span trace_id for opentelemetry log: b7dc6e3b-6c88-6b32-52be-541afe09d10b | ||
| 481 | 2026.08.17 23:52:13.424835 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Debug> executeQuery: (from [::1]:41598) SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name IN ('virtual_machine:cpu_busy') FORMAT Native (stage: Complete) | ||
| 482 | 2026.08.17 23:52:13.425078 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 483 | 2026.08.17 23:52:13.425219 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 484 | 2026.08.17 23:52:13.425341 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 485 | 2026.08.17 23:52:13.425350 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name IN ('virtual_machine:cpu_busy')" moved to PREWHERE | ||
| 486 | 2026.08.17 23:52:13.425424 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local | ||
| 487 | 2026.08.17 23:52:13.425459 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 488 | 2026.08.17 23:52:13.427094 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 489 | 2026.08.17 23:52:13.427204 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Key condition: (column 0 in 1-element set) | ||
| 490 | 2026.08.17 23:52:13.427218 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 491 | 2026.08.17 23:52:13.427232 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 492 | 2026.08.17 23:52:13.427237 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 493 | 2026.08.17 23:52:13.427244 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found continuous range in 2 steps | ||
| 494 | 2026.08.17 23:52:13.427256 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges | ||
| 495 | 2026.08.17 23:52:13.427261 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 496 | 2026.08.17 23:52:13.427286 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "in(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 497 | 2026.08.17 23:52:13.427292 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0 | ||
| 498 | 2026.08.17 23:52:13.427962 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Debug> executeQuery: Read 1 rows, 126.00 B in 0.003194 sec., 313.08703819661866 rows/sec., 38.52 KiB/sec. | ||
| 499 | 2026.08.17 23:52:13.428007 [ 423966 ] {5c00a2b1-209f-41c1-bda3-04eb4a920508} <Debug> TCPHandler: Processed in 0.003493223 sec. | ||
| 500 | 2026.08.17 23:52:13.428739 [ 423966 ] {} <Trace> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 501 | 2026.08.17 23:52:13.429817 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> executeQuery: Query span trace_id for opentelemetry log: eb44a536-116f-679e-1a05-97922f410474 | ||
| 502 | 2026.08.17 23:52:13.429885 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Debug> executeQuery: (from [::1]:41598) SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name IN ('virtual_machine:cpu_busy') FORMAT Native (stage: Complete) | ||
| 503 | 2026.08.17 23:52:13.430054 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 504 | 2026.08.17 23:52:13.430162 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 505 | 2026.08.17 23:52:13.430275 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 506 | 2026.08.17 23:52:13.430283 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name IN ('virtual_machine:cpu_busy')" moved to PREWHERE | ||
| 507 | 2026.08.17 23:52:13.430341 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local | ||
| 508 | 2026.08.17 23:52:13.430366 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 509 | 2026.08.17 23:52:13.430398 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 510 | 2026.08.17 23:52:13.430480 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Key condition: (column 0 in 1-element set) | ||
| 511 | 2026.08.17 23:52:13.430492 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 512 | 2026.08.17 23:52:13.432405 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 513 | 2026.08.17 23:52:13.432419 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 514 | 2026.08.17 23:52:13.432425 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found continuous range in 2 steps | ||
| 515 | 2026.08.17 23:52:13.432439 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges | ||
| 516 | 2026.08.17 23:52:13.432445 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 517 | 2026.08.17 23:52:13.432470 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "in(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 518 | 2026.08.17 23:52:13.432475 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0 | ||
| 519 | 2026.08.17 23:52:13.433095 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Debug> executeQuery: Read 1 rows, 126.00 B in 0.003263 sec., 306.4664419246093 rows/sec., 37.71 KiB/sec. | ||
| 520 | 2026.08.17 23:52:13.433154 [ 423966 ] {e72b3655-b121-4eba-8cdd-7e179ab4224c} <Debug> TCPHandler: Processed in 0.004534063 sec. | ||
| 521 | 2026.08.17 23:52:13.433611 [ 423967 ] {} <Trace> TCP-Session: 96093916-4a2e-42d4-9d27-a5a734b1d1da Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 522 | 2026.08.17 23:52:13.434908 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> executeQuery: Query span trace_id for opentelemetry log: a3d21833-f7aa-12ab-7974-3ff10f131710 | ||
| 523 | 2026.08.17 23:52:13.435046 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> executeQuery: (from [::1]:41600) SELECT fields_i64_pivot.cpu_id AS cpu_id, fields_uuid_pivot.instance_id AS instance_id, fields_uuid_pivot.project_id AS project_id, fields_uuid_pivot.timeseries_key AS timeseries_key FROM ( SELECT timeseries_key, anyIf(field_value, field_name = 'instance_id') AS instance_id, anyIf(field_value, field_name = 'project_id') AS project_id FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' GROUP BY timeseries_key ) AS fields_uuid_pivot JOIN ( SELECT timeseries_key, anyIf(field_value, field_name = 'cpu_id') AS cpu_id FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' GROUP BY timeseries_key ) AS fields_i64_pivot ON fields_uuid_pivot.timeseries_key = fields_i64_pivot.timeseries_key (stage: Complete) | ||
| 524 | 2026.08.17 23:52:13.435369 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 525 | 2026.08.17 23:52:13.435490 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 | ||
| 526 | 2026.08.17 23:52:13.435606 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 527 | 2026.08.17 23:52:13.435915 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 | ||
| 528 | 2026.08.17 23:52:13.436005 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 | ||
| 529 | 2026.08.17 23:52:13.436130 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 530 | 2026.08.17 23:52:13.436141 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name = 'virtual_machine:cpu_busy'" moved to PREWHERE | ||
| 531 | 2026.08.17 23:52:13.436200 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local | ||
| 532 | 2026.08.17 23:52:13.436220 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 533 | 2026.08.17 23:52:13.436251 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 534 | 2026.08.17 23:52:13.436282 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> HashJoin: (0x7f4479536518) Datatype: EMPTY, kind: Inner, strictness: All, right header: fields_i64_pivot.timeseries_key UInt64 UInt64(size = 0), cpu_id Int64 Int64(size = 0) | ||
| 535 | 2026.08.17 23:52:13.436287 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> HashJoin: (0x7f4479536518) Keys: [(timeseries_key) = (fields_i64_pivot.timeseries_key)] | ||
| 536 | 2026.08.17 23:52:13.436469 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 537 | 2026.08.17 23:52:13.436583 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 538 | 2026.08.17 23:52:13.438143 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 539 | 2026.08.17 23:52:13.438157 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name = 'virtual_machine:cpu_busy'" moved to PREWHERE | ||
| 540 | 2026.08.17 23:52:13.438271 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local | ||
| 541 | 2026.08.17 23:52:13.438307 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 542 | 2026.08.17 23:52:13.438364 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 543 | 2026.08.17 23:52:13.438369 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 544 | 2026.08.17 23:52:13.438382 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0)' | ||
| 545 | 2026.08.17 23:52:13.438399 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0), cpu_id Int64 Int64(size = 0)' | ||
| 546 | 2026.08.17 23:52:13.438796 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Key condition: (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']) | ||
| 547 | 2026.08.17 23:52:13.438812 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 548 | 2026.08.17 23:52:13.438829 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 549 | 2026.08.17 23:52:13.438832 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 550 | 2026.08.17 23:52:13.438840 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found continuous range in 2 steps | ||
| 551 | 2026.08.17 23:52:13.438851 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges | ||
| 552 | 2026.08.17 23:52:13.438855 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 553 | 2026.08.17 23:52:13.438880 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 554 | 2026.08.17 23:52:13.438884 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0 | ||
| 555 | 2026.08.17 23:52:13.439009 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Key condition: (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']) | ||
| 556 | 2026.08.17 23:52:13.439015 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 557 | 2026.08.17 23:52:13.439019 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 558 | 2026.08.17 23:52:13.439022 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 559 | 2026.08.17 23:52:13.439024 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found continuous range in 2 steps | ||
| 560 | 2026.08.17 23:52:13.439029 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges | ||
| 561 | 2026.08.17 23:52:13.439031 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 562 | 2026.08.17 23:52:13.439042 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 563 | 2026.08.17 23:52:13.439045 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 8 rows starting from 0 | ||
| 564 | 2026.08.17 23:52:13.439151 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0)' | ||
| 565 | 2026.08.17 23:52:13.439161 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0), cpu_id Int64 Int64(size = 0)' | ||
| 566 | 2026.08.17 23:52:13.440159 [ 430356 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> AggregatingTransform: Aggregating | ||
| 567 | 2026.08.17 23:52:13.441176 [ 430356 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> Aggregator: Aggregation method: key64 | ||
| 568 | 2026.08.17 23:52:13.441208 [ 430356 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> AggregatingTransform: Aggregated. 8 to 8 rows (from 136.00 B) in 0.002133172 sec. (3750.284 rows/sec., 62.26 KiB/sec.) | ||
| 569 | 2026.08.17 23:52:13.441212 [ 430356 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> Aggregator: Merging aggregated data | ||
| 570 | 2026.08.17 23:52:13.441222 [ 430356 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> Aggregator: Statistics updated for key=1559201803930241434: new sum_of_sizes=8, median_size=8 | ||
| 571 | 2026.08.17 23:52:13.479363 [ 430356 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> AggregatingTransform: Aggregating | ||
| 572 | 2026.08.17 23:52:13.479382 [ 430356 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> Aggregator: Aggregation method: key64 | ||
| 573 | 2026.08.17 23:52:13.479410 [ 430356 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> AggregatingTransform: Aggregated. 16 to 8 rows (from 416.00 B) in 0.040475059 sec. (395.305 rows/sec., 10.04 KiB/sec.) | ||
| 574 | 2026.08.17 23:52:13.479414 [ 430356 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> Aggregator: Merging aggregated data | ||
| 575 | 2026.08.17 23:52:13.479419 [ 430356 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> Aggregator: Statistics updated for key=11757313445726935263: new sum_of_sizes=8, median_size=8 | ||
| 576 | 2026.08.17 23:52:13.480094 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> executeQuery: Read 24 rows, 1.70 KiB in 0.045158 sec., 531.4672926170335 rows/sec., 37.54 KiB/sec. | ||
| 577 | 2026.08.17 23:52:13.480250 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Trace> HashJoin: (0x7f4479536518) Join data is being destroyed, 12544 bytes and 8 rows in hash table | ||
| 578 | 2026.08.17 23:52:13.480334 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> MemoryTracker: Peak memory usage (for query): 184.84 KiB. | ||
| 579 | 2026.08.17 23:52:13.480337 [ 423967 ] {707b465f-c48a-4770-adb4-9135e8fa9817} <Debug> TCPHandler: Processed in 0.046838634 sec. | ||
| 580 | 2026.08.17 23:52:13.480733 [ 423967 ] {} <Trace> TCP-Session: 96093916-4a2e-42d4-9d27-a5a734b1d1da Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 581 | 2026.08.17 23:52:13.482539 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> executeQuery: Query span trace_id for opentelemetry log: a39af2e1-4c9c-9e73-8e74-42db1ee601f5 | ||
| 582 | 2026.08.17 23:52:13.482657 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Debug> executeQuery: (from [::1]:41600) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND ((greater(timestamp, '2000-01-01 00:00:00.000000000') AND timeseries_key IN (3810615656589673070,5210923722195156639,5419464027902213652,7613129139487427710,11185254949005441257,11873430000991232922,15203798703989247109,15520859351690753739))) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 (stage: Complete) | ||
| 583 | 2026.08.17 23:52:13.483043 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 | ||
| 584 | 2026.08.17 23:52:13.484462 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 | ||
| 585 | 2026.08.17 23:52:13.484637 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 | ||
| 586 | 2026.08.17 23:52:13.484650 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timestamp > '2000-01-01 00:00:00.000000000') AND (timeseries_key IN (3810615656589673070, 5210923722195156639, 5419464027902213652, 7613129139487427710, 11185254949005441257, 11873430000991232922, 15203798703989247109, 15520859351690753739)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE | ||
| 587 | 2026.08.17 23:52:13.484768 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local | ||
| 588 | 2026.08.17 23:52:13.484801 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 589 | 2026.08.17 23:52:13.484843 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 590 | 2026.08.17 23:52:13.484977 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Key condition: (column 3 in ('946684800', +Inf)), (column 1 in 8-element set), and, (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and | ||
| 591 | 2026.08.17 23:52:13.484999 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps | ||
| 592 | 2026.08.17 23:52:13.485013 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges | ||
| 593 | 2026.08.17 23:52:13.485017 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Spreading ranges among streams with order | ||
| 594 | 2026.08.17 23:52:13.485072 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 3 steps: "greater(timestamp, '2000-01-01 00:00:00.000000000')", "in(timeseries_key, (3810615656589673070, 5210923722195156639, 5419464027902213652, 7613129139487427710, 11185254949005441257, 11873430000991232922, 15203798703989247109, 15520859351690753739))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 595 | 2026.08.17 23:52:13.485079 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 | ||
| 596 | 2026.08.17 23:52:13.485768 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Debug> executeQuery: Read 400 rows, 25.78 KiB in 0.003217 sec., 124339.44668946225 rows/sec., 7.83 MiB/sec. | ||
| 597 | 2026.08.17 23:52:13.485844 [ 423967 ] {7c39db18-b498-444a-9648-5e05938bb467} <Debug> TCPHandler: Processed in 0.005238084 sec. | ||
| 598 | 2026.08.17 23:52:13.524602 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 8 | ||
| 599 | 2026.08.17 23:52:13.524642 [ 425043 ] {} <Debug> SystemLog (system.metric_log): Creating new table system.metric_log for MetricLog | ||
| 600 | 2026.08.17 23:52:13.524650 [ 425044 ] {} <Trace> SystemLog (system.opentelemetry_span_log): Flushing system log, 99 entries to flush up to offset 99 | ||
| 601 | 2026.08.17 23:52:13.524689 [ 425044 ] {} <Debug> SystemLog (system.opentelemetry_span_log): Creating new table system.opentelemetry_span_log for OpenTelemetrySpanLog | ||
| 602 | 2026.08.17 23:52:13.524670 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2360 entries to flush up to offset 2360 | ||
| 603 | 2026.08.17 23:52:13.524724 [ 425046 ] {} <Debug> SystemLog (system.asynchronous_metric_log): Creating new table system.asynchronous_metric_log for AsynchronousMetricLog | ||
| 604 | 2026.08.17 23:52:13.529641 [ 425046 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Loading data parts | ||
| 605 | 2026.08.17 23:52:13.529646 [ 425044 ] {} <Debug> system.opentelemetry_span_log (9be1034d-e911-4280-94c0-05dcb911f3d3): Loading data parts | ||
| 606 | 2026.08.17 23:52:13.529795 [ 425046 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): There are no data parts | ||
| 607 | 2026.08.17 23:52:13.529804 [ 425044 ] {} <Debug> system.opentelemetry_span_log (9be1034d-e911-4280-94c0-05dcb911f3d3): There are no data parts | ||
| 608 | 2026.08.17 23:52:13.534496 [ 425043 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Loading data parts | ||
| 609 | 2026.08.17 23:52:13.534638 [ 425043 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): There are no data parts | ||
| 610 | 2026.08.17 23:52:13.539760 [ 425044 ] {} <Trace> system.opentelemetry_span_log (9be1034d-e911-4280-94c0-05dcb911f3d3): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 611 | 2026.08.17 23:52:13.539782 [ 425044 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.95 GiB. | ||
| 612 | 2026.08.17 23:52:13.539996 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 613 | 2026.08.17 23:52:13.540013 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.95 GiB. | ||
| 614 | 2026.08.17 23:52:13.541555 [ 425044 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_1_1_0 (state Temporary) | ||
| 615 | 2026.08.17 23:52:13.541735 [ 425044 ] {} <Trace> system.opentelemetry_span_log (9be1034d-e911-4280-94c0-05dcb911f3d3): Renaming temporary part tmp_insert_202608_1_1_0 to 202608_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 616 | 2026.08.17 23:52:13.541843 [ 425044 ] {} <Trace> SystemLog (system.opentelemetry_span_log): Flushed system log up to offset 99 | ||
| 617 | 2026.08.17 23:52:13.546866 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_1_1_0 (state Temporary) | ||
| 618 | 2026.08.17 23:52:13.547038 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_1_1_0 to 202608_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 619 | 2026.08.17 23:52:13.547164 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 2360 | ||
| 620 | 2026.08.17 23:52:13.554038 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 621 | 2026.08.17 23:52:13.554057 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.95 GiB. | ||
| 622 | 2026.08.17 23:52:13.559786 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_1_1_0 (state Temporary) | ||
| 623 | 2026.08.17 23:52:13.564240 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_1_1_0 to 202608_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 624 | 2026.08.17 23:52:13.565291 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 8 | ||
| 625 | 2026.08.17 23:52:13.722264 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 626 | 2026.08.17 23:52:13.722277 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 627 | 2026.08.17 23:52:13.722391 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=11, queue_size=11, entries=query-0000000000..query-0000000010, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000009, last_skipped_entry_name=none | ||
| 628 | 2026.08.17 23:52:13.722395 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000010 | ||
| 629 | 2026.08.17 23:52:13.722398 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000010 | ||
| 630 | 2026.08.17 23:52:13.722581 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000010 (CREATE DATABASE IF NOT EXISTS oximeter UUID '4be0c896-7297-443c-9ea9-578cef50f5d1') | ||
| 631 | 2026.08.17 23:52:13.731873 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID '4be0c896-7297-443c-9ea9-578cef50f5d1' | ||
| 632 | 2026.08.17 23:52:13.731917 [ 425085 ] {5773e297-f2e3-4a02-9624-f15e9f27bee3} <Trace> executeQuery: Query span trace_id for opentelemetry log: d2d214aa-ea9c-24a7-2cf8-c8dffcee6a39 | ||
| 633 | 2026.08.17 23:52:13.731939 [ 425085 ] {5773e297-f2e3-4a02-9624-f15e9f27bee3} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f8739398-52c9-460e-ba56-ea94cd24a5b9) /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '4be0c896-7297-443c-9ea9-578cef50f5d1' (stage: Complete) | ||
| 634 | 2026.08.17 23:52:13.731998 [ 425085 ] {5773e297-f2e3-4a02-9624-f15e9f27bee3} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '4be0c896-7297-443c-9ea9-578cef50f5d1' | ||
| 635 | 2026.08.17 23:52:13.740967 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 636 | 2026.08.17 23:52:13.846278 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 637 | 2026.08.17 23:52:13.846283 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 638 | 2026.08.17 23:52:13.846362 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=12, queue_size=12, entries=query-0000000000..query-0000000011, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000010, last_skipped_entry_name=none | ||
| 639 | 2026.08.17 23:52:13.846366 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000011 | ||
| 640 | 2026.08.17 23:52:13.846369 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000011 | ||
| 641 | 2026.08.17 23:52:13.846646 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000011 (CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c0ee7deb-8ff1-49dc-a4f8-eaaa2e6fe247' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)) | ||
| 642 | 2026.08.17 23:52:13.852763 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c0ee7deb-8ff1-49dc-a4f8-eaaa2e6fe247' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) | ||
| 643 | 2026.08.17 23:52:13.852810 [ 425085 ] {9713f565-d549-4756-8214-fe7440e53306} <Trace> executeQuery: Query span trace_id for opentelemetry log: 16854907-df7a-03b7-60d1-9a4d8c75a5cc | ||
| 644 | 2026.08.17 23:52:13.852863 [ 425085 ] {9713f565-d549-4756-8214-fe7440e53306} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5d992474-32bf-4d4e-a55b-cdee57c21e9d) /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c0ee7deb-8ff1-49dc-a4f8-eaaa2e6fe247' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) | ||
| 645 | 2026.08.17 23:52:13.852955 [ 425085 ] {9713f565-d549-4756-8214-fe7440e53306} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c0ee7deb-8ff1-49dc-a4f8-eaaa2e6fe247' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) | ||
| 646 | 2026.08.17 23:52:13.861046 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 647 | 2026.08.17 23:52:13.962180 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 648 | 2026.08.17 23:52:13.962183 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 649 | 2026.08.17 23:52:13.962271 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=13, queue_size=13, entries=query-0000000000..query-0000000012, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000011, last_skipped_entry_name=none | ||
| 650 | 2026.08.17 23:52:13.962276 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000012 | ||
| 651 | 2026.08.17 23:52:13.962279 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000012 | ||
| 652 | 2026.08.17 23:52:13.962563 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000012 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'b3621814-53ee-4a40-975e-9577a7c29267' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) | ||
| 653 | 2026.08.17 23:52:13.978255 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'b3621814-53ee-4a40-975e-9577a7c29267' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) | ||
| 654 | 2026.08.17 23:52:13.978305 [ 425085 ] {619cc101-60ec-4355-a9a9-bc6edc1ecb32} <Trace> executeQuery: Query span trace_id for opentelemetry log: ca5c133b-54d4-1d93-2968-50c3c57f03ae | ||
| 655 | 2026.08.17 23:52:13.978384 [ 425085 ] {619cc101-60ec-4355-a9a9-bc6edc1ecb32} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: df35bc16-dd43-46f9-b3a0-e2346a800b32) /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'b3621814-53ee-4a40-975e-9577a7c29267' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) | ||
| 656 | 2026.08.17 23:52:13.978489 [ 425085 ] {619cc101-60ec-4355-a9a9-bc6edc1ecb32} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'b3621814-53ee-4a40-975e-9577a7c29267' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) | ||
| 657 | 2026.08.17 23:52:13.982972 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 658 | 2026.08.17 23:52:14.000331 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 395.15 MiB, peak 403.98 MiB, free memory in arenas 50.84 MiB, will set to 402.85 MiB (RSS), difference: 7.70 MiB | ||
| 659 | 2026.08.17 23:52:14.040698 [ 425082 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' | ||
| 660 | 2026.08.17 23:52:14.040700 [ 425080 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' | ||
| 661 | 2026.08.17 23:52:14.041231 [ 425082 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration | ||
| 662 | 2026.08.17 23:52:14.041232 [ 425080 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration | ||
| 663 | 2026.08.17 23:52:14.041519 [ 425080 ] {} <Information> Application: Setting max_server_memory_usage was set to 27.67 GiB (30.74 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) | ||
| 664 | 2026.08.17 23:52:14.041522 [ 425080 ] {} <Information> Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.37 GiB (30.74 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) | ||
| 665 | 2026.08.17 23:52:14.041524 [ 425080 ] {} <Information> Application: Merges and mutations memory limit is set to 15.37 GiB | ||
| 666 | 2026.08.17 23:52:14.041535 [ 425082 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration | ||
| 667 | 2026.08.17 23:52:14.041698 [ 425080 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor | ||
| 668 | 2026.08.17 23:52:14.041703 [ 425080 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor | ||
| 669 | 2026.08.17 23:52:14.041705 [ 425080 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor | ||
| 670 | 2026.08.17 23:52:14.041711 [ 425080 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor | ||
| 671 | 2026.08.17 23:52:14.041757 [ 425080 ] {} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1 | ||
| 672 | 2026.08.17 23:52:14.041762 [ 425080 ] {} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1 | ||
| 673 | 2026.08.17 23:52:14.042357 [ 423965 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:53870, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) | ||
| 674 | 2026.08.17 23:52:14.042385 [ 423965 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false | ||
| 675 | 2026.08.17 23:52:14.042392 [ 423965 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Replicated PartsService): Sending part all_0_0_0 | ||
| 676 | 2026.08.17 23:52:14.042602 [ 423965 ] {} <Debug> InterserverIOHTTPHandler: Done processing query | ||
| 677 | 2026.08.17 23:52:14.042879 [ 425080 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. | ||
| 678 | 2026.08.17 23:52:14.043028 [ 425080 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration | ||
| 679 | 2026.08.17 23:52:14.084809 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 680 | 2026.08.17 23:52:14.084827 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 681 | 2026.08.17 23:52:14.084908 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=14, queue_size=14, entries=query-0000000000..query-0000000013, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000012, last_skipped_entry_name=none | ||
| 682 | 2026.08.17 23:52:14.084912 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000013 | ||
| 683 | 2026.08.17 23:52:14.084914 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000013 | ||
| 684 | 2026.08.17 23:52:14.085121 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000013 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '687a1d0a-fc9f-4251-b55d-83fb6471cb02' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 685 | 2026.08.17 23:52:14.095203 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '687a1d0a-fc9f-4251-b55d-83fb6471cb02' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 686 | 2026.08.17 23:52:14.095235 [ 425085 ] {620d2159-8423-4138-8559-1bd531f99f8b} <Trace> executeQuery: Query span trace_id for opentelemetry log: 478a4286-613c-2c39-95ef-71bd587420d6 | ||
| 687 | 2026.08.17 23:52:14.095287 [ 425085 ] {620d2159-8423-4138-8559-1bd531f99f8b} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: badcb7d2-1906-436a-8baf-6f29321e2ff8) /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '687a1d0a-fc9f-4251-b55d-83fb6471cb02' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 688 | 2026.08.17 23:52:14.095422 [ 425085 ] {620d2159-8423-4138-8559-1bd531f99f8b} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '687a1d0a-fc9f-4251-b55d-83fb6471cb02' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 689 | 2026.08.17 23:52:14.103995 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 690 | 2026.08.17 23:52:14.204940 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 691 | 2026.08.17 23:52:14.204944 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 692 | 2026.08.17 23:52:14.206255 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=15, queue_size=15, entries=query-0000000000..query-0000000014, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000013, last_skipped_entry_name=none | ||
| 693 | 2026.08.17 23:52:14.206259 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000014 | ||
| 694 | 2026.08.17 23:52:14.206262 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000014 | ||
| 695 | 2026.08.17 23:52:14.206547 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000014 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '4ce85b75-228a-434b-bf0a-ac32163275d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) | ||
| 696 | 2026.08.17 23:52:14.217810 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '4ce85b75-228a-434b-bf0a-ac32163275d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 697 | 2026.08.17 23:52:14.217851 [ 425085 ] {cb811181-38ed-4c37-9b46-1e6628983e1e} <Trace> executeQuery: Query span trace_id for opentelemetry log: 54c3773d-b913-03fd-a8bf-ced8aee8a445 | ||
| 698 | 2026.08.17 23:52:14.217927 [ 425085 ] {cb811181-38ed-4c37-9b46-1e6628983e1e} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4b23c3b7-0522-419a-9a03-9c6550868030) /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '4ce85b75-228a-434b-bf0a-ac32163275d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) | ||
| 699 | 2026.08.17 23:52:14.218097 [ 425085 ] {cb811181-38ed-4c37-9b46-1e6628983e1e} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '4ce85b75-228a-434b-bf0a-ac32163275d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 700 | 2026.08.17 23:52:14.226951 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 701 | 2026.08.17 23:52:14.297316 [ 423965 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:53870, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) | ||
| 702 | 2026.08.17 23:52:14.297367 [ 423965 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false | ||
| 703 | 2026.08.17 23:52:14.297376 [ 423965 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Replicated PartsService): Sending part all_0_0_0 | ||
| 704 | 2026.08.17 23:52:14.297584 [ 423965 ] {} <Debug> InterserverIOHTTPHandler: Done processing query | ||
| 705 | 2026.08.17 23:52:14.329728 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 706 | 2026.08.17 23:52:14.329746 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 707 | 2026.08.17 23:52:14.329843 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=16, queue_size=16, entries=query-0000000000..query-0000000015, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000014, last_skipped_entry_name=none | ||
| 708 | 2026.08.17 23:52:14.329847 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000015 | ||
| 709 | 2026.08.17 23:52:14.329849 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000015 | ||
| 710 | 2026.08.17 23:52:14.330087 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000015 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID 'a46085f8-d016-49d0-8bec-67bf5913f41d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 711 | 2026.08.17 23:52:14.340698 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID 'a46085f8-d016-49d0-8bec-67bf5913f41d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 712 | 2026.08.17 23:52:14.340740 [ 425085 ] {72a9de94-26b9-4628-9962-a061a9060c5d} <Trace> executeQuery: Query span trace_id for opentelemetry log: c1c60bc6-4a1b-9316-0669-ee0234f1dcc2 | ||
| 713 | 2026.08.17 23:52:14.340800 [ 425085 ] {72a9de94-26b9-4628-9962-a061a9060c5d} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0d6b380e-6b10-4314-998b-91b7ea50b1ba) /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID 'a46085f8-d016-49d0-8bec-67bf5913f41d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 714 | 2026.08.17 23:52:14.340951 [ 425085 ] {72a9de94-26b9-4628-9962-a061a9060c5d} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID 'a46085f8-d016-49d0-8bec-67bf5913f41d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 715 | 2026.08.17 23:52:14.348762 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 716 | 2026.08.17 23:52:14.446029 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 717 | 2026.08.17 23:52:14.446032 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 718 | 2026.08.17 23:52:14.446119 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=17, queue_size=17, entries=query-0000000000..query-0000000016, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000015, last_skipped_entry_name=none | ||
| 719 | 2026.08.17 23:52:14.446124 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000016 | ||
| 720 | 2026.08.17 23:52:14.446130 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000016 | ||
| 721 | 2026.08.17 23:52:14.446375 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000016 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a6697841-90b5-4b0b-8f35-655266f19b34' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) | ||
| 722 | 2026.08.17 23:52:14.463600 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a6697841-90b5-4b0b-8f35-655266f19b34' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 723 | 2026.08.17 23:52:14.463647 [ 425085 ] {b0ec720f-fd3a-4666-be60-02748d24891f} <Trace> executeQuery: Query span trace_id for opentelemetry log: 3fcfcacc-1cd9-ba4d-63b7-c3e3436382a9 | ||
| 724 | 2026.08.17 23:52:14.463725 [ 425085 ] {b0ec720f-fd3a-4666-be60-02748d24891f} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b57a40e3-8d42-40b9-aed2-8491ccacdf96) /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a6697841-90b5-4b0b-8f35-655266f19b34' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) | ||
| 725 | 2026.08.17 23:52:14.463912 [ 425085 ] {b0ec720f-fd3a-4666-be60-02748d24891f} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a6697841-90b5-4b0b-8f35-655266f19b34' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 726 | 2026.08.17 23:52:14.470869 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 727 | 2026.08.17 23:52:14.571636 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 728 | 2026.08.17 23:52:14.571636 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 729 | 2026.08.17 23:52:14.571731 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=18, queue_size=18, entries=query-0000000000..query-0000000017, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000016, last_skipped_entry_name=none | ||
| 730 | 2026.08.17 23:52:14.571736 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000017 | ||
| 731 | 2026.08.17 23:52:14.571739 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000017 | ||
| 732 | 2026.08.17 23:52:14.572023 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000017 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '3a17e6d0-bd01-498b-ad0e-e9245d564d41' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 733 | 2026.08.17 23:52:14.579437 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '3a17e6d0-bd01-498b-ad0e-e9245d564d41' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 734 | 2026.08.17 23:52:14.579484 [ 425085 ] {08200f1c-a4b5-4aef-b75c-f9b781dfcbd6} <Trace> executeQuery: Query span trace_id for opentelemetry log: 946a9ab4-02ea-e5b8-a3b3-83c3d60f5bb6 | ||
| 735 | 2026.08.17 23:52:14.579567 [ 425085 ] {08200f1c-a4b5-4aef-b75c-f9b781dfcbd6} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 7eca9f79-4231-498f-aced-aa2210a52bc5) /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '3a17e6d0-bd01-498b-ad0e-e9245d564d41' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 736 | 2026.08.17 23:52:14.579730 [ 425085 ] {08200f1c-a4b5-4aef-b75c-f9b781dfcbd6} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '3a17e6d0-bd01-498b-ad0e-e9245d564d41' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 737 | 2026.08.17 23:52:14.588768 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 738 | 2026.08.17 23:52:14.694345 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 739 | 2026.08.17 23:52:14.694349 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 740 | 2026.08.17 23:52:14.694437 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=19, queue_size=19, entries=query-0000000000..query-0000000018, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000017, last_skipped_entry_name=none | ||
| 741 | 2026.08.17 23:52:14.694441 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000018 | ||
| 742 | 2026.08.17 23:52:14.694444 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000018 | ||
| 743 | 2026.08.17 23:52:14.694855 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000018 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'fedf803c-4b42-4f88-bda5-0cf52392d08b' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)) | ||
| 744 | 2026.08.17 23:52:14.707084 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'fedf803c-4b42-4f88-bda5-0cf52392d08b' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) | ||
| 745 | 2026.08.17 23:52:14.707146 [ 425085 ] {1cb7cf8c-614e-49e5-80f4-f40a4e62def8} <Trace> executeQuery: Query span trace_id for opentelemetry log: ddc37f34-a0b7-c7f7-47c9-c53e276b6cba | ||
| 746 | 2026.08.17 23:52:14.707257 [ 425085 ] {1cb7cf8c-614e-49e5-80f4-f40a4e62def8} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5380d490-e09b-4ff0-aed1-d03fc091bde8) /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'fedf803c-4b42-4f88-bda5-0cf52392d08b' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) | ||
| 747 | 2026.08.17 23:52:14.707434 [ 425085 ] {1cb7cf8c-614e-49e5-80f4-f40a4e62def8} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'fedf803c-4b42-4f88-bda5-0cf52392d08b' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) | ||
| 748 | 2026.08.17 23:52:14.716633 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 749 | 2026.08.17 23:52:14.787494 [ 423965 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:53870, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) | ||
| 750 | 2026.08.17 23:52:14.787531 [ 423965 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ftimeseries_schema_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false | ||
| 751 | 2026.08.17 23:52:14.787541 [ 423965 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (Replicated PartsService): Sending part all_0_0_0 | ||
| 752 | 2026.08.17 23:52:14.787736 [ 423965 ] {} <Debug> InterserverIOHTTPHandler: Done processing query | ||
| 753 | 2026.08.17 23:52:14.817979 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 754 | 2026.08.17 23:52:14.817981 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 755 | 2026.08.17 23:52:14.818095 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000018, last_skipped_entry_name=none | ||
| 756 | 2026.08.17 23:52:14.818103 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000019 | ||
| 757 | 2026.08.17 23:52:14.818106 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000019 | ||
| 758 | 2026.08.17 23:52:14.818523 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000019 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '1cc18418-904a-4736-9734-d5efdce75180' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 759 | 2026.08.17 23:52:14.826770 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '1cc18418-904a-4736-9734-d5efdce75180' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 760 | 2026.08.17 23:52:14.826815 [ 425085 ] {5aaffc4a-5c31-4909-a9d1-a76c66dbe514} <Trace> executeQuery: Query span trace_id for opentelemetry log: beac905f-b105-04bb-1fc3-91b58bf7f6ea | ||
| 761 | 2026.08.17 23:52:14.826910 [ 425085 ] {5aaffc4a-5c31-4909-a9d1-a76c66dbe514} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: a500356f-414f-4204-8145-0b8bce4ec994) /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '1cc18418-904a-4736-9734-d5efdce75180' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 762 | 2026.08.17 23:52:14.827074 [ 425085 ] {5aaffc4a-5c31-4909-a9d1-a76c66dbe514} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '1cc18418-904a-4736-9734-d5efdce75180' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 763 | 2026.08.17 23:52:14.835783 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 764 | 2026.08.17 23:52:15.000388 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 403.00 MiB, peak 412.85 MiB, free memory in arenas 62.84 MiB, will set to 413.92 MiB (RSS), difference: 10.93 MiB | ||
| 765 | 2026.08.17 23:52:15.032470 [ 424416 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 | ||
| 766 | 2026.08.17 23:52:15.043930 [ 424416 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] | ||
| 767 | 2026.08.17 23:52:15.043950 [ 424416 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 768 | 2026.08.17 23:52:15.044351 [ 424488 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Fetching part all_1_1_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 | ||
| 769 | 2026.08.17 23:52:15.044441 [ 424488 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false | ||
| 770 | 2026.08.17 23:52:15.044497 [ 424488 ] {} <Trace> HTTPSessionAdapter: Created HTTP(S) session with ::1:19403 (::1:19403) | ||
| 771 | 2026.08.17 23:52:15.044904 [ 424488 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 772 | 2026.08.17 23:52:15.044921 [ 424488 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.92 GiB. | ||
| 773 | 2026.08.17 23:52:15.044926 [ 424488 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 774 | 2026.08.17 23:52:15.044935 [ 424488 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Downloading part all_1_1_0 onto disk default. | ||
| 775 | 2026.08.17 23:52:15.045401 [ 424488 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Download of part all_1_1_0 onto disk default finished. | ||
| 776 | 2026.08.17 23:52:15.046990 [ 424488 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 777 | 2026.08.17 23:52:15.047037 [ 424488 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Committing part all_1_1_0 to zookeeper | ||
| 778 | 2026.08.17 23:52:15.056866 [ 424335 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 | ||
| 779 | 2026.08.17 23:52:15.061792 [ 424488 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Part all_1_1_0 committed to zookeeper | ||
| 780 | 2026.08.17 23:52:15.061830 [ 424488 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Fetched part all_1_1_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 | ||
| 781 | 2026.08.17 23:52:15.061899 [ 424422 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=72971319296, merge_with_ttl_allowedtrue) | ||
| 782 | 2026.08.17 23:52:15.061913 [ 424422 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 9751ms | ||
| 783 | 2026.08.17 23:52:15.071466 [ 424335 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] | ||
| 784 | 2026.08.17 23:52:15.071489 [ 424335 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 785 | 2026.08.17 23:52:15.075559 [ 424465 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Fetching part all_1_1_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3 | ||
| 786 | 2026.08.17 23:52:15.075659 [ 424465 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false | ||
| 787 | 2026.08.17 23:52:15.076004 [ 424465 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 788 | 2026.08.17 23:52:15.076017 [ 424465 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.92 GiB. | ||
| 789 | 2026.08.17 23:52:15.076023 [ 424465 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 790 | 2026.08.17 23:52:15.076031 [ 424465 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Downloading part all_1_1_0 onto disk default. | ||
| 791 | 2026.08.17 23:52:15.076506 [ 424465 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Download of part all_1_1_0 onto disk default finished. | ||
| 792 | 2026.08.17 23:52:15.076517 [ 424465 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 793 | 2026.08.17 23:52:15.076543 [ 424465 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Committing part all_1_1_0 to zookeeper | ||
| 794 | 2026.08.17 23:52:15.089930 [ 424465 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Part all_1_1_0 committed to zookeeper | ||
| 795 | 2026.08.17 23:52:15.089969 [ 424465 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Fetched part all_1_1_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3 | ||
| 796 | 2026.08.17 23:52:15.090035 [ 424397 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=72970907648, merge_with_ttl_allowedtrue) | ||
| 797 | 2026.08.17 23:52:15.090057 [ 424397 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 10785ms | ||
| 798 | 2026.08.17 23:52:15.104379 [ 424339 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 | ||
| 799 | 2026.08.17 23:52:15.119096 [ 424339 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] | ||
| 800 | 2026.08.17 23:52:15.119117 [ 424339 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 801 | 2026.08.17 23:52:15.121991 [ 423966 ] {} <Trace> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 802 | 2026.08.17 23:52:15.122957 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> executeQuery: Query span trace_id for opentelemetry log: 24153a6a-6362-7f18-1e96-d6e1ba5379a4 | ||
| 803 | 2026.08.17 23:52:15.123018 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Debug> executeQuery: (from [::1]:41598) SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name IN ('virtual_machine:cpu_busy') FORMAT Native (stage: Complete) | ||
| 804 | 2026.08.17 23:52:15.123245 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 805 | 2026.08.17 23:52:15.123369 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 806 | 2026.08.17 23:52:15.123491 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 807 | 2026.08.17 23:52:15.123499 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name IN ('virtual_machine:cpu_busy')" moved to PREWHERE | ||
| 808 | 2026.08.17 23:52:15.123561 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local | ||
| 809 | 2026.08.17 23:52:15.125017 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 810 | 2026.08.17 23:52:15.125064 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 811 | 2026.08.17 23:52:15.125140 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Key condition: (column 0 in 1-element set) | ||
| 812 | 2026.08.17 23:52:15.125147 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 813 | 2026.08.17 23:52:15.125155 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 814 | 2026.08.17 23:52:15.125160 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 815 | 2026.08.17 23:52:15.125164 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found continuous range in 2 steps | ||
| 816 | 2026.08.17 23:52:15.125171 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges | ||
| 817 | 2026.08.17 23:52:15.125176 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 818 | 2026.08.17 23:52:15.125208 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "in(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 819 | 2026.08.17 23:52:15.125213 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0 | ||
| 820 | 2026.08.17 23:52:15.125545 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Fetching part all_1_1_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/3 | ||
| 821 | 2026.08.17 23:52:15.125648 [ 424490 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false | ||
| 822 | 2026.08.17 23:52:15.125707 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Debug> executeQuery: Read 1 rows, 126.00 B in 0.002735 sec., 365.6307129798903 rows/sec., 44.99 KiB/sec. | ||
| 823 | 2026.08.17 23:52:15.125757 [ 423966 ] {5a195f19-9738-4f9a-bf0d-72b23843a884} <Debug> TCPHandler: Processed in 0.003834633 sec. | ||
| 824 | 2026.08.17 23:52:15.126351 [ 423966 ] {} <Trace> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 825 | 2026.08.17 23:52:15.127798 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> executeQuery: Query span trace_id for opentelemetry log: 927c2784-5ad1-abee-ef13-b9af1c97fd03 | ||
| 826 | 2026.08.17 23:52:15.127848 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Debug> executeQuery: (from [::1]:41598) SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name IN ('virtual_machine:cpu_busy') FORMAT Native (stage: Complete) | ||
| 827 | 2026.08.17 23:52:15.127883 [ 424490 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 828 | 2026.08.17 23:52:15.127899 [ 424490 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.92 GiB. | ||
| 829 | 2026.08.17 23:52:15.127907 [ 424490 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 830 | 2026.08.17 23:52:15.127916 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Downloading part all_1_1_0 onto disk default. | ||
| 831 | 2026.08.17 23:52:15.128006 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 832 | 2026.08.17 23:52:15.128125 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 833 | 2026.08.17 23:52:15.128214 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 834 | 2026.08.17 23:52:15.128221 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name IN ('virtual_machine:cpu_busy')" moved to PREWHERE | ||
| 835 | 2026.08.17 23:52:15.128274 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local | ||
| 836 | 2026.08.17 23:52:15.128295 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 837 | 2026.08.17 23:52:15.128322 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 838 | 2026.08.17 23:52:15.128365 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Download of part all_1_1_0 onto disk default finished. | ||
| 839 | 2026.08.17 23:52:15.128374 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Key condition: (column 0 in 1-element set) | ||
| 840 | 2026.08.17 23:52:15.128377 [ 424490 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 841 | 2026.08.17 23:52:15.128381 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 842 | 2026.08.17 23:52:15.128387 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 843 | 2026.08.17 23:52:15.128390 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 844 | 2026.08.17 23:52:15.128393 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found continuous range in 2 steps | ||
| 845 | 2026.08.17 23:52:15.128400 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges | ||
| 846 | 2026.08.17 23:52:15.128402 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Committing part all_1_1_0 to zookeeper | ||
| 847 | 2026.08.17 23:52:15.128404 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 848 | 2026.08.17 23:52:15.128416 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "in(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 849 | 2026.08.17 23:52:15.128421 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0 | ||
| 850 | 2026.08.17 23:52:15.128906 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Debug> executeQuery: Read 1 rows, 126.00 B in 0.001094 sec., 914.0767824497259 rows/sec., 112.47 KiB/sec. | ||
| 851 | 2026.08.17 23:52:15.130576 [ 423966 ] {9d773327-8467-4a56-aa37-ed1a9b11d647} <Debug> TCPHandler: Processed in 0.004273313 sec. | ||
| 852 | 2026.08.17 23:52:15.130863 [ 423967 ] {} <Trace> TCP-Session: 96093916-4a2e-42d4-9d27-a5a734b1d1da Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 853 | 2026.08.17 23:52:15.130916 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> executeQuery: Query span trace_id for opentelemetry log: 2f766f93-e70d-0c99-879e-8435a3f3c301 | ||
| 854 | 2026.08.17 23:52:15.131040 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> executeQuery: (from [::1]:41600) SELECT fields_i64_pivot.cpu_id AS cpu_id, fields_uuid_pivot.instance_id AS instance_id, fields_uuid_pivot.project_id AS project_id, fields_uuid_pivot.timeseries_key AS timeseries_key FROM ( SELECT timeseries_key, anyIf(field_value, field_name = 'instance_id') AS instance_id, anyIf(field_value, field_name = 'project_id') AS project_id FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' GROUP BY timeseries_key ) AS fields_uuid_pivot JOIN ( SELECT timeseries_key, anyIf(field_value, field_name = 'cpu_id') AS cpu_id FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' GROUP BY timeseries_key ) AS fields_i64_pivot ON fields_uuid_pivot.timeseries_key = fields_i64_pivot.timeseries_key (stage: Complete) | ||
| 855 | 2026.08.17 23:52:15.131462 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 856 | 2026.08.17 23:52:15.131595 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 | ||
| 857 | 2026.08.17 23:52:15.133123 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 858 | 2026.08.17 23:52:15.133404 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 | ||
| 859 | 2026.08.17 23:52:15.133509 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 | ||
| 860 | 2026.08.17 23:52:15.133627 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 861 | 2026.08.17 23:52:15.133634 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name = 'virtual_machine:cpu_busy'" moved to PREWHERE | ||
| 862 | 2026.08.17 23:52:15.133710 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local | ||
| 863 | 2026.08.17 23:52:15.133730 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 864 | 2026.08.17 23:52:15.133758 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 865 | 2026.08.17 23:52:15.133789 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> HashJoin: (0x7f4479536298) Datatype: EMPTY, kind: Inner, strictness: All, right header: fields_i64_pivot.timeseries_key UInt64 UInt64(size = 0), cpu_id Int64 Int64(size = 0) | ||
| 866 | 2026.08.17 23:52:15.133793 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> HashJoin: (0x7f4479536298) Keys: [(timeseries_key) = (fields_i64_pivot.timeseries_key)] | ||
| 867 | 2026.08.17 23:52:15.133968 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 868 | 2026.08.17 23:52:15.135581 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 869 | 2026.08.17 23:52:15.135724 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 870 | 2026.08.17 23:52:15.135731 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name = 'virtual_machine:cpu_busy'" moved to PREWHERE | ||
| 871 | 2026.08.17 23:52:15.135811 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local | ||
| 872 | 2026.08.17 23:52:15.135835 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 873 | 2026.08.17 23:52:15.135867 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 874 | 2026.08.17 23:52:15.135870 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 875 | 2026.08.17 23:52:15.135880 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0)' | ||
| 876 | 2026.08.17 23:52:15.135896 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0), cpu_id Int64 Int64(size = 0)' | ||
| 877 | 2026.08.17 23:52:15.136211 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Key condition: (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']) | ||
| 878 | 2026.08.17 23:52:15.136287 [ 430357 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 879 | 2026.08.17 23:52:15.136321 [ 430368 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) | ||
| 880 | 2026.08.17 23:52:15.138017 [ 430357 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 881 | 2026.08.17 23:52:15.138022 [ 430368 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 882 | 2026.08.17 23:52:15.138032 [ 430368 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 883 | 2026.08.17 23:52:15.138025 [ 430357 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 884 | 2026.08.17 23:52:15.138036 [ 430368 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found continuous range in 2 steps | ||
| 885 | 2026.08.17 23:52:15.138046 [ 430357 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found continuous range in 2 steps | ||
| 886 | 2026.08.17 23:52:15.138118 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges | ||
| 887 | 2026.08.17 23:52:15.138129 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 888 | 2026.08.17 23:52:15.138173 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> MergeTreeReadPool: min_marks_for_concurrent_read=24 | ||
| 889 | 2026.08.17 23:52:15.138180 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Reading approx. 32 rows with 2 streams | ||
| 890 | 2026.08.17 23:52:15.138196 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 891 | 2026.08.17 23:52:15.138212 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 892 | 2026.08.17 23:52:15.138345 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Key condition: (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']) | ||
| 893 | 2026.08.17 23:52:15.138422 [ 430362 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 894 | 2026.08.17 23:52:15.138425 [ 430359 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) | ||
| 895 | 2026.08.17 23:52:15.138436 [ 430362 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 896 | 2026.08.17 23:52:15.138441 [ 430362 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 897 | 2026.08.17 23:52:15.138441 [ 430359 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 898 | 2026.08.17 23:52:15.138450 [ 430359 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 899 | 2026.08.17 23:52:15.138444 [ 430362 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found continuous range in 2 steps | ||
| 900 | 2026.08.17 23:52:15.138456 [ 430359 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found continuous range in 2 steps | ||
| 901 | 2026.08.17 23:52:15.138499 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges | ||
| 902 | 2026.08.17 23:52:15.138504 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 903 | 2026.08.17 23:52:15.138528 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> MergeTreeReadPool: min_marks_for_concurrent_read=24 | ||
| 904 | 2026.08.17 23:52:15.138533 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Reading approx. 16 rows with 2 streams | ||
| 905 | 2026.08.17 23:52:15.138543 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 906 | 2026.08.17 23:52:15.138551 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 907 | 2026.08.17 23:52:15.138647 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0)' | ||
| 908 | 2026.08.17 23:52:15.138660 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0), cpu_id Int64 Int64(size = 0)' | ||
| 909 | 2026.08.17 23:52:15.139360 [ 430365 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> AggregatingTransform: Aggregating | ||
| 910 | 2026.08.17 23:52:15.139362 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> AggregatingTransform: Aggregating | ||
| 911 | 2026.08.17 23:52:15.140579 [ 430365 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: An entry for key=1559201803930241434 found in cache: sum_of_sizes=8, median_size=8 | ||
| 912 | 2026.08.17 23:52:15.140586 [ 430365 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: Aggregation method: key64 | ||
| 913 | 2026.08.17 23:52:15.140587 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: An entry for key=1559201803930241434 found in cache: sum_of_sizes=8, median_size=8 | ||
| 914 | 2026.08.17 23:52:15.140595 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: Aggregation method: key64 | ||
| 915 | 2026.08.17 23:52:15.140595 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Part all_1_1_0 committed to zookeeper | ||
| 916 | 2026.08.17 23:52:15.140621 [ 430365 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> AggregatingTransform: Aggregated. 8 to 8 rows (from 136.00 B) in 0.002022151 sec. (3956.183 rows/sec., 65.68 KiB/sec.) | ||
| 917 | 2026.08.17 23:52:15.140625 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> AggregatingTransform: Aggregated. 8 to 8 rows (from 136.00 B) in 0.002030392 sec. (3940.126 rows/sec., 65.41 KiB/sec.) | ||
| 918 | 2026.08.17 23:52:15.140628 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: Merging aggregated data | ||
| 919 | 2026.08.17 23:52:15.140630 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Fetched part all_1_1_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/3 | ||
| 920 | 2026.08.17 23:52:15.140632 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: Statistics updated for key=1559201803930241434: new sum_of_sizes=16, median_size=8 | ||
| 921 | 2026.08.17 23:52:15.140724 [ 424348 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=72970070016, merge_with_ttl_allowedtrue) | ||
| 922 | 2026.08.17 23:52:15.140738 [ 424348 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 10213ms | ||
| 923 | 2026.08.17 23:52:15.140856 [ 430365 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> AggregatingTransform: Aggregating | ||
| 924 | 2026.08.17 23:52:15.140861 [ 430365 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: An entry for key=11757313445726935263 found in cache: sum_of_sizes=8, median_size=8 | ||
| 925 | 2026.08.17 23:52:15.140863 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> AggregatingTransform: Aggregating | ||
| 926 | 2026.08.17 23:52:15.140864 [ 430365 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: Aggregation method: key64 | ||
| 927 | 2026.08.17 23:52:15.140869 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: An entry for key=11757313445726935263 found in cache: sum_of_sizes=8, median_size=8 | ||
| 928 | 2026.08.17 23:52:15.140885 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: Aggregation method: key64 | ||
| 929 | 2026.08.17 23:52:15.140900 [ 430365 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> AggregatingTransform: Aggregated. 16 to 8 rows (from 416.00 B) in 0.002635362 sec. (6071.272 rows/sec., 154.15 KiB/sec.) | ||
| 930 | 2026.08.17 23:52:15.140902 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> AggregatingTransform: Aggregated. 16 to 8 rows (from 416.00 B) in 0.002640032 sec. (6060.533 rows/sec., 153.88 KiB/sec.) | ||
| 931 | 2026.08.17 23:52:15.140912 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: Merging aggregated data | ||
| 932 | 2026.08.17 23:52:15.140915 [ 429499 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> Aggregator: Statistics updated for key=11757313445726935263: new sum_of_sizes=16, median_size=8 | ||
| 933 | 2026.08.17 23:52:15.141820 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> executeQuery: Read 48 rows, 3.39 KiB in 0.010884 sec., 4410.1433296582145 rows/sec., 311.52 KiB/sec. | ||
| 934 | 2026.08.17 23:52:15.143987 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Trace> HashJoin: (0x7f4479536298) Join data is being destroyed, 12800 bytes and 16 rows in hash table | ||
| 935 | 2026.08.17 23:52:15.144096 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> MemoryTracker: Peak memory usage (for query): 230.69 KiB. | ||
| 936 | 2026.08.17 23:52:15.144101 [ 423967 ] {85dc8ecf-7ff5-42cf-a4d1-5f417b6581b3} <Debug> TCPHandler: Processed in 0.01329017 sec. | ||
| 937 | 2026.08.17 23:52:15.144526 [ 423967 ] {} <Trace> TCP-Session: 96093916-4a2e-42d4-9d27-a5a734b1d1da Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 938 | 2026.08.17 23:52:15.144587 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> executeQuery: Query span trace_id for opentelemetry log: 42db585c-3ddf-817b-b20f-7ded7a2357bf | ||
| 939 | 2026.08.17 23:52:15.144697 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Debug> executeQuery: (from [::1]:41600) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND ((greater(timestamp, '2000-01-01 00:00:00.000000000') AND timeseries_key IN (462795175800602962,2318161133194800099,3810615656589673070,5210923722195156639,5419464027902213652,6772052453391040098,7613129139487427710,11185254949005441257,11365707485692726787,11873430000991232922,12428098974121224233,13097606626804240593,15203798703989247109,15279762139926950523,15520859351690753739,15994013491234619255))) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 (stage: Complete) | ||
| 940 | 2026.08.17 23:52:15.145062 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 | ||
| 941 | 2026.08.17 23:52:15.145274 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 | ||
| 942 | 2026.08.17 23:52:15.145446 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 | ||
| 943 | 2026.08.17 23:52:15.145459 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timestamp > '2000-01-01 00:00:00.000000000') AND (timeseries_key IN (462795175800602962, 2318161133194800099, 3810615656589673070, 5210923722195156639, 5419464027902213652, 6772052453391040098, 7613129139487427710, 11185254949005441257, 11365707485692726787, 11873430000991232922, 12428098974121224233, 13097606626804240593, 15203798703989247109, 15279762139926950523, 15520859351690753739, 15994013491234619255)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE | ||
| 944 | 2026.08.17 23:52:15.145590 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local | ||
| 945 | 2026.08.17 23:52:15.145620 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 946 | 2026.08.17 23:52:15.145657 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 947 | 2026.08.17 23:52:15.145776 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Key condition: (column 3 in ('946684800', +Inf)), (column 1 in 16-element set), and, (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and | ||
| 948 | 2026.08.17 23:52:15.145838 [ 430357 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Used generic exclusion search over index for part all_1_1_0 with 1 steps | ||
| 949 | 2026.08.17 23:52:15.145841 [ 430354 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps | ||
| 950 | 2026.08.17 23:52:15.147578 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges | ||
| 951 | 2026.08.17 23:52:15.147590 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Spreading ranges among streams with order | ||
| 952 | 2026.08.17 23:52:15.147667 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 3 steps: "greater(timestamp, '2000-01-01 00:00:00.000000000')", "in(timeseries_key, (462795175800602962, 2318161133194800099, 3810615656589673070, 5210923722195156639, 5419464027902213652, 6772052453391040098, 7613129139487427710, 11185254949005441257, 11365707485692726787, 11873430000991232922, 12428098974121224233, 13097606626804240593, 15203798703989247109, 15279762139926950523, 15520859351690753739, 15994013491234619255))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 953 | 2026.08.17 23:52:15.147674 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_1_1_0, approx. 400 rows starting from 0 | ||
| 954 | 2026.08.17 23:52:15.147709 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 3 steps: "greater(timestamp, '2000-01-01 00:00:00.000000000')", "in(timeseries_key, (462795175800602962, 2318161133194800099, 3810615656589673070, 5210923722195156639, 5419464027902213652, 6772052453391040098, 7613129139487427710, 11185254949005441257, 11365707485692726787, 11873430000991232922, 12428098974121224233, 13097606626804240593, 15203798703989247109, 15279762139926950523, 15520859351690753739, 15994013491234619255))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 955 | 2026.08.17 23:52:15.147717 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 | ||
| 956 | 2026.08.17 23:52:15.148354 [ 430365 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Debug> MergingSortedTransform: Merge sorted 1 blocks, 800 rows in 0 sec. | ||
| 957 | 2026.08.17 23:52:15.148602 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Debug> executeQuery: Read 800 rows, 51.56 KiB in 0.003998 sec., 200100.05002501252 rows/sec., 12.59 MiB/sec. | ||
| 958 | 2026.08.17 23:52:15.148713 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Debug> MemoryTracker: Peak memory usage (for query): 253.54 KiB. | ||
| 959 | 2026.08.17 23:52:15.148716 [ 423967 ] {f050d4b4-9800-498e-b21d-d671d1a080a3} <Debug> TCPHandler: Processed in 0.004302693 sec. | ||
| 960 | 2026.08.17 23:52:15.666503 [ 424300 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000002 - log-0000000002 | ||
| 961 | 2026.08.17 23:52:15.687281 [ 424300 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_2_2_0] | ||
| 962 | 2026.08.17 23:52:15.687295 [ 424300 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 963 | 2026.08.17 23:52:15.703843 [ 424411 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000002 - log-0000000002 | ||
| 964 | 2026.08.17 23:52:15.703965 [ 424469 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreePartCheckThread): Enqueueing all_2_2_0 for check after after 0s | ||
| 965 | 2026.08.17 23:52:15.704002 [ 424469 ] {} <Information> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Code: 234. DB::Exception: No active replica has part all_2_2_0 or covering part (cannot execute queue-0000000002: GET_PART with virtual parts [all_2_2_0]). (NO_REPLICA_HAS_PART) | ||
| 966 | 2026.08.17 23:52:15.704004 [ 424409 ] {} <Information> oximeter.fields_i64_local (ReplicatedMergeTreePartCheckThread): Checking part all_2_2_0 | ||
| 967 | 2026.08.17 23:52:15.707184 [ 424409 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreePartCheckThread): Part all_2_2_0 in zookeeper: false, locally: false | ||
| 968 | 2026.08.17 23:52:15.707193 [ 424409 ] {} <Information> oximeter.fields_i64_local (ReplicatedMergeTreePartCheckThread): Checking if anyone has a part all_2_2_0 or covering part. | ||
| 969 | 2026.08.17 23:52:15.710515 [ 424411 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_2_2_0] | ||
| 970 | 2026.08.17 23:52:15.710529 [ 424411 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 971 | 2026.08.17 23:52:15.716973 [ 424409 ] {} <Information> oximeter.fields_i64_local (ReplicatedMergeTreePartCheckThread): Found the missing part all_2_2_0 at all_2_2_0 on 3 | ||
| 972 | 2026.08.17 23:52:15.720549 [ 424488 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Fetching part all_2_2_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3 | ||
| 973 | 2026.08.17 23:52:15.720645 [ 424488 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F3&part=all_2_2_0&client_protocol_version=8&compress=false | ||
| 974 | 2026.08.17 23:52:15.720962 [ 424488 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 975 | 2026.08.17 23:52:15.720982 [ 424488 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 135.90 GiB. | ||
| 976 | 2026.08.17 23:52:15.720987 [ 424488 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 977 | 2026.08.17 23:52:15.720997 [ 424488 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Downloading part all_2_2_0 onto disk default. | ||
| 978 | 2026.08.17 23:52:15.721525 [ 424488 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Download of part all_2_2_0 onto disk default finished. | ||
| 979 | 2026.08.17 23:52:15.723163 [ 424488 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Renaming temporary part tmp-fetch_all_2_2_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 980 | 2026.08.17 23:52:15.723205 [ 424488 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Committing part all_2_2_0 to zookeeper | ||
| 981 | 2026.08.17 23:52:15.731176 [ 424488 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Part all_2_2_0 committed to zookeeper | ||
| 982 | 2026.08.17 23:52:15.731202 [ 424488 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Fetched part all_2_2_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3 | ||
| 983 | 2026.08.17 23:52:15.731269 [ 424290 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=72961632256, merge_with_ttl_allowedtrue) | ||
| 984 | 2026.08.17 23:52:15.731279 [ 424290 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 13911ms | ||
| 985 | 2026.08.17 23:52:16.001689 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 413.96 MiB, peak 414.22 MiB, free memory in arenas 54.74 MiB, will set to 415.26 MiB (RSS), difference: 1.31 MiB | ||
| 986 | 2026.08.17 23:52:16.041907 [ 425082 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' | ||
| 987 | 2026.08.17 23:52:16.043073 [ 425082 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration | ||
| 988 | 2026.08.17 23:52:16.043393 [ 425082 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration | ||
| 989 | 2026.08.17 23:52:16.044061 [ 425080 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' | ||
| 990 | 2026.08.17 23:52:16.044437 [ 425080 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration | ||
| 991 | 2026.08.17 23:52:16.044728 [ 425080 ] {} <Information> Application: Setting max_server_memory_usage was set to 27.67 GiB (30.74 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) | ||
| 992 | 2026.08.17 23:52:16.044732 [ 425080 ] {} <Information> Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.37 GiB (30.74 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) | ||
| 993 | 2026.08.17 23:52:16.044734 [ 425080 ] {} <Information> Application: Merges and mutations memory limit is set to 15.37 GiB | ||
| 994 | 2026.08.17 23:52:16.044874 [ 425080 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor | ||
| 995 | 2026.08.17 23:52:16.046436 [ 425080 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor | ||
| 996 | 2026.08.17 23:52:16.046444 [ 425080 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor | ||
| 997 | 2026.08.17 23:52:16.046446 [ 425080 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor | ||
| 998 | 2026.08.17 23:52:16.046464 [ 425080 ] {} <Information> ZooKeeperClient: Finalizing session 5. finalization_started: false, queue_finished: false, reason: 'Config changed' | ||
| 999 | 2026.08.17 23:52:16.046501 [ 425080 ] {} <Trace> oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 1000 | 2026.08.17 23:52:16.046516 [ 425080 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 1001 | 2026.08.17 23:52:16.046536 [ 425080 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 1002 | 2026.08.17 23:52:16.046542 [ 425080 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 1003 | 2026.08.17 23:52:16.046558 [ 425080 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 1004 | 2026.08.17 23:52:16.046564 [ 424320 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. | ||
| 1005 | 2026.08.17 23:52:16.046563 [ 424333 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. | ||
| 1006 | 2026.08.17 23:52:16.046597 [ 424320 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/2/is_active since session has been expired | ||
| 1007 | 2026.08.17 23:52:16.046608 [ 424320 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Waiting for threads to finish | ||
| 1008 | 2026.08.17 23:52:16.046610 [ 424333 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/2/is_active since session has been expired | ||
| 1009 | 2026.08.17 23:52:16.046618 [ 424333 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Waiting for threads to finish | ||
| 1010 | 2026.08.17 23:52:16.046568 [ 424325 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. | ||
| 1011 | 2026.08.17 23:52:16.046613 [ 424367 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. | ||
| 1012 | 2026.08.17 23:52:16.046637 [ 424325 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/2/is_active since session has been expired | ||
| 1013 | 2026.08.17 23:52:16.046644 [ 424325 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Waiting for threads to finish | ||
| 1014 | 2026.08.17 23:52:16.046640 [ 424367 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/2/is_active since session has been expired | ||
| 1015 | 2026.08.17 23:52:16.046579 [ 424318 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. | ||
| 1016 | 2026.08.17 23:52:16.046650 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 1017 | 2026.08.17 23:52:16.046657 [ 424318 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/is_active since session has been expired | ||
| 1018 | 2026.08.17 23:52:16.046650 [ 424367 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Waiting for threads to finish | ||
| 1019 | 2026.08.17 23:52:16.046661 [ 424318 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Waiting for threads to finish | ||
| 1020 | 2026.08.17 23:52:16.046776 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 1021 | 2026.08.17 23:52:16.046798 [ 424320 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Threads finished | ||
| 1022 | 2026.08.17 23:52:16.046828 [ 424333 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Threads finished | ||
| 1023 | 2026.08.17 23:52:16.046852 [ 425085 ] {} <Information> DDLWorker: Lost ZooKeeper connection, will try to connect again: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1024 | |||
| 1025 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1026 | 1. DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1027 | 2. Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1028 | 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1029 | 4. Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function<void (Coordination::ListResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x00000000138481b1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1030 | 5. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f728e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1031 | 6. zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f6d96 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1032 | 7. zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f7a7b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1033 | 8. zkutil::ZooKeeper::tryGetChildren(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::ListRequestType) @ 0x00000000137f75ff in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1034 | 9. DB::DDLWorker::scheduleTasks(bool) @ 0x00000000116ee6b7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1035 | 10. DB::DDLWorker::runMainThread() @ 0x00000000116e75be in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1036 | 11. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1037 | 12. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1038 | 13. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1039 | 14. ? @ 0x00007f44aa744890 in ? | ||
| 1040 | (version 23.8.7.24 (official build)) | ||
| 1041 | 2026.08.17 23:52:16.046923 [ 424367 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Threads finished | ||
| 1042 | 2026.08.17 23:52:16.046992 [ 424318 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Threads finished | ||
| 1043 | 2026.08.17 23:52:16.046968 [ 424398 ] {} <Error> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1044 | |||
| 1045 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1046 | 1. DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1047 | 2. Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1048 | 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1049 | 4. Coordination::ZooKeeper::get(String const&, std::function<void (Coordination::GetResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x0000000013847605 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1050 | 5. zkutil::ZooKeeper::getImpl(String const&, String&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>) @ 0x00000000137fa0bb in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1051 | 6. zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>, Coordination::Error*) @ 0x00000000137fa7df in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1052 | 7. zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::Error*) @ 0x00000000137fa6c8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1053 | 8. zkutil::ZooKeeper::get(String const&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&) @ 0x00000000137fa518 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1054 | 9. DB::ReplicatedMergeTreeQueue::pullLogsToQueue(std::shared_ptr<zkutil::ZooKeeper>, std::function<void (Coordination::WatchResponse const&)>, DB::ReplicatedMergeTreeQueue::PullLogsReason) @ 0x0000000012eddcf5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1055 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000001289d59f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1056 | 11. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1057 | 12. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1058 | 13. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1059 | 14. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1060 | 15. ? @ 0x00007f44aa744890 in ? | ||
| 1061 | (version 23.8.7.24 (official build)) | ||
| 1062 | 2026.08.17 23:52:16.047051 [ 424314 ] {} <Error> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1063 | |||
| 1064 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1065 | 1. DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1066 | 2. Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1067 | 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1068 | 4. Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function<void (Coordination::ListResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x00000000138481b1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1069 | 5. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f728e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1070 | 6. zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f6d96 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1071 | 7. zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f7a7b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1072 | 8. zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f7971 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1073 | 9. DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr<zkutil::ZooKeeper>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x0000000012ee47c8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1074 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_2, void ()>>(std::__function::__policy_storage const*) @ 0x000000001289dec0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1075 | 11. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1076 | 12. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1077 | 13. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1078 | 14. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1079 | 15. ? @ 0x00007f44aa744890 in ? | ||
| 1080 | (version 23.8.7.24 (official build)) | ||
| 1081 | 2026.08.17 23:52:16.047153 [ 424325 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Threads finished | ||
| 1082 | 2026.08.17 23:52:16.052427 [ 432308 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:53874, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) | ||
| 1083 | 2026.08.17 23:52:16.052476 [ 432308 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F2&part=all_2_2_0&client_protocol_version=8&compress=false | ||
| 1084 | 2026.08.17 23:52:16.052485 [ 432308 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Replicated PartsService): Sending part all_2_2_0 | ||
| 1085 | 2026.08.17 23:52:16.052723 [ 432308 ] {} <Debug> InterserverIOHTTPHandler: Done processing query | ||
| 1086 | 2026.08.17 23:52:16.054894 [ 425080 ] {} <Information> ZooKeeperClient: Connected to ZooKeeper at [::1]:19001 with session_id 11 | ||
| 1087 | 2026.08.17 23:52:16.054994 [ 425080 ] {} <Information> ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled | ||
| 1088 | 2026.08.17 23:52:16.054999 [ 425080 ] {} <Information> ZooKeeperClient: Keeper feature flag MULTI_READ: enabled | ||
| 1089 | 2026.08.17 23:52:16.055001 [ 425080 ] {} <Information> ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled | ||
| 1090 | 2026.08.17 23:52:16.055004 [ 425080 ] {} <Trace> ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19003 | ||
| 1091 | 2026.08.17 23:52:16.055018 [ 424320 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 1092 | 2026.08.17 23:52:16.055025 [ 424333 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 1093 | 2026.08.17 23:52:16.055031 [ 424367 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 1094 | 2026.08.17 23:52:16.055039 [ 424325 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 1095 | 2026.08.17 23:52:16.055034 [ 424318 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 1096 | 2026.08.17 23:52:16.055053 [ 425080 ] {} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1 | ||
| 1097 | 2026.08.17 23:52:16.055060 [ 425080 ] {} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1 | ||
| 1098 | 2026.08.17 23:52:16.055179 [ 425080 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. | ||
| 1099 | 2026.08.17 23:52:16.055186 [ 425080 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-642120957f655e64-test_cluster.423860.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration | ||
| 1100 | 2026.08.17 23:52:16.071958 [ 424367 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 1101 | 2026.08.17 23:52:16.071958 [ 424318 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 1102 | 2026.08.17 23:52:16.071963 [ 424320 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 1103 | 2026.08.17 23:52:16.072009 [ 424325 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 1104 | 2026.08.17 23:52:16.072028 [ 424333 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 1105 | 2026.08.17 23:52:16.072033 [ 424318 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 1106 | 2026.08.17 23:52:16.072037 [ 424367 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 1107 | 2026.08.17 23:52:16.072043 [ 424320 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 1108 | 2026.08.17 23:52:16.072046 [ 424320 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue | ||
| 1109 | 2026.08.17 23:52:16.072047 [ 424367 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue | ||
| 1110 | 2026.08.17 23:52:16.072037 [ 424318 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue | ||
| 1111 | 2026.08.17 23:52:16.072075 [ 424333 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Queue initialized | ||
| 1112 | 2026.08.17 23:52:16.072076 [ 424325 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 1113 | 2026.08.17 23:52:16.072078 [ 424333 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue | ||
| 1114 | 2026.08.17 23:52:16.072085 [ 424325 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue | ||
| 1115 | 2026.08.17 23:52:16.072106 [ 424320 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 1116 | 2026.08.17 23:52:16.072109 [ 424367 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 1117 | 2026.08.17 23:52:16.072133 [ 424318 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 1118 | 2026.08.17 23:52:16.072139 [ 424333 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 1119 | 2026.08.17 23:52:16.072147 [ 424325 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded. | ||
| 1120 | 2026.08.17 23:52:16.072165 [ 424320 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 1121 | 2026.08.17 23:52:16.072172 [ 424367 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 1122 | 2026.08.17 23:52:16.072182 [ 424318 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 1123 | 2026.08.17 23:52:16.072196 [ 424333 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Loaded queue | ||
| 1124 | 2026.08.17 23:52:16.072214 [ 424325 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_2_2_0] | ||
| 1125 | 2026.08.17 23:52:16.072270 [ 424325 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 1126 | 2026.08.17 23:52:16.072520 [ 424320 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 1127 | 2026.08.17 23:52:16.072526 [ 424318 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 1128 | 2026.08.17 23:52:16.072606 [ 424363 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73253259264, merge_with_ttl_allowedtrue) | ||
| 1129 | 2026.08.17 23:52:16.072608 [ 424318 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73253259264, merge_with_ttl_allowedtrue) | ||
| 1130 | 2026.08.17 23:52:16.073854 [ 424363 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 10220ms | ||
| 1131 | 2026.08.17 23:52:16.072667 [ 424322 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73253259264, merge_with_ttl_allowedtrue) | ||
| 1132 | 2026.08.17 23:52:16.073866 [ 424318 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 13451ms | ||
| 1133 | 2026.08.17 23:52:16.072701 [ 424333 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 1134 | 2026.08.17 23:52:16.072727 [ 424345 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 7581ms | ||
| 1135 | 2026.08.17 23:52:16.072807 [ 424325 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 1136 | 2026.08.17 23:52:16.072848 [ 424377 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/timeseries_schema_local/blocks | ||
| 1137 | 2026.08.17 23:52:16.072891 [ 424365 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks | ||
| 1138 | 2026.08.17 23:52:16.072897 [ 424371 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (3 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks | ||
| 1139 | 2026.08.17 23:52:16.072913 [ 424392 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73253259264, merge_with_ttl_allowedtrue) | ||
| 1140 | 2026.08.17 23:52:16.072984 [ 424356 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 4250ms, ratio: 0, points per minute: 0) | ||
| 1141 | 2026.08.17 23:52:16.073011 [ 424393 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (3 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks | ||
| 1142 | 2026.08.17 23:52:16.073034 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Fetching part all_2_2_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 | ||
| 1143 | 2026.08.17 23:52:16.072685 [ 424367 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 1144 | 2026.08.17 23:52:16.073873 [ 424322 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 17724ms | ||
| 1145 | 2026.08.17 23:52:16.073937 [ 424392 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 12366ms | ||
| 1146 | 2026.08.17 23:52:16.074079 [ 424377 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 3031ms, ratio: 0, points per minute: 0) | ||
| 1147 | 2026.08.17 23:52:16.074104 [ 424465 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_2_2_0&client_protocol_version=8&compress=false | ||
| 1148 | 2026.08.17 23:52:16.074124 [ 424371 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 3294ms, ratio: 0, points per minute: 0) | ||
| 1149 | 2026.08.17 23:52:16.074123 [ 424365 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 3933ms, ratio: 0, points per minute: 0) | ||
| 1150 | 2026.08.17 23:52:16.074182 [ 424393 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 3601ms, ratio: 0, points per minute: 0) | ||
| 1151 | 2026.08.17 23:52:16.074442 [ 424465 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 1152 | 2026.08.17 23:52:16.074455 [ 424465 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.44 GiB. | ||
| 1153 | 2026.08.17 23:52:16.074459 [ 424465 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 1154 | 2026.08.17 23:52:16.074465 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Downloading part all_2_2_0 onto disk default. | ||
| 1155 | 2026.08.17 23:52:16.074870 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Download of part all_2_2_0 onto disk default finished. | ||
| 1156 | 2026.08.17 23:52:16.074880 [ 424465 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Renaming temporary part tmp-fetch_all_2_2_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 1157 | 2026.08.17 23:52:16.074905 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Committing part all_2_2_0 to zookeeper | ||
| 1158 | 2026.08.17 23:52:16.078734 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Part all_2_2_0 committed to zookeeper | ||
| 1159 | 2026.08.17 23:52:16.078757 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Fetched part all_2_2_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 | ||
| 1160 | 2026.08.17 23:52:16.078799 [ 424351 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73253142528, merge_with_ttl_allowedtrue) | ||
| 1161 | 2026.08.17 23:52:16.078810 [ 424351 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 16059ms | ||
| 1162 | 2026.08.17 23:52:16.831751 [ 424331 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000003 - log-0000000003 | ||
| 1163 | 2026.08.17 23:52:16.839087 [ 424331 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000003 to queue with type GET_PART with virtual parts [all_3_3_0] | ||
| 1164 | 2026.08.17 23:52:16.839094 [ 424331 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 1165 | 2026.08.17 23:52:16.839285 [ 424490 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Fetching part all_3_3_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 | ||
| 1166 | 2026.08.17 23:52:16.839354 [ 424490 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_3_3_0&client_protocol_version=8&compress=false | ||
| 1167 | 2026.08.17 23:52:16.839658 [ 424490 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 1168 | 2026.08.17 23:52:16.839667 [ 424490 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.45 GiB. | ||
| 1169 | 2026.08.17 23:52:16.839671 [ 424490 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 1170 | 2026.08.17 23:52:16.839677 [ 424490 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Downloading part all_3_3_0 onto disk default. | ||
| 1171 | 2026.08.17 23:52:16.841885 [ 424490 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Download of part all_3_3_0 onto disk default finished. | ||
| 1172 | 2026.08.17 23:52:16.841898 [ 424490 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Renaming temporary part tmp-fetch_all_3_3_0 to all_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 1173 | 2026.08.17 23:52:16.841927 [ 424490 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Committing part all_3_3_0 to zookeeper | ||
| 1174 | 2026.08.17 23:52:16.849348 [ 424490 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Part all_3_3_0 committed to zookeeper | ||
| 1175 | 2026.08.17 23:52:16.849370 [ 424490 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Fetched part all_3_3_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 | ||
| 1176 | 2026.08.17 23:52:16.849391 [ 424353 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73254184960, merge_with_ttl_allowedtrue) | ||
| 1177 | 2026.08.17 23:52:16.849397 [ 424353 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 20495ms | ||
| 1178 | 2026.08.17 23:52:16.862062 [ 424343 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000003 - log-0000000003 | ||
| 1179 | 2026.08.17 23:52:16.868638 [ 424343 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000003 to queue with type GET_PART with virtual parts [all_3_3_0] | ||
| 1180 | 2026.08.17 23:52:16.868647 [ 424343 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 1181 | 2026.08.17 23:52:16.868792 [ 424469 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Fetching part all_3_3_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3 | ||
| 1182 | 2026.08.17 23:52:16.868879 [ 424469 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F3&part=all_3_3_0&client_protocol_version=8&compress=false | ||
| 1183 | 2026.08.17 23:52:16.869185 [ 424469 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 1184 | 2026.08.17 23:52:16.869201 [ 424469 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.45 GiB. | ||
| 1185 | 2026.08.17 23:52:16.869205 [ 424469 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 1186 | 2026.08.17 23:52:16.869213 [ 424469 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Downloading part all_3_3_0 onto disk default. | ||
| 1187 | 2026.08.17 23:52:16.869640 [ 424469 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Download of part all_3_3_0 onto disk default finished. | ||
| 1188 | 2026.08.17 23:52:16.871166 [ 424469 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Renaming temporary part tmp-fetch_all_3_3_0 to all_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 1189 | 2026.08.17 23:52:16.871193 [ 424469 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Committing part all_3_3_0 to zookeeper | ||
| 1190 | 2026.08.17 23:52:16.875382 [ 424469 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Part all_3_3_0 committed to zookeeper | ||
| 1191 | 2026.08.17 23:52:16.875403 [ 424469 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Fetched part all_3_3_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3 | ||
| 1192 | 2026.08.17 23:52:16.875431 [ 424309 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73253824512, merge_with_ttl_allowedtrue) | ||
| 1193 | 2026.08.17 23:52:16.875440 [ 424309 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 23194ms | ||
| 1194 | 2026.08.17 23:52:16.892061 [ 424352 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000002 - log-0000000002 | ||
| 1195 | 2026.08.17 23:52:16.892619 [ 423966 ] {} <Trace> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 1196 | 2026.08.17 23:52:16.892688 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> executeQuery: Query span trace_id for opentelemetry log: 74f3d7ee-b026-338f-690c-5191aa969a8b | ||
| 1197 | 2026.08.17 23:52:16.892759 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Debug> executeQuery: (from [::1]:41598) SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name IN ('virtual_machine:cpu_busy') FORMAT Native (stage: Complete) | ||
| 1198 | 2026.08.17 23:52:16.893025 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 1199 | 2026.08.17 23:52:16.894639 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 1200 | 2026.08.17 23:52:16.894777 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 1201 | 2026.08.17 23:52:16.894788 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name IN ('virtual_machine:cpu_busy')" moved to PREWHERE | ||
| 1202 | 2026.08.17 23:52:16.894858 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local | ||
| 1203 | 2026.08.17 23:52:16.894886 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 1204 | 2026.08.17 23:52:16.894930 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 1205 | 2026.08.17 23:52:16.895009 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Key condition: (column 0 in 1-element set) | ||
| 1206 | 2026.08.17 23:52:16.895020 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 1207 | 2026.08.17 23:52:16.895030 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 1208 | 2026.08.17 23:52:16.895034 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 1209 | 2026.08.17 23:52:16.895038 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found continuous range in 2 steps | ||
| 1210 | 2026.08.17 23:52:16.895049 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges | ||
| 1211 | 2026.08.17 23:52:16.895054 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 1212 | 2026.08.17 23:52:16.895071 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "in(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1213 | 2026.08.17 23:52:16.895076 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0 | ||
| 1214 | 2026.08.17 23:52:16.895688 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Debug> executeQuery: Read 1 rows, 126.00 B in 0.002989 sec., 334.5600535296086 rows/sec., 41.17 KiB/sec. | ||
| 1215 | 2026.08.17 23:52:16.895727 [ 423966 ] {bad11966-a0a3-436d-993f-e0d85adb4988} <Debug> TCPHandler: Processed in 0.003202302 sec. | ||
| 1216 | 2026.08.17 23:52:16.896330 [ 423966 ] {} <Trace> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 1217 | 2026.08.17 23:52:16.897320 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> executeQuery: Query span trace_id for opentelemetry log: 810fbefb-2c8f-f4c8-bfc1-73f7f4c2b25d | ||
| 1218 | 2026.08.17 23:52:16.897380 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Debug> executeQuery: (from [::1]:41598) SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name IN ('virtual_machine:cpu_busy') FORMAT Native (stage: Complete) | ||
| 1219 | 2026.08.17 23:52:16.897538 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 1220 | 2026.08.17 23:52:16.897631 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema | ||
| 1221 | 2026.08.17 23:52:16.897719 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 1222 | 2026.08.17 23:52:16.897726 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name IN ('virtual_machine:cpu_busy')" moved to PREWHERE | ||
| 1223 | 2026.08.17 23:52:16.897779 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local | ||
| 1224 | 2026.08.17 23:52:16.897803 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 1225 | 2026.08.17 23:52:16.897831 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 1226 | 2026.08.17 23:52:16.897895 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Key condition: (column 0 in 1-element set) | ||
| 1227 | 2026.08.17 23:52:16.897904 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 1228 | 2026.08.17 23:52:16.897912 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 1229 | 2026.08.17 23:52:16.897915 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 1230 | 2026.08.17 23:52:16.897918 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Found continuous range in 2 steps | ||
| 1231 | 2026.08.17 23:52:16.897927 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Debug> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges | ||
| 1232 | 2026.08.17 23:52:16.897931 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 1233 | 2026.08.17 23:52:16.897944 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "in(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1234 | 2026.08.17 23:52:16.897952 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0 | ||
| 1235 | 2026.08.17 23:52:16.898245 [ 424352 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_3_3_0] | ||
| 1236 | 2026.08.17 23:52:16.898252 [ 424352 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 1237 | 2026.08.17 23:52:16.898446 [ 424488 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Fetching part all_3_3_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/3 | ||
| 1238 | 2026.08.17 23:52:16.898473 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Debug> executeQuery: Read 1 rows, 126.00 B in 0.00114 sec., 877.1929824561404 rows/sec., 107.94 KiB/sec. | ||
| 1239 | 2026.08.17 23:52:16.898503 [ 424488 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F3&part=all_3_3_0&client_protocol_version=8&compress=false | ||
| 1240 | 2026.08.17 23:52:16.898538 [ 423966 ] {df08eba2-fcb9-4219-bb9c-b42df55fcca4} <Debug> TCPHandler: Processed in 0.002277302 sec. | ||
| 1241 | 2026.08.17 23:52:16.898832 [ 423967 ] {} <Trace> TCP-Session: 96093916-4a2e-42d4-9d27-a5a734b1d1da Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 1242 | 2026.08.17 23:52:16.900436 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> executeQuery: Query span trace_id for opentelemetry log: 6c1e866e-f647-54d8-6afc-1ec726633fab | ||
| 1243 | 2026.08.17 23:52:16.900446 [ 424488 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 1244 | 2026.08.17 23:52:16.900456 [ 424488 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.45 GiB. | ||
| 1245 | 2026.08.17 23:52:16.900460 [ 424488 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 1246 | 2026.08.17 23:52:16.900468 [ 424488 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Downloading part all_3_3_0 onto disk default. | ||
| 1247 | 2026.08.17 23:52:16.900562 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> executeQuery: (from [::1]:41600) SELECT fields_i64_pivot.cpu_id AS cpu_id, fields_uuid_pivot.instance_id AS instance_id, fields_uuid_pivot.project_id AS project_id, fields_uuid_pivot.timeseries_key AS timeseries_key FROM ( SELECT timeseries_key, anyIf(field_value, field_name = 'instance_id') AS instance_id, anyIf(field_value, field_name = 'project_id') AS project_id FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' GROUP BY timeseries_key ) AS fields_uuid_pivot JOIN ( SELECT timeseries_key, anyIf(field_value, field_name = 'cpu_id') AS cpu_id FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' GROUP BY timeseries_key ) AS fields_i64_pivot ON fields_uuid_pivot.timeseries_key = fields_i64_pivot.timeseries_key (stage: Complete) | ||
| 1248 | 2026.08.17 23:52:16.900855 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 1249 | 2026.08.17 23:52:16.900929 [ 424488 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Download of part all_3_3_0 onto disk default finished. | ||
| 1250 | 2026.08.17 23:52:16.900943 [ 424488 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Renaming temporary part tmp-fetch_all_3_3_0 to all_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 1251 | 2026.08.17 23:52:16.900975 [ 424488 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Committing part all_3_3_0 to zookeeper | ||
| 1252 | 2026.08.17 23:52:16.901002 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 | ||
| 1253 | 2026.08.17 23:52:16.901132 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 1254 | 2026.08.17 23:52:16.901391 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 | ||
| 1255 | 2026.08.17 23:52:16.901499 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 | ||
| 1256 | 2026.08.17 23:52:16.901607 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 1257 | 2026.08.17 23:52:16.901614 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name = 'virtual_machine:cpu_busy'" moved to PREWHERE | ||
| 1258 | 2026.08.17 23:52:16.901670 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local | ||
| 1259 | 2026.08.17 23:52:16.901690 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 1260 | 2026.08.17 23:52:16.901720 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 1261 | 2026.08.17 23:52:16.901751 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> HashJoin: (0x7f43f01a7c98) Datatype: EMPTY, kind: Inner, strictness: All, right header: fields_i64_pivot.timeseries_key UInt64 UInt64(size = 0), cpu_id Int64 Int64(size = 0) | ||
| 1262 | 2026.08.17 23:52:16.901756 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> HashJoin: (0x7f43f01a7c98) Keys: [(timeseries_key) = (fields_i64_pivot.timeseries_key)] | ||
| 1263 | 2026.08.17 23:52:16.901921 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 1264 | 2026.08.17 23:52:16.902044 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid | ||
| 1265 | 2026.08.17 23:52:16.902153 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 0 | ||
| 1266 | 2026.08.17 23:52:16.903992 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "timeseries_name = 'virtual_machine:cpu_busy'" moved to PREWHERE | ||
| 1267 | 2026.08.17 23:52:16.904122 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local | ||
| 1268 | 2026.08.17 23:52:16.904147 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 1269 | 2026.08.17 23:52:16.904182 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 1270 | 2026.08.17 23:52:16.904185 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 1271 | 2026.08.17 23:52:16.904195 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0)' | ||
| 1272 | 2026.08.17 23:52:16.904209 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0), cpu_id Int64 Int64(size = 0)' | ||
| 1273 | 2026.08.17 23:52:16.904528 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Key condition: (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']) | ||
| 1274 | 2026.08.17 23:52:16.904597 [ 429500 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) | ||
| 1275 | 2026.08.17 23:52:16.904600 [ 430355 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 1276 | 2026.08.17 23:52:16.904608 [ 430367 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Running binary search on index range for part all_3_3_0 (2 marks) | ||
| 1277 | 2026.08.17 23:52:16.904615 [ 430355 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 1278 | 2026.08.17 23:52:16.904612 [ 429500 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 1279 | 2026.08.17 23:52:16.904627 [ 430355 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 1280 | 2026.08.17 23:52:16.904629 [ 430367 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 1281 | 2026.08.17 23:52:16.904632 [ 430355 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found continuous range in 2 steps | ||
| 1282 | 2026.08.17 23:52:16.904630 [ 429500 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 1283 | 2026.08.17 23:52:16.904635 [ 430367 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 1284 | 2026.08.17 23:52:16.904641 [ 429500 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found continuous range in 2 steps | ||
| 1285 | 2026.08.17 23:52:16.904631 [ 430364 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Running binary search on index range for part all_2_2_0 (2 marks) | ||
| 1286 | 2026.08.17 23:52:16.904646 [ 430367 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found continuous range in 2 steps | ||
| 1287 | 2026.08.17 23:52:16.904674 [ 430364 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 1288 | 2026.08.17 23:52:16.904685 [ 430364 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 1289 | 2026.08.17 23:52:16.904691 [ 430364 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Found continuous range in 2 steps | ||
| 1290 | 2026.08.17 23:52:16.904749 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Selected 4/4 parts by partition key, 4 parts by primary key, 4/4 marks by primary key, 4 marks to read from 4 ranges | ||
| 1291 | 2026.08.17 23:52:16.904758 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 1292 | 2026.08.17 23:52:16.904809 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> MergeTreeReadPool: min_marks_for_concurrent_read=24 | ||
| 1293 | 2026.08.17 23:52:16.904816 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (SelectExecutor): Reading approx. 64 rows with 4 streams | ||
| 1294 | 2026.08.17 23:52:16.904828 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1295 | 2026.08.17 23:52:16.904837 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1296 | 2026.08.17 23:52:16.904843 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1297 | 2026.08.17 23:52:16.904850 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1298 | 2026.08.17 23:52:16.904976 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Key condition: (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']) | ||
| 1299 | 2026.08.17 23:52:16.905025 [ 430358 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) | ||
| 1300 | 2026.08.17 23:52:16.905032 [ 429499 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Running binary search on index range for part all_2_2_0 (2 marks) | ||
| 1301 | 2026.08.17 23:52:16.905037 [ 430358 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 1302 | 2026.08.17 23:52:16.905042 [ 429499 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 1303 | 2026.08.17 23:52:16.905034 [ 430360 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) | ||
| 1304 | 2026.08.17 23:52:16.905033 [ 430362 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Running binary search on index range for part all_3_3_0 (2 marks) | ||
| 1305 | 2026.08.17 23:52:16.905045 [ 430358 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 1306 | 2026.08.17 23:52:16.905069 [ 430362 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 1307 | 2026.08.17 23:52:16.905056 [ 430360 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (LEFT) boundary mark: 0 | ||
| 1308 | 2026.08.17 23:52:16.905077 [ 430362 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 1309 | 2026.08.17 23:52:16.905047 [ 429499 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 1310 | 2026.08.17 23:52:16.905075 [ 430358 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found continuous range in 2 steps | ||
| 1311 | 2026.08.17 23:52:16.905087 [ 429499 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found continuous range in 2 steps | ||
| 1312 | 2026.08.17 23:52:16.905080 [ 430360 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found (RIGHT) boundary mark: 2 | ||
| 1313 | 2026.08.17 23:52:16.905082 [ 430362 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found continuous range in 2 steps | ||
| 1314 | 2026.08.17 23:52:16.905097 [ 430360 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Found continuous range in 2 steps | ||
| 1315 | 2026.08.17 23:52:16.905163 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Selected 4/4 parts by partition key, 4 parts by primary key, 4/4 marks by primary key, 4 marks to read from 4 ranges | ||
| 1316 | 2026.08.17 23:52:16.905176 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Spreading mark ranges among streams (default reading) | ||
| 1317 | 2026.08.17 23:52:16.905207 [ 424488 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Part all_3_3_0 committed to zookeeper | ||
| 1318 | 2026.08.17 23:52:16.905211 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> MergeTreeReadPool: min_marks_for_concurrent_read=24 | ||
| 1319 | 2026.08.17 23:52:16.905217 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (SelectExecutor): Reading approx. 32 rows with 4 streams | ||
| 1320 | 2026.08.17 23:52:16.905226 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1321 | 2026.08.17 23:52:16.905228 [ 424488 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Fetched part all_3_3_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/3 | ||
| 1322 | 2026.08.17 23:52:16.905234 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1323 | 2026.08.17 23:52:16.905245 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1324 | 2026.08.17 23:52:16.905253 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 1 steps: "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1325 | 2026.08.17 23:52:16.905287 [ 424382 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73253601280, merge_with_ttl_allowedtrue) | ||
| 1326 | 2026.08.17 23:52:16.905298 [ 424382 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 16368ms | ||
| 1327 | 2026.08.17 23:52:16.905352 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0)' | ||
| 1328 | 2026.08.17 23:52:16.905364 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), instance_id UUID UUID(size = 0), project_id UUID UUID(size = 0), cpu_id Int64 Int64(size = 0)' | ||
| 1329 | 2026.08.17 23:52:16.905939 [ 430354 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregating | ||
| 1330 | 2026.08.17 23:52:16.905946 [ 430368 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregating | ||
| 1331 | 2026.08.17 23:52:16.905985 [ 428932 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregating | ||
| 1332 | 2026.08.17 23:52:16.905952 [ 430354 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: An entry for key=1559201803930241434 found in cache: sum_of_sizes=16, median_size=8 | ||
| 1333 | 2026.08.17 23:52:16.905943 [ 430365 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregating | ||
| 1334 | 2026.08.17 23:52:16.906002 [ 430368 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: An entry for key=1559201803930241434 found in cache: sum_of_sizes=16, median_size=8 | ||
| 1335 | 2026.08.17 23:52:16.905999 [ 430354 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Aggregation method: key64 | ||
| 1336 | 2026.08.17 23:52:16.906010 [ 430368 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Aggregation method: key64 | ||
| 1337 | 2026.08.17 23:52:16.906011 [ 428932 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: An entry for key=1559201803930241434 found in cache: sum_of_sizes=16, median_size=8 | ||
| 1338 | 2026.08.17 23:52:16.906022 [ 428932 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Aggregation method: key64 | ||
| 1339 | 2026.08.17 23:52:16.906024 [ 430365 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: An entry for key=1559201803930241434 found in cache: sum_of_sizes=16, median_size=8 | ||
| 1340 | 2026.08.17 23:52:16.906029 [ 430365 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Aggregation method: key64 | ||
| 1341 | 2026.08.17 23:52:16.906034 [ 430354 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregated. 8 to 8 rows (from 136.00 B) in 0.00073244 sec. (10922.396 rows/sec., 181.33 KiB/sec.) | ||
| 1342 | 2026.08.17 23:52:16.906036 [ 428932 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregated. 8 to 8 rows (from 136.00 B) in 0.00073411 sec. (10897.549 rows/sec., 180.92 KiB/sec.) | ||
| 1343 | 2026.08.17 23:52:16.906044 [ 430368 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregated. 8 to 8 rows (from 136.00 B) in 0.00074108 sec. (10795.056 rows/sec., 179.21 KiB/sec.) | ||
| 1344 | 2026.08.17 23:52:16.906044 [ 430365 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregated. 8 to 8 rows (from 136.00 B) in 0.00073665 sec. (10859.974 rows/sec., 180.29 KiB/sec.) | ||
| 1345 | 2026.08.17 23:52:16.906049 [ 430365 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Merging aggregated data | ||
| 1346 | 2026.08.17 23:52:16.906053 [ 430365 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Statistics updated for key=1559201803930241434: new sum_of_sizes=32, median_size=8 | ||
| 1347 | 2026.08.17 23:52:16.906224 [ 430368 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregating | ||
| 1348 | 2026.08.17 23:52:16.906227 [ 430368 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: An entry for key=11757313445726935263 found in cache: sum_of_sizes=16, median_size=8 | ||
| 1349 | 2026.08.17 23:52:16.906229 [ 430368 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Aggregation method: key64 | ||
| 1350 | 2026.08.17 23:52:16.906234 [ 430365 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregating | ||
| 1351 | 2026.08.17 23:52:16.906237 [ 430365 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: An entry for key=11757313445726935263 found in cache: sum_of_sizes=16, median_size=8 | ||
| 1352 | 2026.08.17 23:52:16.906240 [ 430365 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Aggregation method: key64 | ||
| 1353 | 2026.08.17 23:52:16.906241 [ 430368 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregated. 16 to 8 rows (from 416.00 B) in 0.001335321 sec. (11982.138 rows/sec., 304.23 KiB/sec.) | ||
| 1354 | 2026.08.17 23:52:16.906246 [ 430365 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregated. 16 to 8 rows (from 416.00 B) in 0.001343521 sec. (11909.006 rows/sec., 302.38 KiB/sec.) | ||
| 1355 | 2026.08.17 23:52:16.906259 [ 428932 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregating | ||
| 1356 | 2026.08.17 23:52:16.906266 [ 428932 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: An entry for key=11757313445726935263 found in cache: sum_of_sizes=16, median_size=8 | ||
| 1357 | 2026.08.17 23:52:16.906266 [ 430354 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregating | ||
| 1358 | 2026.08.17 23:52:16.906273 [ 428932 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Aggregation method: key64 | ||
| 1359 | 2026.08.17 23:52:16.906279 [ 430354 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: An entry for key=11757313445726935263 found in cache: sum_of_sizes=16, median_size=8 | ||
| 1360 | 2026.08.17 23:52:16.906282 [ 430354 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Aggregation method: key64 | ||
| 1361 | 2026.08.17 23:52:16.906292 [ 430354 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregated. 16 to 8 rows (from 416.00 B) in 0.001380321 sec. (11591.507 rows/sec., 294.32 KiB/sec.) | ||
| 1362 | 2026.08.17 23:52:16.906301 [ 428932 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> AggregatingTransform: Aggregated. 16 to 8 rows (from 416.00 B) in 0.001390871 sec. (11503.583 rows/sec., 292.08 KiB/sec.) | ||
| 1363 | 2026.08.17 23:52:16.906303 [ 428932 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Merging aggregated data | ||
| 1364 | 2026.08.17 23:52:16.906307 [ 428932 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> Aggregator: Statistics updated for key=11757313445726935263: new sum_of_sizes=32, median_size=8 | ||
| 1365 | 2026.08.17 23:52:16.906630 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> executeQuery: Read 96 rows, 6.78 KiB in 0.006172 sec., 15554.115359688916 rows/sec., 1.07 MiB/sec. | ||
| 1366 | 2026.08.17 23:52:16.906815 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Trace> HashJoin: (0x7f43f01a7c98) Join data is being destroyed, 12800 bytes and 24 rows in hash table | ||
| 1367 | 2026.08.17 23:52:16.906955 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> MemoryTracker: Peak memory usage (for query): 335.55 KiB. | ||
| 1368 | 2026.08.17 23:52:16.906958 [ 423967 ] {b05aacc4-54a3-492e-a9b9-ba78b3b379ba} <Debug> TCPHandler: Processed in 0.008177996 sec. | ||
| 1369 | 2026.08.17 23:52:16.907279 [ 423967 ] {} <Trace> TCP-Session: 96093916-4a2e-42d4-9d27-a5a734b1d1da Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 1370 | 2026.08.17 23:52:16.907336 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> executeQuery: Query span trace_id for opentelemetry log: e9121347-1d31-da5b-c7a6-74a4d8fe768b | ||
| 1371 | 2026.08.17 23:52:16.907451 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Debug> executeQuery: (from [::1]:41600) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND ((greater(timestamp, '2000-01-01 00:00:00.000000000') AND timeseries_key IN (462795175800602962,2318161133194800099,3810615656589673070,5210923722195156639,5419464027902213652,6772052453391040098,7613129139487427710,9406430691007220535,11185254949005441257,11365707485692726787,11873430000991232922,12428098974121224233,13097606626804240593,13412992881554994937,13674246925771883735,13850886821849078558,15203798703989247109,15228222593821303909,15279762139926950523,15515585004882416385,15520859351690753739,15768325978800699421,15994013491234619255,16524397771145742832))) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 (stage: Complete) | ||
| 1372 | 2026.08.17 23:52:16.907757 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 | ||
| 1373 | 2026.08.17 23:52:16.907952 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 | ||
| 1374 | 2026.08.17 23:52:16.908124 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 | ||
| 1375 | 2026.08.17 23:52:16.908135 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timestamp > '2000-01-01 00:00:00.000000000') AND (timeseries_key IN (462795175800602962, 2318161133194800099, 3810615656589673070, 5210923722195156639, 5419464027902213652, 6772052453391040098, 7613129139487427710, 9406430691007220535, 11185254949005441257, 11365707485692726787, 11873430000991232922, 12428098974121224233, 13097606626804240593, 13412992881554994937, 13674246925771883735, 13850886821849078558, 15203798703989247109, 15228222593821303909, 15279762139926950523, 15515585004882416385, 15520859351690753739, 15768325978800699421, 15994013491234619255, 16524397771145742832)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE | ||
| 1376 | 2026.08.17 23:52:16.908276 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local | ||
| 1377 | 2026.08.17 23:52:16.908304 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 1378 | 2026.08.17 23:52:16.908340 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> InterpreterSelectQuery: Complete -> Complete | ||
| 1379 | 2026.08.17 23:52:16.908447 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Key condition: (column 3 in ('946684800', +Inf)), (column 1 in 24-element set), and, (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and | ||
| 1380 | 2026.08.17 23:52:16.908499 [ 430368 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Used generic exclusion search over index for part all_3_3_0 with 1 steps | ||
| 1381 | 2026.08.17 23:52:16.908498 [ 430357 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps | ||
| 1382 | 2026.08.17 23:52:16.908511 [ 430362 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Used generic exclusion search over index for part all_1_1_0 with 1 steps | ||
| 1383 | 2026.08.17 23:52:16.908577 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Selected 3/3 parts by partition key, 3 parts by primary key, 3/3 marks by primary key, 3 marks to read from 3 ranges | ||
| 1384 | 2026.08.17 23:52:16.908588 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (SelectExecutor): Spreading ranges among streams with order | ||
| 1385 | 2026.08.17 23:52:16.908696 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 3 steps: "greater(timestamp, '2000-01-01 00:00:00.000000000')", "in(timeseries_key, (462795175800602962, 2318161133194800099, 3810615656589673070, 5210923722195156639, 5419464027902213652, 6772052453391040098, 7613129139487427710, 9406430691007220535, 11185254949005441257, 11365707485692726787, 11873430000991232922, 12428098974121224233, 13097606626804240593, 13412992881554994937, 13674246925771883735, 13850886821849078558, 15203798703989247109, 15228222593821303909, 15279762139926950523, 15515585004882416385, 15520859351690753739, 15768325978800699421, 15994013491234619255, 16524397771145742832))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1386 | 2026.08.17 23:52:16.908715 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_3_3_0, approx. 400 rows starting from 0 | ||
| 1387 | 2026.08.17 23:52:16.908756 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 3 steps: "greater(timestamp, '2000-01-01 00:00:00.000000000')", "in(timeseries_key, (462795175800602962, 2318161133194800099, 3810615656589673070, 5210923722195156639, 5419464027902213652, 6772052453391040098, 7613129139487427710, 9406430691007220535, 11185254949005441257, 11365707485692726787, 11873430000991232922, 12428098974121224233, 13097606626804240593, 13412992881554994937, 13674246925771883735, 13850886821849078558, 15203798703989247109, 15228222593821303909, 15279762139926950523, 15515585004882416385, 15520859351690753739, 15768325978800699421, 15994013491234619255, 16524397771145742832))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1388 | 2026.08.17 23:52:16.908763 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_1_1_0, approx. 400 rows starting from 0 | ||
| 1389 | 2026.08.17 23:52:16.908796 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 3 steps: "greater(timestamp, '2000-01-01 00:00:00.000000000')", "in(timeseries_key, (462795175800602962, 2318161133194800099, 3810615656589673070, 5210923722195156639, 5419464027902213652, 6772052453391040098, 7613129139487427710, 9406430691007220535, 11185254949005441257, 11365707485692726787, 11873430000991232922, 12428098974121224233, 13097606626804240593, 13412992881554994937, 13674246925771883735, 13850886821849078558, 15203798703989247109, 15228222593821303909, 15279762139926950523, 15515585004882416385, 15520859351690753739, 15768325978800699421, 15994013491234619255, 16524397771145742832))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" | ||
| 1390 | 2026.08.17 23:52:16.908799 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 | ||
| 1391 | 2026.08.17 23:52:16.909458 [ 429499 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Debug> MergingSortedTransform: Merge sorted 1 blocks, 1200 rows in 0 sec. | ||
| 1392 | 2026.08.17 23:52:16.909611 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Debug> executeQuery: Read 1200 rows, 77.34 KiB in 0.002263 sec., 530269.5536897924 rows/sec., 33.38 MiB/sec. | ||
| 1393 | 2026.08.17 23:52:16.909740 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Debug> MemoryTracker: Peak memory usage (for query): 398.25 KiB. | ||
| 1394 | 2026.08.17 23:52:16.909743 [ 423967 ] {e7a8a7a9-fa2d-4b01-9bf8-45eecb742272} <Debug> TCPHandler: Processed in 0.002516772 sec. | ||
| 1395 | 2026.08.17 23:52:16.922698 [ 430366 ] {} <Error> ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): | ||
| 1396 | |||
| 1397 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1398 | 1. DB::Exception::Exception<unsigned long&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type, std::type_identity<String>::type>, unsigned long&, String&&) @ 0x0000000007354cb4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1399 | 2. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x0000000007354bb7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1400 | 3. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001384c492 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1401 | 4. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1402 | 5. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1403 | 6. ? @ 0x00007f44aa744890 in ? | ||
| 1404 | (version 23.8.7.24 (official build)) | ||
| 1405 | 2026.08.17 23:52:16.922737 [ 430366 ] {} <Information> ZooKeeperClient: Finalizing session 11. finalization_started: false, queue_finished: false, reason: 'Exception in receiveThread' | ||
| 1406 | 2026.08.17 23:52:16.922769 [ 430366 ] {} <Trace> oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 1407 | 2026.08.17 23:52:16.922784 [ 430366 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 1408 | 2026.08.17 23:52:16.922789 [ 430366 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 1409 | 2026.08.17 23:52:16.922793 [ 430366 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 1410 | 2026.08.17 23:52:16.922801 [ 430366 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true | ||
| 1411 | 2026.08.17 23:52:16.922808 [ 424420 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. | ||
| 1412 | 2026.08.17 23:52:16.922832 [ 424420 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/2/is_active since session has been expired | ||
| 1413 | 2026.08.17 23:52:16.922810 [ 424379 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. | ||
| 1414 | 2026.08.17 23:52:16.922840 [ 424420 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Waiting for threads to finish | ||
| 1415 | 2026.08.17 23:52:16.922844 [ 424379 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/is_active since session has been expired | ||
| 1416 | 2026.08.17 23:52:16.922827 [ 424332 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. | ||
| 1417 | 2026.08.17 23:52:16.922854 [ 424379 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Waiting for threads to finish | ||
| 1418 | 2026.08.17 23:52:16.922842 [ 424329 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. | ||
| 1419 | 2026.08.17 23:52:16.922858 [ 424332 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/2/is_active since session has been expired | ||
| 1420 | 2026.08.17 23:52:16.922867 [ 424329 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/2/is_active since session has been expired | ||
| 1421 | 2026.08.17 23:52:16.922872 [ 424329 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Waiting for threads to finish | ||
| 1422 | 2026.08.17 23:52:16.922867 [ 424332 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Waiting for threads to finish | ||
| 1423 | 2026.08.17 23:52:16.922897 [ 430366 ] {} <Error> ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): | ||
| 1424 | |||
| 1425 | 0. Poco::Net::SocketImpl::error(int, String const&) @ 0x0000000015b5abb2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1426 | 1. Poco::Net::SocketImpl::shutdown() @ 0x0000000015b5c39c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1427 | 2. Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001383d143 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1428 | 3. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001384e087 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1429 | 4. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1430 | 5. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1431 | 6. ? @ 0x00007f44aa744890 in ? | ||
| 1432 | (version 23.8.7.24 (official build)) | ||
| 1433 | 2026.08.17 23:52:16.922918 [ 424420 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Threads finished | ||
| 1434 | 2026.08.17 23:52:16.922922 [ 424420 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1435 | 2026.08.17 23:52:16.922932 [ 424361 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. | ||
| 1436 | 2026.08.17 23:52:16.922963 [ 424361 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/2/is_active since session has been expired | ||
| 1437 | 2026.08.17 23:52:16.922966 [ 424361 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Waiting for threads to finish | ||
| 1438 | 2026.08.17 23:52:16.922997 [ 424379 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Threads finished | ||
| 1439 | 2026.08.17 23:52:16.923029 [ 424329 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Threads finished | ||
| 1440 | 2026.08.17 23:52:16.923046 [ 424391 ] {} <Error> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1441 | |||
| 1442 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1443 | 1. DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1444 | 2. Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1445 | 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1446 | 4. Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function<void (Coordination::ListResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x00000000138481b1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1447 | 5. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f728e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1448 | 6. zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f6d96 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1449 | 7. zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f7a7b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1450 | 8. zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f7971 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1451 | 9. DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr<zkutil::ZooKeeper>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x0000000012ee47c8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1452 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_2, void ()>>(std::__function::__policy_storage const*) @ 0x000000001289dec0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1453 | 11. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1454 | 12. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1455 | 13. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1456 | 14. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1457 | 15. ? @ 0x00007f44aa744890 in ? | ||
| 1458 | (version 23.8.7.24 (official build)) | ||
| 1459 | 2026.08.17 23:52:16.923088 [ 424332 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Threads finished | ||
| 1460 | 2026.08.17 23:52:16.923066 [ 424354 ] {} <Error> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1461 | |||
| 1462 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1463 | 1. DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1464 | 2. Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1465 | 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1466 | 4. Coordination::ZooKeeper::get(String const&, std::function<void (Coordination::GetResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x0000000013847605 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1467 | 5. zkutil::ZooKeeper::getImpl(String const&, String&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>) @ 0x00000000137fa0bb in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1468 | 6. zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>, Coordination::Error*) @ 0x00000000137fa7df in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1469 | 7. zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::Error*) @ 0x00000000137fa6c8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1470 | 8. zkutil::ZooKeeper::get(String const&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&) @ 0x00000000137fa518 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1471 | 9. DB::ReplicatedMergeTreeQueue::pullLogsToQueue(std::shared_ptr<zkutil::ZooKeeper>, std::function<void (Coordination::WatchResponse const&)>, DB::ReplicatedMergeTreeQueue::PullLogsReason) @ 0x0000000012eddcf5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1472 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, bool, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000001289d59f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1473 | 11. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1474 | 12. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1475 | 13. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1476 | 14. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1477 | 15. ? @ 0x00007f44aa744890 in ? | ||
| 1478 | (version 23.8.7.24 (official build)) | ||
| 1479 | 2026.08.17 23:52:16.923187 [ 424361 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Threads finished | ||
| 1480 | 2026.08.17 23:52:17.001287 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 420.07 MiB, peak 425.23 MiB, free memory in arenas 44.50 MiB, will set to 421.23 MiB (RSS), difference: 1.16 MiB | ||
| 1481 | 2026.08.17 23:52:17.046925 [ 425085 ] {} <Debug> DDLWorker: Initializing DDLWorker thread | ||
| 1482 | 2026.08.17 23:52:21.006280 [ 424316 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 1483 | 2026.08.17 23:52:21.006316 [ 424316 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 1484 | 2026.08.17 23:52:21.041990 [ 425044 ] {} <Trace> SystemLog (system.opentelemetry_span_log): Flushing system log, 166 entries to flush up to offset 265 | ||
| 1485 | 2026.08.17 23:52:21.047201 [ 425044 ] {} <Trace> system.opentelemetry_span_log (9be1034d-e911-4280-94c0-05dcb911f3d3): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 1486 | 2026.08.17 23:52:21.047216 [ 425044 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.74 GiB. | ||
| 1487 | 2026.08.17 23:52:21.047245 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 972 entries to flush up to offset 3332 | ||
| 1488 | 2026.08.17 23:52:21.047521 [ 425044 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_2_2_0 (state Temporary) | ||
| 1489 | 2026.08.17 23:52:21.047719 [ 425044 ] {} <Trace> system.opentelemetry_span_log (9be1034d-e911-4280-94c0-05dcb911f3d3): Renaming temporary part tmp_insert_202608_2_2_0 to 202608_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 1490 | 2026.08.17 23:52:21.048018 [ 425044 ] {} <Trace> SystemLog (system.opentelemetry_span_log): Flushed system log up to offset 265 | ||
| 1491 | 2026.08.17 23:52:21.048220 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 1492 | 2026.08.17 23:52:21.048236 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.74 GiB. | ||
| 1493 | 2026.08.17 23:52:21.048617 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_2_2_0 (state Temporary) | ||
| 1494 | 2026.08.17 23:52:21.048767 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_2_2_0 to 202608_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 1495 | 2026.08.17 23:52:21.048868 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 3332 | ||
| 1496 | 2026.08.17 23:52:21.065365 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 16 | ||
| 1497 | 2026.08.17 23:52:21.073877 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 1498 | 2026.08.17 23:52:21.073892 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.74 GiB. | ||
| 1499 | 2026.08.17 23:52:21.077308 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_2_2_0 (state Temporary) | ||
| 1500 | 2026.08.17 23:52:21.079950 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_2_2_0 to 202608_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 1501 | 2026.08.17 23:52:21.080819 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 16 | ||
| 1502 | 2026.08.17 23:52:26.931532 [ 424379 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1503 | 2026.08.17 23:52:26.931620 [ 424420 ] {} <Error> oximeter.version (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 1504 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1505 | Code: 209. DB::NetException: Timeout exceeded while reading from socket ([::1]:19003, 10000 ms): while receiving handshake from ZooKeeper. (SOCKET_TIMEOUT) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1506 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1507 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1508 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1509 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1510 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1511 | |||
| 1512 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1513 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1514 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1515 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1516 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1517 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1518 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1519 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1520 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1521 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1522 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1523 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1524 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1525 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1526 | (version 23.8.7.24 (official build)) | ||
| 1527 | 2026.08.17 23:52:26.931651 [ 424420 ] {} <Trace> oximeter.version (ReplicatedMergeTreeRestartingThread): Execution took 10008 ms. | ||
| 1528 | 2026.08.17 23:52:26.931955 [ 424329 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1529 | 2026.08.17 23:52:26.931982 [ 424379 ] {} <Error> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 1530 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1531 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1532 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1533 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1534 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1535 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1536 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1537 | |||
| 1538 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1539 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1540 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1541 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1542 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1543 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1544 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1545 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1546 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1547 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1548 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1549 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1550 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1551 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1552 | (version 23.8.7.24 (official build)) | ||
| 1553 | 2026.08.17 23:52:26.932002 [ 424379 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Execution took 10009 ms. | ||
| 1554 | 2026.08.17 23:52:26.932330 [ 424332 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1555 | 2026.08.17 23:52:26.932349 [ 424329 ] {} <Error> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 1556 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1557 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1558 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1559 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1560 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1561 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1562 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1563 | |||
| 1564 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1565 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1566 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1567 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1568 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1569 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1570 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1571 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1572 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1573 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1574 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1575 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1576 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1577 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1578 | (version 23.8.7.24 (official build)) | ||
| 1579 | 2026.08.17 23:52:26.932368 [ 424329 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Execution took 10009 ms. | ||
| 1580 | 2026.08.17 23:52:26.932636 [ 424361 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1581 | 2026.08.17 23:52:26.932661 [ 424332 ] {} <Error> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 1582 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1583 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1584 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1585 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1586 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1587 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1588 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1589 | |||
| 1590 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1591 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1592 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1593 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1594 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1595 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1596 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1597 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1598 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1599 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1600 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1601 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1602 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1603 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1604 | (version 23.8.7.24 (official build)) | ||
| 1605 | 2026.08.17 23:52:26.932680 [ 424332 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Execution took 10009 ms. | ||
| 1606 | 2026.08.17 23:52:26.933124 [ 425085 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1607 | 2026.08.17 23:52:26.933144 [ 424361 ] {} <Error> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 1608 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1609 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1610 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1611 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1612 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1613 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1614 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1615 | |||
| 1616 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1617 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1618 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1619 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1620 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1621 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1622 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1623 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1624 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1625 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1626 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1627 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1628 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1629 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1630 | (version 23.8.7.24 (official build)) | ||
| 1631 | 2026.08.17 23:52:26.933167 [ 424361 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Execution took 10010 ms. | ||
| 1632 | 2026.08.17 23:52:26.933173 [ 424361 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1633 | 2026.08.17 23:52:26.933532 [ 424361 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1634 | 2026.08.17 23:52:26.933610 [ 425085 ] {} <Error> virtual bool DB::DDLWorker::initializeMainThread(): Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 1635 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1636 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1637 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1638 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1639 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1640 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1641 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1642 | |||
| 1643 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1644 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1645 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1646 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1647 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1648 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1649 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1650 | 7. DB::DDLWorker::getAndSetZooKeeper() @ 0x00000000116ec1ed in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1651 | 8. DB::DDLWorker::initializeMainThread() @ 0x00000000116fc81b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1652 | 9. DB::DDLWorker::runMainThread() @ 0x00000000116e7280 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1653 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1654 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1655 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1656 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1657 | (version 23.8.7.24 (official build)) | ||
| 1658 | 2026.08.17 23:52:26.933830 [ 424361 ] {} <Error> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 1659 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1660 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1661 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1662 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1663 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1664 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1665 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1666 | |||
| 1667 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1668 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1669 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1670 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1671 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1672 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1673 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1674 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1675 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1676 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1677 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1678 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1679 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1680 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1681 | (version 23.8.7.24 (official build)) | ||
| 1682 | 2026.08.17 23:52:27.000357 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 421.77 MiB, peak 429.78 MiB, free memory in arenas 67.41 MiB, will set to 430.03 MiB (RSS), difference: 8.26 MiB | ||
| 1683 | 2026.08.17 23:52:27.031717 [ 424411 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1684 | 2026.08.17 23:52:27.031732 [ 424411 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1685 | 2026.08.17 23:52:27.032071 [ 424326 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1686 | 2026.08.17 23:52:27.032150 [ 424326 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1687 | 2026.08.17 23:52:27.032163 [ 424411 ] {} <Error> oximeter.version (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 1688 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1689 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1690 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1691 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1692 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1693 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1694 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1695 | |||
| 1696 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1697 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1698 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1699 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1700 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1701 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1702 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1703 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1704 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1705 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1706 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1707 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1708 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1709 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1710 | (version 23.8.7.24 (official build)) | ||
| 1711 | 2026.08.17 23:52:27.032430 [ 424409 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1712 | 2026.08.17 23:52:27.032473 [ 424409 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1713 | 2026.08.17 23:52:27.032491 [ 424326 ] {} <Error> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 1714 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1715 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1716 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1717 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1718 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1719 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1720 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1721 | |||
| 1722 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1723 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1724 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1725 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1726 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1727 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1728 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1729 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1730 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1731 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1732 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1733 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1734 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1735 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1736 | (version 23.8.7.24 (official build)) | ||
| 1737 | 2026.08.17 23:52:27.032761 [ 424341 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1738 | 2026.08.17 23:52:27.032832 [ 424341 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1739 | 2026.08.17 23:52:27.032853 [ 424409 ] {} <Error> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 1740 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1741 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1742 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1743 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1744 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1745 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1746 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1747 | |||
| 1748 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1749 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1750 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1751 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1752 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1753 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1754 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1755 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1756 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1757 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1758 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1759 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1760 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1761 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1762 | (version 23.8.7.24 (official build)) | ||
| 1763 | 2026.08.17 23:52:27.033157 [ 424341 ] {} <Error> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 1764 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1765 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1766 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1767 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1768 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1769 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1770 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1771 | |||
| 1772 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1773 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1774 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1775 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1776 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1777 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1778 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1779 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1780 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1781 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1782 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1783 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1784 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1785 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1786 | (version 23.8.7.24 (official build)) | ||
| 1787 | 2026.08.17 23:52:27.233920 [ 424297 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1788 | 2026.08.17 23:52:27.233948 [ 424297 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1789 | 2026.08.17 23:52:27.234476 [ 424297 ] {} <Error> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 1790 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1791 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1792 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1793 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1794 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1795 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1796 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1797 | |||
| 1798 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1799 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1800 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1801 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1802 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1803 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1804 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1805 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1806 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1807 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1808 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1809 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1810 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1811 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1812 | (version 23.8.7.24 (official build)) | ||
| 1813 | 2026.08.17 23:52:27.332253 [ 424317 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1814 | 2026.08.17 23:52:27.332266 [ 424317 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1815 | 2026.08.17 23:52:27.332571 [ 424350 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1816 | 2026.08.17 23:52:27.332643 [ 424350 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1817 | 2026.08.17 23:52:27.332663 [ 424317 ] {} <Error> oximeter.version (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 1818 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1819 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1820 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1821 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1822 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1823 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1824 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1825 | |||
| 1826 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1827 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1828 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1829 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1830 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1831 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1832 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1833 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1834 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1835 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1836 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1837 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1838 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1839 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1840 | (version 23.8.7.24 (official build)) | ||
| 1841 | 2026.08.17 23:52:27.332942 [ 424366 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1842 | 2026.08.17 23:52:27.332990 [ 424366 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1843 | 2026.08.17 23:52:27.333010 [ 424350 ] {} <Error> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 1844 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1845 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1846 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1847 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1848 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1849 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1850 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1851 | |||
| 1852 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1853 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1854 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1855 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1856 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1857 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1858 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1859 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1860 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1861 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1862 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1863 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1864 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1865 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1866 | (version 23.8.7.24 (official build)) | ||
| 1867 | 2026.08.17 23:52:27.333239 [ 424330 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1868 | 2026.08.17 23:52:27.333314 [ 424330 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1869 | 2026.08.17 23:52:27.333341 [ 424366 ] {} <Error> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 1870 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1871 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1872 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1873 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1874 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1875 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1876 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1877 | |||
| 1878 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1879 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1880 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1881 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1882 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1883 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1884 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1885 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1886 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1887 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1888 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1889 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1890 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1891 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1892 | (version 23.8.7.24 (official build)) | ||
| 1893 | 2026.08.17 23:52:27.333665 [ 424330 ] {} <Error> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 1894 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1895 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1896 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1897 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1898 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1899 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1900 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1901 | |||
| 1902 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1903 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1904 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1905 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1906 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1907 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1908 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1909 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1910 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1911 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1912 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1913 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1914 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1915 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1916 | (version 23.8.7.24 (official build)) | ||
| 1917 | 2026.08.17 23:52:27.834582 [ 424349 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1918 | 2026.08.17 23:52:27.834604 [ 424349 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1919 | 2026.08.17 23:52:27.835050 [ 424349 ] {} <Error> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 1920 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1921 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1922 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1923 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1924 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1925 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1926 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1927 | |||
| 1928 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1929 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1930 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1931 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1932 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1933 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1934 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1935 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1936 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1937 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1938 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1939 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1940 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1941 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1942 | (version 23.8.7.24 (official build)) | ||
| 1943 | 2026.08.17 23:52:27.932755 [ 424368 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1944 | 2026.08.17 23:52:27.932776 [ 424368 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1945 | 2026.08.17 23:52:27.933118 [ 424334 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1946 | 2026.08.17 23:52:27.933156 [ 424334 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1947 | 2026.08.17 23:52:27.933184 [ 424368 ] {} <Error> oximeter.version (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 1948 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1949 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1950 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1951 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1952 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1953 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1954 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1955 | |||
| 1956 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1957 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1958 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1959 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1960 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1961 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1962 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1963 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1964 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1965 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1966 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1967 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1968 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1969 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1970 | (version 23.8.7.24 (official build)) | ||
| 1971 | 2026.08.17 23:52:27.933434 [ 424299 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1972 | 2026.08.17 23:52:27.933490 [ 424299 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1973 | 2026.08.17 23:52:27.933515 [ 424334 ] {} <Error> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 1974 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1975 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1976 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1977 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1978 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 1979 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 1980 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 1981 | |||
| 1982 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1983 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1984 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1985 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1986 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1987 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1988 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1989 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1990 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1991 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1992 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1993 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 1994 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 1995 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 1996 | (version 23.8.7.24 (official build)) | ||
| 1997 | 2026.08.17 23:52:27.933738 [ 424398 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 1998 | 2026.08.17 23:52:27.933790 [ 424398 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 1999 | 2026.08.17 23:52:27.933817 [ 424299 ] {} <Error> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2000 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2001 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2002 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2003 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2004 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2005 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2006 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2007 | |||
| 2008 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2009 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2010 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2011 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2012 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2013 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2014 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2015 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2016 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2017 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2018 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2019 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2020 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2021 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2022 | (version 23.8.7.24 (official build)) | ||
| 2023 | 2026.08.17 23:52:27.934071 [ 424398 ] {} <Error> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2024 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2025 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2026 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2027 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2028 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2029 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2030 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2031 | |||
| 2032 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2033 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2034 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2035 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2036 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2037 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2038 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2039 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2040 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2041 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2042 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2043 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2044 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2045 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2046 | (version 23.8.7.24 (official build)) | ||
| 2047 | 2026.08.17 23:52:28.548946 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 966 entries to flush up to offset 4298 | ||
| 2048 | 2026.08.17 23:52:28.549533 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 2049 | 2026.08.17 23:52:28.549547 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 137.03 GiB. | ||
| 2050 | 2026.08.17 23:52:28.549878 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_3_3_0 (state Temporary) | ||
| 2051 | 2026.08.17 23:52:28.550059 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_3_3_0 to 202608_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 2052 | 2026.08.17 23:52:28.550156 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 4298 | ||
| 2053 | 2026.08.17 23:52:28.580958 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 23 | ||
| 2054 | 2026.08.17 23:52:28.588424 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 2055 | 2026.08.17 23:52:28.588440 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 137.03 GiB. | ||
| 2056 | 2026.08.17 23:52:28.591920 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_3_3_0 (state Temporary) | ||
| 2057 | 2026.08.17 23:52:28.594630 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_3_3_0 to 202608_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 2058 | 2026.08.17 23:52:28.595558 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 23 | ||
| 2059 | 2026.08.17 23:52:28.835170 [ 424355 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2060 | 2026.08.17 23:52:28.835191 [ 424355 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2061 | 2026.08.17 23:52:28.835615 [ 424355 ] {} <Error> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2062 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2063 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2064 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2065 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2066 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2067 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2068 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2069 | |||
| 2070 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2071 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2072 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2073 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2074 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2075 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2076 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2077 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2078 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2079 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2080 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2081 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2082 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2083 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2084 | (version 23.8.7.24 (official build)) | ||
| 2085 | 2026.08.17 23:52:28.933293 [ 424327 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2086 | 2026.08.17 23:52:28.933319 [ 424327 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2087 | 2026.08.17 23:52:28.933592 [ 424328 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2088 | 2026.08.17 23:52:28.933765 [ 424328 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2089 | 2026.08.17 23:52:28.933790 [ 424327 ] {} <Error> oximeter.version (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2090 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2091 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2092 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2093 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2094 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2095 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2096 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2097 | |||
| 2098 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2099 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2100 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2101 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2102 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2103 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2104 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2105 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2106 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2107 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2108 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2109 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2110 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2111 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2112 | (version 23.8.7.24 (official build)) | ||
| 2113 | 2026.08.17 23:52:28.933907 [ 424414 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2114 | 2026.08.17 23:52:28.934136 [ 424414 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2115 | 2026.08.17 23:52:28.934146 [ 424337 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2116 | 2026.08.17 23:52:28.934153 [ 424328 ] {} <Error> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2117 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2118 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2119 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2120 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2121 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2122 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2123 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2124 | |||
| 2125 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2126 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2127 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2128 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2129 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2130 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2131 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2132 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2133 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2134 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2135 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2136 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2137 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2138 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2139 | (version 23.8.7.24 (official build)) | ||
| 2140 | 2026.08.17 23:52:28.934478 [ 424337 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2141 | 2026.08.17 23:52:28.934495 [ 424414 ] {} <Error> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2142 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2143 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2144 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2145 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2146 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2147 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2148 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2149 | |||
| 2150 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2151 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2152 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2153 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2154 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2155 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2156 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2157 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2158 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2159 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2160 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2161 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2162 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2163 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2164 | (version 23.8.7.24 (official build)) | ||
| 2165 | 2026.08.17 23:52:28.934805 [ 424337 ] {} <Error> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2166 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2167 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2168 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2169 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2170 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2171 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2172 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2173 | |||
| 2174 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2175 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2176 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2177 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2178 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2179 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2180 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2181 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2182 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2183 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2184 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2185 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2186 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2187 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2188 | (version 23.8.7.24 (official build)) | ||
| 2189 | 2026.08.17 23:52:29.000368 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 430.75 MiB, peak 438.78 MiB, free memory in arenas 80.54 MiB, will set to 439.08 MiB (RSS), difference: 8.33 MiB | ||
| 2190 | 2026.08.17 23:52:30.335727 [ 424394 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2191 | 2026.08.17 23:52:30.335749 [ 424394 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2192 | 2026.08.17 23:52:30.336159 [ 424394 ] {} <Error> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2193 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2194 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2195 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2196 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2197 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2198 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2199 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2200 | |||
| 2201 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2202 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2203 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2204 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2205 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2206 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2207 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2208 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2209 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2210 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2211 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2212 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2213 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2214 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2215 | (version 23.8.7.24 (official build)) | ||
| 2216 | 2026.08.17 23:52:30.433892 [ 424313 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2217 | 2026.08.17 23:52:30.433914 [ 424313 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2218 | 2026.08.17 23:52:30.434237 [ 424407 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2219 | 2026.08.17 23:52:30.434331 [ 424407 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2220 | 2026.08.17 23:52:30.434361 [ 424313 ] {} <Error> oximeter.version (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2221 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2222 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2223 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2224 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2225 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2226 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2227 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2228 | |||
| 2229 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2230 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2231 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2232 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2233 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2234 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2235 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2236 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2237 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2238 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2239 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2240 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2241 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2242 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2243 | (version 23.8.7.24 (official build)) | ||
| 2244 | 2026.08.17 23:52:30.434573 [ 424381 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2245 | 2026.08.17 23:52:30.434671 [ 424381 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2246 | 2026.08.17 23:52:30.434696 [ 424407 ] {} <Error> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2247 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2248 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2249 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2250 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2251 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2252 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2253 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2254 | |||
| 2255 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2256 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2257 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2258 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2259 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2260 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2261 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2262 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2263 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2264 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2265 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2266 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2267 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2268 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2269 | (version 23.8.7.24 (official build)) | ||
| 2270 | 2026.08.17 23:52:30.434888 [ 424390 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2271 | 2026.08.17 23:52:30.434973 [ 424390 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2272 | 2026.08.17 23:52:30.434987 [ 424381 ] {} <Error> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2273 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2274 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2275 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2276 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2277 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2278 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2279 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2280 | |||
| 2281 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2282 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2283 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2284 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2285 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2286 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2287 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2288 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2289 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2290 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2291 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2292 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2293 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2294 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2295 | (version 23.8.7.24 (official build)) | ||
| 2296 | 2026.08.17 23:52:30.435324 [ 424390 ] {} <Error> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2297 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2298 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2299 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2300 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2301 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2302 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2303 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2304 | |||
| 2305 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2306 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2307 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2308 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2309 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2310 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2311 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2312 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2313 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2314 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2315 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2316 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2317 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2318 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2319 | (version 23.8.7.24 (official build)) | ||
| 2320 | 2026.08.17 23:52:31.933689 [ 425085 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2321 | 2026.08.17 23:52:31.934499 [ 425085 ] {} <Error> virtual bool DB::DDLWorker::initializeMainThread(): Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2322 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2323 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2324 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2325 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2326 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2327 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2328 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2329 | |||
| 2330 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2331 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2332 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2333 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2334 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2335 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2336 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2337 | 7. DB::DDLWorker::getAndSetZooKeeper() @ 0x00000000116ec1ed in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2338 | 8. DB::DDLWorker::initializeMainThread() @ 0x00000000116fc81b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2339 | 9. DB::DDLWorker::runMainThread() @ 0x00000000116e7280 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2340 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2341 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2342 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2343 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2344 | (version 23.8.7.24 (official build)) | ||
| 2345 | 2026.08.17 23:52:32.436254 [ 424320 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2346 | 2026.08.17 23:52:32.436275 [ 424320 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2347 | 2026.08.17 23:52:32.436688 [ 424320 ] {} <Error> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2348 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2349 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2350 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2351 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2352 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2353 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2354 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2355 | |||
| 2356 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2357 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2358 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2359 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2360 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2361 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2362 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2363 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2364 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2365 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2366 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2367 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2368 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2369 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2370 | (version 23.8.7.24 (official build)) | ||
| 2371 | 2026.08.17 23:52:32.534457 [ 424364 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2372 | 2026.08.17 23:52:32.534476 [ 424364 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2373 | 2026.08.17 23:52:32.534781 [ 424424 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2374 | 2026.08.17 23:52:32.534857 [ 424424 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2375 | 2026.08.17 23:52:32.534885 [ 424364 ] {} <Error> oximeter.version (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2376 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2377 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2378 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2379 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2380 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2381 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2382 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2383 | |||
| 2384 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2385 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2386 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2387 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2388 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2389 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2390 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2391 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2392 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2393 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2394 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2395 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2396 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2397 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2398 | (version 23.8.7.24 (official build)) | ||
| 2399 | 2026.08.17 23:52:32.535060 [ 424358 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2400 | 2026.08.17 23:52:32.535220 [ 424358 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2401 | 2026.08.17 23:52:32.535238 [ 424424 ] {} <Error> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2402 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2403 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2404 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2405 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2406 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2407 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2408 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2409 | |||
| 2410 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2411 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2412 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2413 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2414 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2415 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2416 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2417 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2418 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2419 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2420 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2421 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2422 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2423 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2424 | (version 23.8.7.24 (official build)) | ||
| 2425 | 2026.08.17 23:52:32.535405 [ 424387 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2426 | 2026.08.17 23:52:32.535515 [ 424387 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2427 | 2026.08.17 23:52:32.535534 [ 424358 ] {} <Error> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2428 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2429 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2430 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2431 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2432 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2433 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2434 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2435 | |||
| 2436 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2437 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2438 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2439 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2440 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2441 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2442 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2443 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2444 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2445 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2446 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2447 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2448 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2449 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2450 | (version 23.8.7.24 (official build)) | ||
| 2451 | 2026.08.17 23:52:32.535923 [ 424387 ] {} <Error> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2452 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2453 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2454 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2455 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2456 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2457 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2458 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2459 | |||
| 2460 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2461 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2462 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2463 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2464 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2465 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2466 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2467 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2468 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2469 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2470 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2471 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2472 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2473 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2474 | (version 23.8.7.24 (official build)) | ||
| 2475 | 2026.08.17 23:52:35.236777 [ 424367 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2476 | 2026.08.17 23:52:35.236796 [ 424367 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2477 | 2026.08.17 23:52:35.237317 [ 424367 ] {} <Error> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2478 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2479 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2480 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2481 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2482 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2483 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2484 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2485 | |||
| 2486 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2487 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2488 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2489 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2490 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2491 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2492 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2493 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2494 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2495 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2496 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2497 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2498 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2499 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2500 | (version 23.8.7.24 (official build)) | ||
| 2501 | 2026.08.17 23:52:35.334970 [ 424392 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2502 | 2026.08.17 23:52:35.334987 [ 424392 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2503 | 2026.08.17 23:52:35.335328 [ 424377 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2504 | 2026.08.17 23:52:35.335351 [ 424377 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2505 | 2026.08.17 23:52:35.335370 [ 424392 ] {} <Error> oximeter.version (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2506 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2507 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2508 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2509 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2510 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2511 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2512 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2513 | |||
| 2514 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2515 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2516 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2517 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2518 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2519 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2520 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2521 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2522 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2523 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2524 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2525 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2526 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2527 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2528 | (version 23.8.7.24 (official build)) | ||
| 2529 | 2026.08.17 23:52:35.335605 [ 424371 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2530 | 2026.08.17 23:52:35.335710 [ 424371 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2531 | 2026.08.17 23:52:35.335741 [ 424377 ] {} <Error> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2532 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2533 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2534 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2535 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2536 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2537 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2538 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2539 | |||
| 2540 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2541 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2542 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2543 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2544 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2545 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2546 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2547 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2548 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2549 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2550 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2551 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2552 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2553 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2554 | (version 23.8.7.24 (official build)) | ||
| 2555 | 2026.08.17 23:52:35.336000 [ 424365 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2556 | 2026.08.17 23:52:35.336006 [ 424365 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2557 | 2026.08.17 23:52:35.336015 [ 424371 ] {} <Error> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2558 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2559 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2560 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2561 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2562 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2563 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2564 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2565 | |||
| 2566 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2567 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2568 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2569 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2570 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2571 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2572 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2573 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2574 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2575 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2576 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2577 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2578 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2579 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2580 | (version 23.8.7.24 (official build)) | ||
| 2581 | 2026.08.17 23:52:35.336321 [ 424365 ] {} <Error> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2582 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2583 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2584 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2585 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2586 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2587 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2588 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2589 | |||
| 2590 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2591 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2592 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2593 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2594 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2595 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2596 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2597 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2598 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2599 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2600 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2601 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2602 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2603 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2604 | (version 23.8.7.24 (official build)) | ||
| 2605 | 2026.08.17 23:52:36.006393 [ 424351 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 2606 | 2026.08.17 23:52:36.006412 [ 424351 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 2607 | 2026.08.17 23:52:36.050236 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 6874 | ||
| 2608 | 2026.08.17 23:52:36.051495 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 2609 | 2026.08.17 23:52:36.051513 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 137.02 GiB. | ||
| 2610 | 2026.08.17 23:52:36.051907 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_4_4_0 (state Temporary) | ||
| 2611 | 2026.08.17 23:52:36.052038 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_4_4_0 to 202608_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 2612 | 2026.08.17 23:52:36.052132 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 6874 | ||
| 2613 | 2026.08.17 23:52:36.095626 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 31 | ||
| 2614 | 2026.08.17 23:52:36.102892 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 2615 | 2026.08.17 23:52:36.102908 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 137.02 GiB. | ||
| 2616 | 2026.08.17 23:52:36.106366 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_4_4_0 (state Temporary) | ||
| 2617 | 2026.08.17 23:52:36.108994 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_4_4_0 to 202608_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 2618 | 2026.08.17 23:52:36.109895 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 31 | ||
| 2619 | 2026.08.17 23:52:36.934588 [ 425085 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2620 | 2026.08.17 23:52:36.935158 [ 425085 ] {} <Error> virtual bool DB::DDLWorker::initializeMainThread(): Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2621 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2622 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2623 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2624 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2625 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2626 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2627 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2628 | |||
| 2629 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2630 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2631 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2632 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2633 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2634 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2635 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2636 | 7. DB::DDLWorker::getAndSetZooKeeper() @ 0x00000000116ec1ed in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2637 | 8. DB::DDLWorker::initializeMainThread() @ 0x00000000116fc81b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2638 | 9. DB::DDLWorker::runMainThread() @ 0x00000000116e7280 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2639 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2640 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2641 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2642 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2643 | (version 23.8.7.24 (official build)) | ||
| 2644 | 2026.08.17 23:52:37.000383 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 439.26 MiB, peak 447.29 MiB, free memory in arenas 82.82 MiB, will set to 441.09 MiB (RSS), difference: 1.83 MiB | ||
| 2645 | 2026.08.17 23:52:38.837402 [ 424331 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2646 | 2026.08.17 23:52:38.837422 [ 424331 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2647 | 2026.08.17 23:52:38.837833 [ 424331 ] {} <Error> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2648 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2649 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2650 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2651 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2652 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2653 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2654 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2655 | |||
| 2656 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2657 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2658 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2659 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2660 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2661 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2662 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2663 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2664 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2665 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2666 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2667 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2668 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2669 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2670 | (version 23.8.7.24 (official build)) | ||
| 2671 | 2026.08.17 23:52:38.935465 [ 424403 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2672 | 2026.08.17 23:52:38.935481 [ 424403 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2673 | 2026.08.17 23:52:38.935819 [ 424353 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2674 | 2026.08.17 23:52:38.935839 [ 424353 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2675 | 2026.08.17 23:52:38.935866 [ 424403 ] {} <Error> oximeter.version (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2676 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2677 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2678 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2679 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2680 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2681 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2682 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2683 | |||
| 2684 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2685 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2686 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2687 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2688 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2689 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2690 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2691 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2692 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2693 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2694 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2695 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2696 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2697 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2698 | (version 23.8.7.24 (official build)) | ||
| 2699 | 2026.08.17 23:52:38.936089 [ 424402 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2700 | 2026.08.17 23:52:38.936204 [ 424402 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2701 | 2026.08.17 23:52:38.936233 [ 424353 ] {} <Error> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2702 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2703 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2704 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2705 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2706 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2707 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2708 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2709 | |||
| 2710 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2711 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2712 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2713 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2714 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2715 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2716 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2717 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2718 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2719 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2720 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2721 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2722 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2723 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2724 | (version 23.8.7.24 (official build)) | ||
| 2725 | 2026.08.17 23:52:38.936411 [ 424404 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2726 | 2026.08.17 23:52:38.936581 [ 424404 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2727 | 2026.08.17 23:52:38.936608 [ 424402 ] {} <Error> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2728 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2729 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2730 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2731 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2732 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2733 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2734 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2735 | |||
| 2736 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2737 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2738 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2739 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2740 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2741 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2742 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2743 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2744 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2745 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2746 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2747 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2748 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2749 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2750 | (version 23.8.7.24 (official build)) | ||
| 2751 | 2026.08.17 23:52:38.936903 [ 424404 ] {} <Error> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2752 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2753 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2754 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2755 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2756 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2757 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2758 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2759 | |||
| 2760 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2761 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2762 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2763 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2764 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2765 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2766 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2767 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2768 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2769 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2770 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2771 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2772 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2773 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2774 | (version 23.8.7.24 (official build)) | ||
| 2775 | 2026.08.17 23:52:41.935246 [ 425085 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2776 | 2026.08.17 23:52:41.935758 [ 425085 ] {} <Error> virtual bool DB::DDLWorker::initializeMainThread(): Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2777 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2778 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2779 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2780 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2781 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2782 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2783 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2784 | |||
| 2785 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2786 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2787 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2788 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2789 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2790 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2791 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2792 | 7. DB::DDLWorker::getAndSetZooKeeper() @ 0x00000000116ec1ed in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2793 | 8. DB::DDLWorker::initializeMainThread() @ 0x00000000116fc81b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2794 | 9. DB::DDLWorker::runMainThread() @ 0x00000000116e7280 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2795 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2796 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2797 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2798 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2799 | (version 23.8.7.24 (official build)) | ||
| 2800 | 2026.08.17 23:52:43.337928 [ 424391 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2801 | 2026.08.17 23:52:43.337942 [ 424391 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2802 | 2026.08.17 23:52:43.338347 [ 424391 ] {} <Error> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2803 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2804 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2805 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2806 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2807 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2808 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2809 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2810 | |||
| 2811 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2812 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2813 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2814 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2815 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2816 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2817 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2818 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2819 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2820 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2821 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2822 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2823 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2824 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2825 | (version 23.8.7.24 (official build)) | ||
| 2826 | 2026.08.17 23:52:43.435961 [ 424362 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2827 | 2026.08.17 23:52:43.435987 [ 424362 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2828 | 2026.08.17 23:52:43.436318 [ 424405 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2829 | 2026.08.17 23:52:43.436412 [ 424405 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2830 | 2026.08.17 23:52:43.436437 [ 424362 ] {} <Error> oximeter.version (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2831 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2832 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2833 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2834 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2835 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2836 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2837 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2838 | |||
| 2839 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2840 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2841 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2842 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2843 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2844 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2845 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2846 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2847 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2848 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2849 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2850 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2851 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2852 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2853 | (version 23.8.7.24 (official build)) | ||
| 2854 | 2026.08.17 23:52:43.436691 [ 424419 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2855 | 2026.08.17 23:52:43.436761 [ 424419 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2856 | 2026.08.17 23:52:43.436781 [ 424405 ] {} <Error> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2857 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2858 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2859 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2860 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2861 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2862 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2863 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2864 | |||
| 2865 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2866 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2867 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2868 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2869 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2870 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2871 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2872 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2873 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2874 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2875 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2876 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2877 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2878 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2879 | (version 23.8.7.24 (official build)) | ||
| 2880 | 2026.08.17 23:52:43.436981 [ 424301 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 2881 | 2026.08.17 23:52:43.437095 [ 424301 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2882 | 2026.08.17 23:52:43.437118 [ 424419 ] {} <Error> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2883 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2884 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2885 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2886 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2887 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2888 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2889 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2890 | |||
| 2891 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2892 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2893 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2894 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2895 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2896 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2897 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2898 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2899 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2900 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2901 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2902 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2903 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2904 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2905 | (version 23.8.7.24 (official build)) | ||
| 2906 | 2026.08.17 23:52:43.437510 [ 424301 ] {} <Error> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Failed to establish a new ZK connection. Will try again: Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19003, [::1]:19001 | ||
| 2907 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2908 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2909 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2910 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2911 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2912 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2913 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2914 | |||
| 2915 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2916 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2917 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2918 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2919 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2920 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2921 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2922 | 7. DB::StorageReplicatedMergeTree::setZooKeeper() @ 0x000000001275b85e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2923 | 8. DB::ReplicatedMergeTreeRestartingThread::run() @ 0x0000000012f11640 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2924 | 9. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2925 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2926 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2927 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2928 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2929 | (version 23.8.7.24 (official build)) | ||
| 2930 | 2026.08.17 23:52:43.552223 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 9128 | ||
| 2931 | 2026.08.17 23:52:43.553167 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 2932 | 2026.08.17 23:52:43.553181 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 137.00 GiB. | ||
| 2933 | 2026.08.17 23:52:43.553533 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_5_5_0 (state Temporary) | ||
| 2934 | 2026.08.17 23:52:43.553665 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_5_5_0 to 202608_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 2935 | 2026.08.17 23:52:43.553745 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 9128 | ||
| 2936 | 2026.08.17 23:52:43.609969 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 38 | ||
| 2937 | 2026.08.17 23:52:43.616733 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 2938 | 2026.08.17 23:52:43.616747 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 137.00 GiB. | ||
| 2939 | 2026.08.17 23:52:43.620201 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_5_5_0 (state Temporary) | ||
| 2940 | 2026.08.17 23:52:43.622750 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_5_5_0 to 202608_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 2941 | 2026.08.17 23:52:43.623650 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 38 | ||
| 2942 | 2026.08.17 23:52:46.935838 [ 425085 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 2943 | 2026.08.17 23:52:46.936970 [ 425085 ] {} <Error> virtual bool DB::DDLWorker::initializeMainThread(): Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003 | ||
| 2944 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2945 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2946 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2947 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2948 | Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 | ||
| 2949 | Code: 999. Coordination::Exception: Keeper server rejected the connection during the handshake. Possibly it's overloaded, doesn't see leader or stale: while receiving handshake from ZooKeeper. (KEEPER_EXCEPTION) (version 23.8.7.24 (official build)), [::1]:19003 | ||
| 2950 | . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): | ||
| 2951 | |||
| 2952 | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2953 | 1. DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2954 | 2. Coordination::Exception::Exception<String&>(Coordination::Error, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2955 | 3. Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2956 | 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2957 | 5. zkutil::ZooKeeper::ZooKeeper(zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>) @ 0x00000000137f5ff0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2958 | 6. DB::Context::getZooKeeper() const @ 0x000000001166b47c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2959 | 7. DB::DDLWorker::getAndSetZooKeeper() @ 0x00000000116ec1ed in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2960 | 8. DB::DDLWorker::initializeMainThread() @ 0x00000000116fc81b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2961 | 9. DB::DDLWorker::runMainThread() @ 0x00000000116e7280 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2962 | 10. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2963 | 11. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse | ||
| 2964 | 12. ? @ 0x00007f44aa6b2a83 in ? | ||
| 2965 | 13. ? @ 0x00007f44aa744890 in ? | ||
| 2966 | (version 23.8.7.24 (official build)) | ||
| 2967 | 2026.08.17 23:52:47.000378 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 442.46 MiB, peak 449.73 MiB, free memory in arenas 74.61 MiB, will set to 439.88 MiB (RSS), difference: -2.59 MiB | ||
| 2968 | 2026.08.17 23:52:47.668058 [ 423967 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 2969 | 2026.08.17 23:52:47.668080 [ 423967 ] {} <Debug> TCP-Session: 96093916-4a2e-42d4-9d27-a5a734b1d1da Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2970 | 2026.08.17 23:52:47.668080 [ 425233 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 2971 | 2026.08.17 23:52:47.668099 [ 425233 ] {} <Debug> TCP-Session: 8a0cd5be-941b-46c7-a52b-0823b2f5ea08 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2972 | 2026.08.17 23:52:47.668159 [ 425230 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 2973 | 2026.08.17 23:52:47.668169 [ 425230 ] {} <Debug> TCP-Session: 5ce34993-a2a7-45fc-b73c-996557010585 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2974 | 2026.08.17 23:52:47.668182 [ 425234 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 2975 | 2026.08.17 23:52:47.668230 [ 425234 ] {} <Debug> TCP-Session: ccc75a31-f415-488c-8e17-66e501fe6f45 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2976 | 2026.08.17 23:52:47.668241 [ 425231 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 2977 | 2026.08.17 23:52:47.668250 [ 425231 ] {} <Debug> TCP-Session: 3ce3e6d2-eb84-475a-8248-b7a1655e9fa3 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2978 | 2026.08.17 23:52:47.668258 [ 425235 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 2979 | 2026.08.17 23:52:47.668272 [ 425235 ] {} <Debug> TCP-Session: 048a2ffe-8b3b-4e2b-876e-25dc0a70b22e Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2980 | 2026.08.17 23:52:47.668395 [ 425232 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 2981 | 2026.08.17 23:52:47.668403 [ 423966 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 2982 | 2026.08.17 23:52:47.668408 [ 425232 ] {} <Debug> TCP-Session: 539fb0ac-5129-41b5-ab71-a47c35d7361b Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2983 | 2026.08.17 23:52:47.668425 [ 423966 ] {} <Debug> TCP-Session: 60abaf07-3f4c-4286-9309-b99f8a022a2a Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2984 | 2026.08.17 23:52:47.687650 [ 423966 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41618 | ||
| 2985 | 2026.08.17 23:52:47.687689 [ 423966 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 2986 | 2026.08.17 23:52:47.687697 [ 423966 ] {} <Debug> TCP-Session: 80153cf8-c552-4d7a-b1aa-b06a90534a72 Authenticating user 'default' from [::1]:41618 | ||
| 2987 | 2026.08.17 23:52:47.687709 [ 423966 ] {} <Debug> TCP-Session: 80153cf8-c552-4d7a-b1aa-b06a90534a72 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2988 | 2026.08.17 23:52:47.687715 [ 423966 ] {} <Debug> TCP-Session: 80153cf8-c552-4d7a-b1aa-b06a90534a72 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2989 | 2026.08.17 23:52:47.688177 [ 423965 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41620 | ||
| 2990 | 2026.08.17 23:52:47.688203 [ 425230 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41624 | ||
| 2991 | 2026.08.17 23:52:47.688207 [ 425231 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41626 | ||
| 2992 | 2026.08.17 23:52:47.688230 [ 425233 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41630 | ||
| 2993 | 2026.08.17 23:52:47.688232 [ 425232 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41628 | ||
| 2994 | 2026.08.17 23:52:47.688240 [ 425234 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41632 | ||
| 2995 | 2026.08.17 23:52:47.688243 [ 423967 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41622 | ||
| 2996 | 2026.08.17 23:52:47.688263 [ 423965 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 2997 | 2026.08.17 23:52:47.688268 [ 423965 ] {} <Debug> TCP-Session: 0845d4d4-e6e6-41e7-86d8-490918874adb Authenticating user 'default' from [::1]:41620 | ||
| 2998 | 2026.08.17 23:52:47.688271 [ 423965 ] {} <Debug> TCP-Session: 0845d4d4-e6e6-41e7-86d8-490918874adb Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 2999 | 2026.08.17 23:52:47.688273 [ 423965 ] {} <Debug> TCP-Session: 0845d4d4-e6e6-41e7-86d8-490918874adb Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3000 | 2026.08.17 23:52:47.688282 [ 423967 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3001 | 2026.08.17 23:52:47.688288 [ 425230 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3002 | 2026.08.17 23:52:47.688289 [ 423967 ] {} <Debug> TCP-Session: d51ae026-431a-4e04-99c1-2a59b2933c1c Authenticating user 'default' from [::1]:41622 | ||
| 3003 | 2026.08.17 23:52:47.688294 [ 425230 ] {} <Debug> TCP-Session: c955d43c-9d4b-46f8-a278-7371252d22b4 Authenticating user 'default' from [::1]:41624 | ||
| 3004 | 2026.08.17 23:52:47.688299 [ 423967 ] {} <Debug> TCP-Session: d51ae026-431a-4e04-99c1-2a59b2933c1c Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3005 | 2026.08.17 23:52:47.688307 [ 425230 ] {} <Debug> TCP-Session: c955d43c-9d4b-46f8-a278-7371252d22b4 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3006 | 2026.08.17 23:52:47.688311 [ 425230 ] {} <Debug> TCP-Session: c955d43c-9d4b-46f8-a278-7371252d22b4 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3007 | 2026.08.17 23:52:47.688308 [ 423967 ] {} <Debug> TCP-Session: d51ae026-431a-4e04-99c1-2a59b2933c1c Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3008 | 2026.08.17 23:52:47.688319 [ 425232 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3009 | 2026.08.17 23:52:47.688315 [ 425231 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3010 | 2026.08.17 23:52:47.688325 [ 425232 ] {} <Debug> TCP-Session: fd677bd6-ff20-414e-abe2-bed39cb48166 Authenticating user 'default' from [::1]:41628 | ||
| 3011 | 2026.08.17 23:52:47.688332 [ 425231 ] {} <Debug> TCP-Session: 6a70e460-b5c0-4c61-a8a2-de72a4c25aa1 Authenticating user 'default' from [::1]:41626 | ||
| 3012 | 2026.08.17 23:52:47.688336 [ 425232 ] {} <Debug> TCP-Session: fd677bd6-ff20-414e-abe2-bed39cb48166 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3013 | 2026.08.17 23:52:47.688337 [ 425233 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3014 | 2026.08.17 23:52:47.688337 [ 425231 ] {} <Debug> TCP-Session: 6a70e460-b5c0-4c61-a8a2-de72a4c25aa1 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3015 | 2026.08.17 23:52:47.688340 [ 425232 ] {} <Debug> TCP-Session: fd677bd6-ff20-414e-abe2-bed39cb48166 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3016 | 2026.08.17 23:52:47.688344 [ 425234 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3017 | 2026.08.17 23:52:47.688345 [ 425231 ] {} <Debug> TCP-Session: 6a70e460-b5c0-4c61-a8a2-de72a4c25aa1 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3018 | 2026.08.17 23:52:47.688349 [ 425233 ] {} <Debug> TCP-Session: 7388c6af-92bd-4ba6-849b-18be48177a07 Authenticating user 'default' from [::1]:41630 | ||
| 3019 | 2026.08.17 23:52:47.688358 [ 425234 ] {} <Debug> TCP-Session: 5ef91999-fdcb-4eed-82ce-c0ac17e409f5 Authenticating user 'default' from [::1]:41632 | ||
| 3020 | 2026.08.17 23:52:47.688367 [ 425233 ] {} <Debug> TCP-Session: 7388c6af-92bd-4ba6-849b-18be48177a07 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3021 | 2026.08.17 23:52:47.688369 [ 425234 ] {} <Debug> TCP-Session: 5ef91999-fdcb-4eed-82ce-c0ac17e409f5 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3022 | 2026.08.17 23:52:47.688370 [ 425233 ] {} <Debug> TCP-Session: 7388c6af-92bd-4ba6-849b-18be48177a07 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3023 | 2026.08.17 23:52:47.688372 [ 425234 ] {} <Debug> TCP-Session: 5ef91999-fdcb-4eed-82ce-c0ac17e409f5 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3024 | 2026.08.17 23:52:47.688472 [ 425235 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41634 | ||
| 3025 | 2026.08.17 23:52:47.688586 [ 425235 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3026 | 2026.08.17 23:52:47.688590 [ 425235 ] {} <Debug> TCP-Session: 311bbc77-90f5-4578-a93b-05b9706584c4 Authenticating user 'default' from [::1]:41634 | ||
| 3027 | 2026.08.17 23:52:47.688594 [ 425235 ] {} <Debug> TCP-Session: 311bbc77-90f5-4578-a93b-05b9706584c4 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3028 | 2026.08.17 23:52:47.688596 [ 425235 ] {} <Debug> TCP-Session: 311bbc77-90f5-4578-a93b-05b9706584c4 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3029 | 2026.08.17 23:52:48.000389 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 435.81 MiB, peak 449.73 MiB, free memory in arenas 72.20 MiB, will set to 439.88 MiB (RSS), difference: 4.06 MiB | ||
| 3030 | 2026.08.17 23:52:48.838446 [ 424359 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 3031 | 2026.08.17 23:52:48.838467 [ 424359 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper | ||
| 3032 | 2026.08.17 23:52:48.847042 [ 424359 ] {} <Information> ZooKeeperClient: Connected to ZooKeeper at [::1]:19001 with session_id 17 | ||
| 3033 | 2026.08.17 23:52:48.847134 [ 424359 ] {} <Information> ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled | ||
| 3034 | 2026.08.17 23:52:48.847138 [ 424359 ] {} <Information> ZooKeeperClient: Keeper feature flag MULTI_READ: enabled | ||
| 3035 | 2026.08.17 23:52:48.847139 [ 424359 ] {} <Information> ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled | ||
| 3036 | 2026.08.17 23:52:48.847143 [ 424359 ] {} <Trace> ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19003 | ||
| 3037 | 2026.08.17 23:52:48.847148 [ 424359 ] {} <Debug> Context: Establishing a new connection with ZooKeeper took 8 ms | ||
| 3038 | 2026.08.17 23:52:48.847151 [ 424359 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 3039 | 2026.08.17 23:52:48.854752 [ 424359 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 3040 | 2026.08.17 23:52:48.854804 [ 424359 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 3041 | 2026.08.17 23:52:48.854806 [ 424359 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue | ||
| 3042 | 2026.08.17 23:52:48.854841 [ 424359 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 3043 | 2026.08.17 23:52:48.854891 [ 424359 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 3044 | 2026.08.17 23:52:48.855181 [ 424359 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 3045 | 2026.08.17 23:52:48.855222 [ 424416 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73438660608, merge_with_ttl_allowedtrue) | ||
| 3046 | 2026.08.17 23:52:48.855236 [ 424416 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 30612ms | ||
| 3047 | 2026.08.17 23:52:48.855377 [ 424308 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 4 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks | ||
| 3048 | 2026.08.17 23:52:48.855473 [ 424308 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32781ms, ratio: 0, points per minute: 0) | ||
| 3049 | 2026.08.17 23:52:48.936522 [ 424397 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 3050 | 2026.08.17 23:52:48.936595 [ 424397 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 3051 | 2026.08.17 23:52:48.936863 [ 424347 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 3052 | 2026.08.17 23:52:48.936876 [ 424347 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 3053 | 2026.08.17 23:52:48.937202 [ 424339 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 3054 | 2026.08.17 23:52:48.937213 [ 424339 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 3055 | 2026.08.17 23:52:48.937588 [ 424389 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table was in readonly mode. Will try to activate it. | ||
| 3056 | 2026.08.17 23:52:48.937614 [ 424389 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up | ||
| 3057 | 2026.08.17 23:52:48.957165 [ 424397 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 3058 | 2026.08.17 23:52:48.957169 [ 424389 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 3059 | 2026.08.17 23:52:48.957224 [ 424347 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 3060 | 2026.08.17 23:52:48.957226 [ 424339 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue | ||
| 3061 | 2026.08.17 23:52:48.957229 [ 424389 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 3062 | 2026.08.17 23:52:48.957233 [ 424389 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue | ||
| 3063 | 2026.08.17 23:52:48.957227 [ 424397 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Queue initialized | ||
| 3064 | 2026.08.17 23:52:48.957240 [ 424397 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue | ||
| 3065 | 2026.08.17 23:52:48.957276 [ 424389 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 3066 | 2026.08.17 23:52:48.957277 [ 424347 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 3067 | 2026.08.17 23:52:48.957276 [ 424397 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 3068 | 2026.08.17 23:52:48.957282 [ 424347 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue | ||
| 3069 | 2026.08.17 23:52:48.957278 [ 424339 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized | ||
| 3070 | 2026.08.17 23:52:48.957298 [ 424339 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue | ||
| 3071 | 2026.08.17 23:52:48.957315 [ 424389 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 3072 | 2026.08.17 23:52:48.957321 [ 424397 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Loaded queue | ||
| 3073 | 2026.08.17 23:52:48.957337 [ 424339 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 3074 | 2026.08.17 23:52:48.957339 [ 424347 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. | ||
| 3075 | 2026.08.17 23:52:48.957422 [ 424339 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 3076 | 2026.08.17 23:52:48.957425 [ 424347 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue | ||
| 3077 | 2026.08.17 23:52:48.960832 [ 424397 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 3078 | 2026.08.17 23:52:48.960867 [ 424329 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 9775ms | ||
| 3079 | 2026.08.17 23:52:48.960868 [ 424389 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 3080 | 2026.08.17 23:52:48.960890 [ 424340 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73438576640, merge_with_ttl_allowedtrue) | ||
| 3081 | 2026.08.17 23:52:48.960902 [ 424340 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 26964ms | ||
| 3082 | 2026.08.17 23:52:48.960954 [ 424347 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 3083 | 2026.08.17 23:52:48.960967 [ 424339 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully | ||
| 3084 | 2026.08.17 23:52:48.960974 [ 424350 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73438576640, merge_with_ttl_allowedtrue) | ||
| 3085 | 2026.08.17 23:52:48.960983 [ 424350 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 13457ms | ||
| 3086 | 2026.08.17 23:52:48.960980 [ 424341 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73438576640, merge_with_ttl_allowedtrue) | ||
| 3087 | 2026.08.17 23:52:48.960991 [ 424341 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 21336ms | ||
| 3088 | 2026.08.17 23:52:48.964199 [ 424376 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 4 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks | ||
| 3089 | 2026.08.17 23:52:48.967254 [ 424397 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32894ms, ratio: 0, points per minute: 0) | ||
| 3090 | 2026.08.17 23:52:48.967267 [ 424290 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks | ||
| 3091 | 2026.08.17 23:52:48.967307 [ 424376 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32893ms, ratio: 0, points per minute: 0) | ||
| 3092 | 2026.08.17 23:52:48.967321 [ 424297 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32893ms, ratio: 0, points per minute: 0) | ||
| 3093 | 2026.08.17 23:52:48.967358 [ 424290 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32893ms, ratio: 0, points per minute: 0) | ||
| 3094 | 2026.08.17 23:52:51.006505 [ 424380 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3095 | 2026.08.17 23:52:51.006532 [ 424380 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3096 | 2026.08.17 23:52:51.053835 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 11704 | ||
| 3097 | 2026.08.17 23:52:51.054931 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3098 | 2026.08.17 23:52:51.054943 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.79 GiB. | ||
| 3099 | 2026.08.17 23:52:51.055330 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_6_6_0 (state Temporary) | ||
| 3100 | 2026.08.17 23:52:51.055459 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_6_6_0 to 202608_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3101 | 2026.08.17 23:52:51.055530 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 11704 | ||
| 3102 | 2026.08.17 23:52:51.055530 [ 424394 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_1_0 to 202608_6_6_0 | ||
| 3103 | 2026.08.17 23:52:51.055544 [ 424394 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3104 | 2026.08.17 23:52:51.055549 [ 424394 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.79 GiB. | ||
| 3105 | 2026.08.17 23:52:51.055666 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_1_0 to 202608_6_6_0 into Compact with storage Full | ||
| 3106 | 2026.08.17 23:52:51.055704 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3107 | 2026.08.17 23:52:51.055719 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_1_0, total 2360 rows starting from the beginning of the part | ||
| 3108 | 2026.08.17 23:52:51.055768 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_2_2_0, total 972 rows starting from the beginning of the part | ||
| 3109 | 2026.08.17 23:52:51.055783 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_3_3_0, total 966 rows starting from the beginning of the part | ||
| 3110 | 2026.08.17 23:52:51.055797 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_4_4_0, total 2576 rows starting from the beginning of the part | ||
| 3111 | 2026.08.17 23:52:51.055825 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_5_5_0, total 2254 rows starting from the beginning of the part | ||
| 3112 | 2026.08.17 23:52:51.055838 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_6_6_0, total 2576 rows starting from the beginning of the part | ||
| 3113 | 2026.08.17 23:52:51.057695 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 11704 rows, containing 4 columns (4 merged, 0 gathered) in 0.002085191 sec., 5612915.075885135 rows/sec., 85.65 MiB/sec. | ||
| 3114 | 2026.08.17 23:52:51.057938 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Trace> MergedBlockOutputStream: filled checksums 202608_1_6_1 (state Temporary) | ||
| 3115 | 2026.08.17 23:52:51.058060 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_6_1 to 202608_1_6_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3116 | 2026.08.17 23:52:51.058079 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_6_1} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_1_0, 202608_6_6_0] -> 202608_1_6_1 | ||
| 3117 | 2026.08.17 23:52:51.058117 [ 424472 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 6.86 MiB. | ||
| 3118 | 2026.08.17 23:52:51.123739 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 46 | ||
| 3119 | 2026.08.17 23:52:51.131042 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3120 | 2026.08.17 23:52:51.131055 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.79 GiB. | ||
| 3121 | 2026.08.17 23:52:51.134526 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_6_6_0 (state Temporary) | ||
| 3122 | 2026.08.17 23:52:51.137097 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_6_6_0 to 202608_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3123 | 2026.08.17 23:52:51.137252 [ 424407 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_1_0 to 202608_6_6_0 | ||
| 3124 | 2026.08.17 23:52:51.137265 [ 424407 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3125 | 2026.08.17 23:52:51.137269 [ 424407 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.79 GiB. | ||
| 3126 | 2026.08.17 23:52:51.137403 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_1_0 to 202608_6_6_0 into Compact with storage Full | ||
| 3127 | 2026.08.17 23:52:51.137891 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 46 | ||
| 3128 | 2026.08.17 23:52:51.140130 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3129 | 2026.08.17 23:52:51.140500 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_1_0, total 8 rows starting from the beginning of the part | ||
| 3130 | 2026.08.17 23:52:51.142389 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_2_2_0, total 8 rows starting from the beginning of the part | ||
| 3131 | 2026.08.17 23:52:51.144251 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_3_3_0, total 7 rows starting from the beginning of the part | ||
| 3132 | 2026.08.17 23:52:51.146136 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_4_4_0, total 8 rows starting from the beginning of the part | ||
| 3133 | 2026.08.17 23:52:51.148014 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_5_5_0, total 7 rows starting from the beginning of the part | ||
| 3134 | 2026.08.17 23:52:51.150017 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_6_6_0, total 8 rows starting from the beginning of the part | ||
| 3135 | 2026.08.17 23:52:51.176037 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 46 rows, containing 679 columns (679 merged, 0 gathered) in 0.038680658 sec., 1189.2248575502515 rows/sec., 2.13 MiB/sec. | ||
| 3136 | 2026.08.17 23:52:51.176623 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Trace> MergedBlockOutputStream: filled checksums 202608_1_6_1 (state Temporary) | ||
| 3137 | 2026.08.17 23:52:51.180022 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_6_1 to 202608_1_6_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3138 | 2026.08.17 23:52:51.180050 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_6_1} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_1_0, 202608_6_6_0] -> 202608_1_6_1 | ||
| 3139 | 2026.08.17 23:52:51.180455 [ 424485 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 10.64 MiB. | ||
| 3140 | 2026.08.17 23:52:51.941347 [ 425085 ] {} <Debug> DDLWorker: Initialized DDLWorker thread | ||
| 3141 | 2026.08.17 23:52:51.941359 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 3142 | 2026.08.17 23:52:51.941362 [ 425085 ] {} <Information> DDLWorker: Have 1 unfinished tasks, will check them | ||
| 3143 | 2026.08.17 23:52:51.941367 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 3144 | 2026.08.17 23:52:51.941504 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=21, queue_size=21, entries=query-0000000000..query-0000000020, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000019, last_skipped_entry_name=none | ||
| 3145 | 2026.08.17 23:52:51.941507 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000020 | ||
| 3146 | 2026.08.17 23:52:51.941510 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000020 | ||
| 3147 | 2026.08.17 23:52:51.941840 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000020 (CREATE DATABASE IF NOT EXISTS oximeter UUID '15508b34-d1c9-4a0a-a3d5-a44fcdaaa6b2') | ||
| 3148 | 2026.08.17 23:52:51.945101 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID '15508b34-d1c9-4a0a-a3d5-a44fcdaaa6b2' | ||
| 3149 | 2026.08.17 23:52:51.945145 [ 425085 ] {613695eb-7cf9-41f0-b066-36bc0dc8a8ac} <Trace> executeQuery: Query span trace_id for opentelemetry log: 129329e1-3e39-428f-1fdc-af0961e322b9 | ||
| 3150 | 2026.08.17 23:52:51.945161 [ 425085 ] {613695eb-7cf9-41f0-b066-36bc0dc8a8ac} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 680aa279-d059-461a-9f5e-60b39f1237ea) /* ddl_entry=query-0000000020 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '15508b34-d1c9-4a0a-a3d5-a44fcdaaa6b2' (stage: Complete) | ||
| 3151 | 2026.08.17 23:52:51.945228 [ 425085 ] {613695eb-7cf9-41f0-b066-36bc0dc8a8ac} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000020 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '15508b34-d1c9-4a0a-a3d5-a44fcdaaa6b2' | ||
| 3152 | 2026.08.17 23:52:51.948464 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 3153 | 2026.08.17 23:52:52.000352 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 439.37 MiB, peak 451.31 MiB, free memory in arenas 96.96 MiB, will set to 455.26 MiB (RSS), difference: 15.89 MiB | ||
| 3154 | 2026.08.17 23:52:53.037746 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 3155 | 2026.08.17 23:52:53.037750 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 3156 | 2026.08.17 23:52:53.040979 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=22, queue_size=22, entries=query-0000000000..query-0000000021, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000020, last_skipped_entry_name=none | ||
| 3157 | 2026.08.17 23:52:53.040989 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000021 | ||
| 3158 | 2026.08.17 23:52:53.040992 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000021 | ||
| 3159 | 2026.08.17 23:52:53.041258 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000021 (CREATE TABLE IF NOT EXISTS oximeter.version UUID '4628b84b-456f-4f0e-9a48-6dc5825cfbd1' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)) | ||
| 3160 | 2026.08.17 23:52:53.047513 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID '4628b84b-456f-4f0e-9a48-6dc5825cfbd1' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) | ||
| 3161 | 2026.08.17 23:52:53.047550 [ 425085 ] {92b18402-e3e7-4152-8785-74ac6706c026} <Trace> executeQuery: Query span trace_id for opentelemetry log: 7e8fcb1f-01e3-6429-6d72-e02392538572 | ||
| 3162 | 2026.08.17 23:52:53.047591 [ 425085 ] {92b18402-e3e7-4152-8785-74ac6706c026} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e78704b5-17fe-4b81-beb6-c949f95dfb17) /* ddl_entry=query-0000000021 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '4628b84b-456f-4f0e-9a48-6dc5825cfbd1' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) | ||
| 3163 | 2026.08.17 23:52:53.047663 [ 425085 ] {92b18402-e3e7-4152-8785-74ac6706c026} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000021 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '4628b84b-456f-4f0e-9a48-6dc5825cfbd1' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) | ||
| 3164 | 2026.08.17 23:52:53.056753 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 3165 | 2026.08.17 23:52:53.148849 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 3166 | 2026.08.17 23:52:53.148854 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 3167 | 2026.08.17 23:52:53.148934 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=23, queue_size=23, entries=query-0000000000..query-0000000022, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000021, last_skipped_entry_name=none | ||
| 3168 | 2026.08.17 23:52:53.148939 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000022 | ||
| 3169 | 2026.08.17 23:52:53.148941 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000022 | ||
| 3170 | 2026.08.17 23:52:53.152263 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000022 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fa926c01-f931-4a9f-b027-b426f325ccc0' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) | ||
| 3171 | 2026.08.17 23:52:53.158424 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fa926c01-f931-4a9f-b027-b426f325ccc0' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) | ||
| 3172 | 2026.08.17 23:52:53.158448 [ 425085 ] {118b2fd2-865b-442b-8c73-ca7af5dfb760} <Trace> executeQuery: Query span trace_id for opentelemetry log: 0f27273a-965d-2ffb-461b-0595fbdcb9d1 | ||
| 3173 | 2026.08.17 23:52:53.158496 [ 425085 ] {118b2fd2-865b-442b-8c73-ca7af5dfb760} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: bcd45197-4e8e-4d50-9280-ac5e06c5560f) /* ddl_entry=query-0000000022 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fa926c01-f931-4a9f-b027-b426f325ccc0' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) | ||
| 3174 | 2026.08.17 23:52:53.158573 [ 425085 ] {118b2fd2-865b-442b-8c73-ca7af5dfb760} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000022 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fa926c01-f931-4a9f-b027-b426f325ccc0' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) | ||
| 3175 | 2026.08.17 23:52:53.164492 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 3176 | 2026.08.17 23:52:53.268801 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 3177 | 2026.08.17 23:52:53.268806 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 3178 | 2026.08.17 23:52:53.271945 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=24, queue_size=24, entries=query-0000000000..query-0000000023, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000022, last_skipped_entry_name=none | ||
| 3179 | 2026.08.17 23:52:53.271949 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000023 | ||
| 3180 | 2026.08.17 23:52:53.271952 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000023 | ||
| 3181 | 2026.08.17 23:52:53.272192 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000023 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '1c7e8baa-124b-488e-98ae-912d8d8035f2' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 3182 | 2026.08.17 23:52:53.278307 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '1c7e8baa-124b-488e-98ae-912d8d8035f2' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 3183 | 2026.08.17 23:52:53.278335 [ 425085 ] {8e42b148-eb35-499a-9a31-ccbe88a8949b} <Trace> executeQuery: Query span trace_id for opentelemetry log: d1822001-63fc-6eca-3501-3ec068599320 | ||
| 3184 | 2026.08.17 23:52:53.278380 [ 425085 ] {8e42b148-eb35-499a-9a31-ccbe88a8949b} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 702b80e3-af8f-4743-808e-8ed1a53a4309) /* ddl_entry=query-0000000023 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '1c7e8baa-124b-488e-98ae-912d8d8035f2' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 3185 | 2026.08.17 23:52:53.278483 [ 425085 ] {8e42b148-eb35-499a-9a31-ccbe88a8949b} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000023 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '1c7e8baa-124b-488e-98ae-912d8d8035f2' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 3186 | 2026.08.17 23:52:53.287428 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 3187 | 2026.08.17 23:52:53.384240 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 3188 | 2026.08.17 23:52:53.384245 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 3189 | 2026.08.17 23:52:53.387309 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=25, queue_size=25, entries=query-0000000000..query-0000000024, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000023, last_skipped_entry_name=none | ||
| 3190 | 2026.08.17 23:52:53.387313 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000024 | ||
| 3191 | 2026.08.17 23:52:53.387315 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000024 | ||
| 3192 | 2026.08.17 23:52:53.387493 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000024 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '9a6deda6-8e53-450c-b73c-2d5dded3d2dd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) | ||
| 3193 | 2026.08.17 23:52:53.390595 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '9a6deda6-8e53-450c-b73c-2d5dded3d2dd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 3194 | 2026.08.17 23:52:53.390618 [ 425085 ] {0078b07e-9026-439d-83a4-95a33a0a7a0a} <Trace> executeQuery: Query span trace_id for opentelemetry log: 2c670ba3-f73a-1953-5062-9954240e4195 | ||
| 3195 | 2026.08.17 23:52:53.390684 [ 425085 ] {0078b07e-9026-439d-83a4-95a33a0a7a0a} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 73428e74-540c-4b15-a685-62b0888efb95) /* ddl_entry=query-0000000024 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '9a6deda6-8e53-450c-b73c-2d5dded3d2dd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) | ||
| 3196 | 2026.08.17 23:52:53.390825 [ 425085 ] {0078b07e-9026-439d-83a4-95a33a0a7a0a} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000024 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '9a6deda6-8e53-450c-b73c-2d5dded3d2dd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 3197 | 2026.08.17 23:52:53.399556 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 3198 | 2026.08.17 23:52:53.494582 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 3199 | 2026.08.17 23:52:53.494587 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 3200 | 2026.08.17 23:52:53.494643 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=26, queue_size=26, entries=query-0000000000..query-0000000025, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000024, last_skipped_entry_name=none | ||
| 3201 | 2026.08.17 23:52:53.494647 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000025 | ||
| 3202 | 2026.08.17 23:52:53.494649 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000025 | ||
| 3203 | 2026.08.17 23:52:53.497774 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000025 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '6bae2d1b-42e7-4517-b0f8-c17720227858' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 3204 | 2026.08.17 23:52:53.500818 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '6bae2d1b-42e7-4517-b0f8-c17720227858' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 3205 | 2026.08.17 23:52:53.500840 [ 425085 ] {e7904f09-4998-4dfb-8491-74cfb0ccb240} <Trace> executeQuery: Query span trace_id for opentelemetry log: ad335a2e-a58e-3149-a29c-0d2b17b9be8a | ||
| 3206 | 2026.08.17 23:52:53.500876 [ 425085 ] {e7904f09-4998-4dfb-8491-74cfb0ccb240} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c32b927e-2f1f-410a-8847-47d75e3149a7) /* ddl_entry=query-0000000025 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '6bae2d1b-42e7-4517-b0f8-c17720227858' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 3207 | 2026.08.17 23:52:53.500975 [ 425085 ] {e7904f09-4998-4dfb-8491-74cfb0ccb240} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000025 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '6bae2d1b-42e7-4517-b0f8-c17720227858' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 3208 | 2026.08.17 23:52:53.506947 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 3209 | 2026.08.17 23:52:53.606761 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 3210 | 2026.08.17 23:52:53.606768 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 3211 | 2026.08.17 23:52:53.606832 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=27, queue_size=27, entries=query-0000000000..query-0000000026, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000025, last_skipped_entry_name=none | ||
| 3212 | 2026.08.17 23:52:53.606835 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000026 | ||
| 3213 | 2026.08.17 23:52:53.606837 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000026 | ||
| 3214 | 2026.08.17 23:52:53.610481 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000026 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '851f63af-5345-4349-8fa7-9dc67654fad8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) | ||
| 3215 | 2026.08.17 23:52:53.617062 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '851f63af-5345-4349-8fa7-9dc67654fad8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 3216 | 2026.08.17 23:52:53.617087 [ 425085 ] {98cfabd3-6f6d-4871-a80e-b630712482f2} <Trace> executeQuery: Query span trace_id for opentelemetry log: 22f43aa1-0a08-fa74-dc3c-7116e51f8bee | ||
| 3217 | 2026.08.17 23:52:53.617157 [ 425085 ] {98cfabd3-6f6d-4871-a80e-b630712482f2} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 838e5c77-1260-4bc7-b509-ca0ae210d474) /* ddl_entry=query-0000000026 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '851f63af-5345-4349-8fa7-9dc67654fad8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) | ||
| 3218 | 2026.08.17 23:52:53.617270 [ 425085 ] {98cfabd3-6f6d-4871-a80e-b630712482f2} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000026 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '851f63af-5345-4349-8fa7-9dc67654fad8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) | ||
| 3219 | 2026.08.17 23:52:53.626504 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 3220 | 2026.08.17 23:52:53.724481 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 3221 | 2026.08.17 23:52:53.724498 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 3222 | 2026.08.17 23:52:53.724548 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=28, queue_size=28, entries=query-0000000000..query-0000000027, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000026, last_skipped_entry_name=none | ||
| 3223 | 2026.08.17 23:52:53.724552 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000027 | ||
| 3224 | 2026.08.17 23:52:53.724554 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000027 | ||
| 3225 | 2026.08.17 23:52:53.727783 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000027 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '406c7adf-1cf3-4de6-ab73-b7a16eca33c6' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 3226 | 2026.08.17 23:52:53.730891 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '406c7adf-1cf3-4de6-ab73-b7a16eca33c6' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 3227 | 2026.08.17 23:52:53.730913 [ 425085 ] {ae36a1d2-081f-4eca-995c-fdd2dabdb655} <Trace> executeQuery: Query span trace_id for opentelemetry log: 7d503ba1-8322-ec05-bacf-d12c558531a7 | ||
| 3228 | 2026.08.17 23:52:53.730950 [ 425085 ] {ae36a1d2-081f-4eca-995c-fdd2dabdb655} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b0f670d9-bfd1-4760-9bba-c839e9238ec2) /* ddl_entry=query-0000000027 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '406c7adf-1cf3-4de6-ab73-b7a16eca33c6' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 3229 | 2026.08.17 23:52:53.731049 [ 425085 ] {ae36a1d2-081f-4eca-995c-fdd2dabdb655} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000027 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '406c7adf-1cf3-4de6-ab73-b7a16eca33c6' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 3230 | 2026.08.17 23:52:53.736913 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 3231 | 2026.08.17 23:52:53.844441 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 3232 | 2026.08.17 23:52:53.844446 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 3233 | 2026.08.17 23:52:53.844515 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=29, queue_size=29, entries=query-0000000000..query-0000000028, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000027, last_skipped_entry_name=none | ||
| 3234 | 2026.08.17 23:52:53.844519 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000028 | ||
| 3235 | 2026.08.17 23:52:53.844521 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000028 | ||
| 3236 | 2026.08.17 23:52:53.847799 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000028 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'c3db170a-857c-4375-9f45-d6439d6bb792' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)) | ||
| 3237 | 2026.08.17 23:52:53.850862 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'c3db170a-857c-4375-9f45-d6439d6bb792' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) | ||
| 3238 | 2026.08.17 23:52:53.850888 [ 425085 ] {6561bc97-54e7-48e6-a43e-59d43834d824} <Trace> executeQuery: Query span trace_id for opentelemetry log: dde3d52d-0cf7-409f-6bd1-f4e9077524ff | ||
| 3239 | 2026.08.17 23:52:53.850957 [ 425085 ] {6561bc97-54e7-48e6-a43e-59d43834d824} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 34824996-e41e-4330-bcca-adae0fd29b48) /* ddl_entry=query-0000000028 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'c3db170a-857c-4375-9f45-d6439d6bb792' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) | ||
| 3240 | 2026.08.17 23:52:53.851113 [ 425085 ] {6561bc97-54e7-48e6-a43e-59d43834d824} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000028 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'c3db170a-857c-4375-9f45-d6439d6bb792' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) | ||
| 3241 | 2026.08.17 23:52:53.859972 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 3242 | 2026.08.17 23:52:53.958220 [ 425085 ] {} <Debug> DDLWorker: Scheduling tasks | ||
| 3243 | 2026.08.17 23:52:53.958226 [ 425084 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later. | ||
| 3244 | 2026.08.17 23:52:53.958286 [ 425085 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=30, queue_size=30, entries=query-0000000000..query-0000000029, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000028, last_skipped_entry_name=none | ||
| 3245 | 2026.08.17 23:52:53.958290 [ 425085 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000029 | ||
| 3246 | 2026.08.17 23:52:53.958291 [ 425085 ] {} <Trace> DDLWorker: Checking task query-0000000029 | ||
| 3247 | 2026.08.17 23:52:53.961538 [ 425085 ] {} <Debug> DDLWorker: Processing task query-0000000029 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fd0d2ebe-1312-4365-ba64-01e34ea76077' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))) | ||
| 3248 | 2026.08.17 23:52:53.964597 [ 425085 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fd0d2ebe-1312-4365-ba64-01e34ea76077' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 3249 | 2026.08.17 23:52:53.964624 [ 425085 ] {2cc0dea2-4f10-429f-9edc-d168be9fde5a} <Trace> executeQuery: Query span trace_id for opentelemetry log: 62d9e2cd-6c78-4a27-e533-fe25a97e466b | ||
| 3250 | 2026.08.17 23:52:53.964687 [ 425085 ] {2cc0dea2-4f10-429f-9edc-d168be9fde5a} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 64bac3d9-8021-42f4-822c-1a8983c77ed7) /* ddl_entry=query-0000000029 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fd0d2ebe-1312-4365-ba64-01e34ea76077' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) | ||
| 3251 | 2026.08.17 23:52:53.964813 [ 425085 ] {2cc0dea2-4f10-429f-9edc-d168be9fde5a} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000029 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fd0d2ebe-1312-4365-ba64-01e34ea76077' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) | ||
| 3252 | 2026.08.17 23:52:53.970571 [ 425085 ] {} <Debug> DDLWorker: Waiting for queue updates | ||
| 3253 | 2026.08.17 23:52:54.063624 [ 423966 ] {} <Trace> TCP-Session: 80153cf8-c552-4d7a-b1aa-b06a90534a72 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default | ||
| 3254 | 2026.08.17 23:52:54.063691 [ 423966 ] {6a1f39e2-ccbf-4810-99d2-a21b86a3ced6} <Trace> executeQuery: Query span trace_id for opentelemetry log: a8b02e66-bb0b-fb80-bae3-f986e7fab6d8 | ||
| 3255 | 2026.08.17 23:52:54.063740 [ 423966 ] {6a1f39e2-ccbf-4810-99d2-a21b86a3ced6} <Debug> executeQuery: (from [::1]:41618) SELECT name FROM system.tables WHERE database = 'oximeter' AND engine = 'ReplicatedMergeTree' (stage: Complete) | ||
| 3256 | 2026.08.17 23:52:54.063937 [ 423966 ] {6a1f39e2-ccbf-4810-99d2-a21b86a3ced6} <Trace> ContextAccess (default): Access granted: SELECT(database, name, engine) ON system.tables | ||
| 3257 | 2026.08.17 23:52:54.064021 [ 423966 ] {6a1f39e2-ccbf-4810-99d2-a21b86a3ced6} <Trace> InterpreterSelectQuery: FetchColumns -> Complete | ||
| 3258 | 2026.08.17 23:52:54.064170 [ 430355 ] {6a1f39e2-ccbf-4810-99d2-a21b86a3ced6} <Trace> ContextAccess (default): Access granted: SHOW TABLES ON *.* | ||
| 3259 | 2026.08.17 23:52:54.064284 [ 423966 ] {6a1f39e2-ccbf-4810-99d2-a21b86a3ced6} <Debug> executeQuery: Read 9 rows, 631.00 B in 0.000585 sec., 15384.615384615385 rows/sec., 1.03 MiB/sec. | ||
| 3260 | 2026.08.17 23:52:54.064307 [ 423966 ] {6a1f39e2-ccbf-4810-99d2-a21b86a3ced6} <Debug> TCPHandler: Processed in 0.000740391 sec. | ||
| 3261 | 2026.08.17 23:52:54.083054 [ 424331 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000004 - log-0000000004 | ||
| 3262 | 2026.08.17 23:52:54.092711 [ 424331 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000004 to queue with type GET_PART with virtual parts [all_4_4_0] | ||
| 3263 | 2026.08.17 23:52:54.092719 [ 424331 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 3264 | 2026.08.17 23:52:54.105307 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Fetching part all_4_4_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1 | ||
| 3265 | 2026.08.17 23:52:54.108459 [ 424402 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000004 - log-0000000004 | ||
| 3266 | 2026.08.17 23:52:54.108484 [ 424465 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F1&part=all_4_4_0&client_protocol_version=8&compress=false | ||
| 3267 | 2026.08.17 23:52:54.109330 [ 424465 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3268 | 2026.08.17 23:52:54.109341 [ 424465 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.79 GiB. | ||
| 3269 | 2026.08.17 23:52:54.109344 [ 424465 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 3270 | 2026.08.17 23:52:54.109351 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Downloading part all_4_4_0 onto disk default. | ||
| 3271 | 2026.08.17 23:52:54.111352 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (Fetcher): Download of part all_4_4_0 onto disk default finished. | ||
| 3272 | 2026.08.17 23:52:54.111362 [ 424465 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Renaming temporary part tmp-fetch_all_4_4_0 to all_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3273 | 2026.08.17 23:52:54.111382 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Committing part all_4_4_0 to zookeeper | ||
| 3274 | 2026.08.17 23:52:54.115312 [ 424402 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000004 to queue with type GET_PART with virtual parts [all_4_4_0] | ||
| 3275 | 2026.08.17 23:52:54.115320 [ 424402 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 3276 | 2026.08.17 23:52:54.121534 [ 424404 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000003 - log-0000000003 | ||
| 3277 | 2026.08.17 23:52:54.133704 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Part all_4_4_0 committed to zookeeper | ||
| 3278 | 2026.08.17 23:52:54.133713 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Fetching part all_4_4_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1 | ||
| 3279 | 2026.08.17 23:52:54.133726 [ 424465 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Fetched part all_4_4_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1 | ||
| 3280 | 2026.08.17 23:52:54.133752 [ 424309 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Selected 5 parts from all_0_0_0 to all_4_4_0 | ||
| 3281 | 2026.08.17 23:52:54.133761 [ 424309 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 1 partitions with parts that may be merged: [all](max_total_size_to_merge=73436907520, merge_with_ttl_allowedtrue) | ||
| 3282 | 2026.08.17 23:52:54.136687 [ 424404 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000003 to queue with type GET_PART with virtual parts [all_4_4_0] | ||
| 3283 | 2026.08.17 23:52:54.136695 [ 424404 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 3284 | 2026.08.17 23:52:54.139746 [ 424487 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F1&part=all_4_4_0&client_protocol_version=8&compress=false | ||
| 3285 | 2026.08.17 23:52:54.148822 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Fetching part all_4_4_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1 | ||
| 3286 | 2026.08.17 23:52:54.148914 [ 424490 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F1&part=all_4_4_0&client_protocol_version=8&compress=false | ||
| 3287 | 2026.08.17 23:52:54.148950 [ 424309 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Selected 5 parts from all_0_0_0 to all_4_4_0 | ||
| 3288 | 2026.08.17 23:52:54.148971 [ 424490 ] {} <Trace> HTTPSessionAdapter: Created HTTP(S) session with ::1:19401 (::1:19401) | ||
| 3289 | 2026.08.17 23:52:54.155029 [ 424309 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Log entry is not created for merge all_0_4_1 because log was updated | ||
| 3290 | 2026.08.17 23:52:54.155035 [ 424309 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 22924ms | ||
| 3291 | 2026.08.17 23:52:54.155135 [ 424352 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000005 - log-0000000005 | ||
| 3292 | 2026.08.17 23:52:54.158315 [ 424352 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000005 to queue with type MERGE_PARTS with virtual parts [all_0_4_1] | ||
| 3293 | 2026.08.17 23:52:54.158320 [ 424352 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 3294 | 2026.08.17 23:52:54.158389 [ 424496 ] {} <Trace> 2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1 (MergeFromLogEntryTask): Executing log entry to merge parts all_0_0_0, all_1_1_0, all_2_2_0, all_3_3_0, all_4_4_0 to all_0_4_1 | ||
| 3295 | 2026.08.17 23:52:54.158412 [ 424496 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3296 | 2026.08.17 23:52:54.158419 [ 424496 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.79 GiB. | ||
| 3297 | 2026.08.17 23:52:54.158485 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Debug> MergeTask::PrepareStage: Merging 5 parts: from all_0_0_0 to all_4_4_0 into Compact with storage Full | ||
| 3298 | 2026.08.17 23:52:54.158537 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3299 | 2026.08.17 23:52:54.158549 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part all_0_0_0, total 8 rows starting from the beginning of the part | ||
| 3300 | 2026.08.17 23:52:54.158588 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part all_1_1_0, total 8 rows starting from the beginning of the part | ||
| 3301 | 2026.08.17 23:52:54.158610 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part all_2_2_0, total 8 rows starting from the beginning of the part | ||
| 3302 | 2026.08.17 23:52:54.158625 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part all_3_3_0, total 8 rows starting from the beginning of the part | ||
| 3303 | 2026.08.17 23:52:54.158642 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part all_4_4_0, total 8 rows starting from the beginning of the part | ||
| 3304 | 2026.08.17 23:52:54.158984 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 40 rows, containing 5 columns (5 merged, 0 gathered) in 0.00054662 sec., 73176.97852255679 rows/sec., 4.75 MiB/sec. | ||
| 3305 | 2026.08.17 23:52:54.159056 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Trace> MergedBlockOutputStream: filled checksums all_0_4_1 (state Temporary) | ||
| 3306 | 2026.08.17 23:52:54.159188 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Renaming temporary part tmp_merge_all_0_4_1 to all_0_4_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3307 | 2026.08.17 23:52:54.159210 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Merged 5 parts: [all_0_0_0, all_4_4_0] -> all_0_4_1 | ||
| 3308 | 2026.08.17 23:52:54.159223 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Committing part all_0_4_1 to zookeeper | ||
| 3309 | 2026.08.17 23:52:54.159297 [ 424487 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3310 | 2026.08.17 23:52:54.159636 [ 424490 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3311 | 2026.08.17 23:52:54.160748 [ 424487 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.79 GiB. | ||
| 3312 | 2026.08.17 23:52:54.160754 [ 424487 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 3313 | 2026.08.17 23:52:54.160759 [ 424490 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.79 GiB. | ||
| 3314 | 2026.08.17 23:52:54.160767 [ 424490 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' | ||
| 3315 | 2026.08.17 23:52:54.160759 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Downloading part all_4_4_0 onto disk default. | ||
| 3316 | 2026.08.17 23:52:54.160773 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Downloading part all_4_4_0 onto disk default. | ||
| 3317 | 2026.08.17 23:52:54.161175 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (Fetcher): Download of part all_4_4_0 onto disk default finished. | ||
| 3318 | 2026.08.17 23:52:54.161184 [ 424487 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Renaming temporary part tmp-fetch_all_4_4_0 to all_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3319 | 2026.08.17 23:52:54.161204 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Committing part all_4_4_0 to zookeeper | ||
| 3320 | 2026.08.17 23:52:54.161208 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (Fetcher): Download of part all_4_4_0 onto disk default finished. | ||
| 3321 | 2026.08.17 23:52:54.161218 [ 424490 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Renaming temporary part tmp-fetch_all_4_4_0 to all_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3322 | 2026.08.17 23:52:54.161236 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Committing part all_4_4_0 to zookeeper | ||
| 3323 | 2026.08.17 23:52:54.172076 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Part all_4_4_0 committed to zookeeper | ||
| 3324 | 2026.08.17 23:52:54.172083 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Part all_4_4_0 committed to zookeeper | ||
| 3325 | 2026.08.17 23:52:54.172095 [ 424487 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Fetched part all_4_4_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1 | ||
| 3326 | 2026.08.17 23:52:54.172113 [ 424490 ] {} <Debug> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Fetched part all_4_4_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1 | ||
| 3327 | 2026.08.17 23:52:54.172143 [ 424391 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73436657664, merge_with_ttl_allowedtrue) | ||
| 3328 | 2026.08.17 23:52:54.172155 [ 424391 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 37847ms | ||
| 3329 | 2026.08.17 23:52:54.172143 [ 424354 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73436657664, merge_with_ttl_allowedtrue) | ||
| 3330 | 2026.08.17 23:52:54.172169 [ 424354 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 26564ms | ||
| 3331 | 2026.08.17 23:52:54.175206 [ 424496 ] {2d79911c-8882-4309-a914-7e64c31972ae::all_0_4_1} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Part all_0_4_1 committed to zookeeper | ||
| 3332 | 2026.08.17 23:52:54.184329 [ 424496 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 3.27 MiB. | ||
| 3333 | 2026.08.17 23:52:54.184359 [ 424362 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73436637184, merge_with_ttl_allowedtrue) | ||
| 3334 | 2026.08.17 23:52:54.184369 [ 424362 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 27514ms | ||
| 3335 | 2026.08.17 23:52:54.289869 [ 423967 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3336 | 2026.08.17 23:52:54.289888 [ 423967 ] {} <Debug> TCP-Session: d51ae026-431a-4e04-99c1-2a59b2933c1c Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3337 | 2026.08.17 23:52:54.289914 [ 425233 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3338 | 2026.08.17 23:52:54.289941 [ 425233 ] {} <Debug> TCP-Session: 7388c6af-92bd-4ba6-849b-18be48177a07 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3339 | 2026.08.17 23:52:54.289968 [ 425230 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3340 | 2026.08.17 23:52:54.289980 [ 425234 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3341 | 2026.08.17 23:52:54.289983 [ 425230 ] {} <Debug> TCP-Session: c955d43c-9d4b-46f8-a278-7371252d22b4 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3342 | 2026.08.17 23:52:54.289994 [ 425234 ] {} <Debug> TCP-Session: 5ef91999-fdcb-4eed-82ce-c0ac17e409f5 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3343 | 2026.08.17 23:52:54.290014 [ 425235 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3344 | 2026.08.17 23:52:54.290017 [ 423966 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3345 | 2026.08.17 23:52:54.290026 [ 425235 ] {} <Debug> TCP-Session: 311bbc77-90f5-4578-a93b-05b9706584c4 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3346 | 2026.08.17 23:52:54.290019 [ 425231 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3347 | 2026.08.17 23:52:54.290041 [ 423966 ] {} <Debug> TCP-Session: 80153cf8-c552-4d7a-b1aa-b06a90534a72 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3348 | 2026.08.17 23:52:54.290043 [ 425231 ] {} <Debug> TCP-Session: 6a70e460-b5c0-4c61-a8a2-de72a4c25aa1 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3349 | 2026.08.17 23:52:54.290135 [ 425232 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3350 | 2026.08.17 23:52:54.290139 [ 423965 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3351 | 2026.08.17 23:52:54.290158 [ 425232 ] {} <Debug> TCP-Session: fd677bd6-ff20-414e-abe2-bed39cb48166 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3352 | 2026.08.17 23:52:54.290158 [ 423965 ] {} <Debug> TCP-Session: 0845d4d4-e6e6-41e7-86d8-490918874adb Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3353 | 2026.08.17 23:52:54.309545 [ 423965 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41636 | ||
| 3354 | 2026.08.17 23:52:54.309621 [ 423965 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3355 | 2026.08.17 23:52:54.309629 [ 423965 ] {} <Debug> TCP-Session: 27bdfc6f-0fd1-4d4e-9aa1-f0f003647bde Authenticating user 'default' from [::1]:41636 | ||
| 3356 | 2026.08.17 23:52:54.309639 [ 423965 ] {} <Debug> TCP-Session: 27bdfc6f-0fd1-4d4e-9aa1-f0f003647bde Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3357 | 2026.08.17 23:52:54.309642 [ 423965 ] {} <Debug> TCP-Session: 27bdfc6f-0fd1-4d4e-9aa1-f0f003647bde Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3358 | 2026.08.17 23:52:54.309871 [ 423967 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41640 | ||
| 3359 | 2026.08.17 23:52:54.309872 [ 425231 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41642 | ||
| 3360 | 2026.08.17 23:52:54.309875 [ 423966 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41638 | ||
| 3361 | 2026.08.17 23:52:54.309913 [ 425233 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41648 | ||
| 3362 | 2026.08.17 23:52:54.309923 [ 425230 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41644 | ||
| 3363 | 2026.08.17 23:52:54.309921 [ 425234 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41650 | ||
| 3364 | 2026.08.17 23:52:54.309922 [ 425232 ] {} <Trace> TCPHandlerFactory: TCP Request. Address: [::1]:41646 | ||
| 3365 | 2026.08.17 23:52:54.310062 [ 423966 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3366 | 2026.08.17 23:52:54.310071 [ 423966 ] {} <Debug> TCP-Session: 2d987302-ab25-4966-9203-77c40899ee2d Authenticating user 'default' from [::1]:41638 | ||
| 3367 | 2026.08.17 23:52:54.310075 [ 423966 ] {} <Debug> TCP-Session: 2d987302-ab25-4966-9203-77c40899ee2d Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3368 | 2026.08.17 23:52:54.310078 [ 423966 ] {} <Debug> TCP-Session: 2d987302-ab25-4966-9203-77c40899ee2d Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3369 | 2026.08.17 23:52:54.310081 [ 425231 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3370 | 2026.08.17 23:52:54.310089 [ 425231 ] {} <Debug> TCP-Session: c6025b94-9d1d-463c-9409-ab94e9cf3b6e Authenticating user 'default' from [::1]:41642 | ||
| 3371 | 2026.08.17 23:52:54.310081 [ 423967 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3372 | 2026.08.17 23:52:54.310094 [ 425231 ] {} <Debug> TCP-Session: c6025b94-9d1d-463c-9409-ab94e9cf3b6e Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3373 | 2026.08.17 23:52:54.310096 [ 425231 ] {} <Debug> TCP-Session: c6025b94-9d1d-463c-9409-ab94e9cf3b6e Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3374 | 2026.08.17 23:52:54.310096 [ 425230 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3375 | 2026.08.17 23:52:54.310098 [ 423967 ] {} <Debug> TCP-Session: b4bf579f-bb78-4752-b495-a8647af52d2f Authenticating user 'default' from [::1]:41640 | ||
| 3376 | 2026.08.17 23:52:54.310103 [ 425232 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3377 | 2026.08.17 23:52:54.310106 [ 423967 ] {} <Debug> TCP-Session: b4bf579f-bb78-4752-b495-a8647af52d2f Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3378 | 2026.08.17 23:52:54.310108 [ 423967 ] {} <Debug> TCP-Session: b4bf579f-bb78-4752-b495-a8647af52d2f Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3379 | 2026.08.17 23:52:54.310104 [ 425230 ] {} <Debug> TCP-Session: 4182f575-24e7-4d05-8da8-d33203d14843 Authenticating user 'default' from [::1]:41644 | ||
| 3380 | 2026.08.17 23:52:54.310115 [ 425233 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3381 | 2026.08.17 23:52:54.310118 [ 425230 ] {} <Debug> TCP-Session: 4182f575-24e7-4d05-8da8-d33203d14843 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3382 | 2026.08.17 23:52:54.310119 [ 425233 ] {} <Debug> TCP-Session: 8fe6f474-323d-482a-9bf7-187dbcbf0daf Authenticating user 'default' from [::1]:41648 | ||
| 3383 | 2026.08.17 23:52:54.310121 [ 425230 ] {} <Debug> TCP-Session: 4182f575-24e7-4d05-8da8-d33203d14843 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3384 | 2026.08.17 23:52:54.310122 [ 425233 ] {} <Debug> TCP-Session: 8fe6f474-323d-482a-9bf7-187dbcbf0daf Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3385 | 2026.08.17 23:52:54.310124 [ 425233 ] {} <Debug> TCP-Session: 8fe6f474-323d-482a-9bf7-187dbcbf0daf Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3386 | 2026.08.17 23:52:54.310121 [ 425234 ] {} <Debug> TCPHandler: Connected oximeter version 23.8.0, revision: 54465, database: default, user: default. | ||
| 3387 | 2026.08.17 23:52:54.310133 [ 425234 ] {} <Debug> TCP-Session: 074a073d-d7a9-49fd-b507-2b476d13bb4f Authenticating user 'default' from [::1]:41650 | ||
| 3388 | 2026.08.17 23:52:54.310137 [ 425234 ] {} <Debug> TCP-Session: 074a073d-d7a9-49fd-b507-2b476d13bb4f Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3389 | 2026.08.17 23:52:54.310141 [ 425234 ] {} <Debug> TCP-Session: 074a073d-d7a9-49fd-b507-2b476d13bb4f Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3390 | 2026.08.17 23:52:54.310112 [ 425232 ] {} <Debug> TCP-Session: 58b4eed5-853b-4ff0-98d0-72afc2907cc9 Authenticating user 'default' from [::1]:41646 | ||
| 3391 | 2026.08.17 23:52:54.310147 [ 425232 ] {} <Debug> TCP-Session: 58b4eed5-853b-4ff0-98d0-72afc2907cc9 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3392 | 2026.08.17 23:52:54.310149 [ 425232 ] {} <Debug> TCP-Session: 58b4eed5-853b-4ff0-98d0-72afc2907cc9 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3393 | 2026.08.17 23:52:58.548460 [ 425044 ] {} <Trace> SystemLog (system.opentelemetry_span_log): Flushing system log, 35 entries to flush up to offset 300 | ||
| 3394 | 2026.08.17 23:52:58.549247 [ 425044 ] {} <Trace> system.opentelemetry_span_log (9be1034d-e911-4280-94c0-05dcb911f3d3): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3395 | 2026.08.17 23:52:58.549266 [ 425044 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.78 GiB. | ||
| 3396 | 2026.08.17 23:52:58.549624 [ 425044 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_3_3_0 (state Temporary) | ||
| 3397 | 2026.08.17 23:52:58.549784 [ 425044 ] {} <Trace> system.opentelemetry_span_log (9be1034d-e911-4280-94c0-05dcb911f3d3): Renaming temporary part tmp_insert_202608_3_3_0 to 202608_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3398 | 2026.08.17 23:52:58.549981 [ 425044 ] {} <Trace> SystemLog (system.opentelemetry_span_log): Flushed system log up to offset 300 | ||
| 3399 | 2026.08.17 23:52:58.555649 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2256 entries to flush up to offset 13960 | ||
| 3400 | 2026.08.17 23:52:58.556675 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3401 | 2026.08.17 23:52:58.556688 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.78 GiB. | ||
| 3402 | 2026.08.17 23:52:58.557133 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_7_7_0 (state Temporary) | ||
| 3403 | 2026.08.17 23:52:58.557268 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_7_7_0 to 202608_7_7_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3404 | 2026.08.17 23:52:58.557353 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 13960 | ||
| 3405 | 2026.08.17 23:52:58.637962 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 53 | ||
| 3406 | 2026.08.17 23:52:58.644400 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3407 | 2026.08.17 23:52:58.644417 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.78 GiB. | ||
| 3408 | 2026.08.17 23:52:58.647706 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_7_7_0 (state Temporary) | ||
| 3409 | 2026.08.17 23:52:58.650173 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_7_7_0 to 202608_7_7_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3410 | 2026.08.17 23:52:58.652112 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 53 | ||
| 3411 | 2026.08.17 23:52:58.735979 [ 424341 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 11788ms | ||
| 3412 | 2026.08.17 23:53:02.418092 [ 424388 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73428819968, merge_with_ttl_allowedtrue) | ||
| 3413 | 2026.08.17 23:53:02.418112 [ 424388 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 16403ms | ||
| 3414 | 2026.08.17 23:53:06.006607 [ 424319 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3415 | 2026.08.17 23:53:06.006628 [ 424319 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3416 | 2026.08.17 23:53:06.057440 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2582 entries to flush up to offset 16542 | ||
| 3417 | 2026.08.17 23:53:06.058713 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3418 | 2026.08.17 23:53:06.058729 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.77 GiB. | ||
| 3419 | 2026.08.17 23:53:06.059206 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_8_8_0 (state Temporary) | ||
| 3420 | 2026.08.17 23:53:06.059359 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_8_8_0 to 202608_8_8_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3421 | 2026.08.17 23:53:06.059450 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 16542 | ||
| 3422 | 2026.08.17 23:53:06.152180 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 61 | ||
| 3423 | 2026.08.17 23:53:06.159334 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3424 | 2026.08.17 23:53:06.159350 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.77 GiB. | ||
| 3425 | 2026.08.17 23:53:06.162862 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_8_8_0 (state Temporary) | ||
| 3426 | 2026.08.17 23:53:06.165422 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_8_8_0 to 202608_8_8_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3427 | 2026.08.17 23:53:06.166301 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 61 | ||
| 3428 | 2026.08.17 23:53:10.524076 [ 424342 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 14758ms | ||
| 3429 | 2026.08.17 23:53:13.559804 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2258 entries to flush up to offset 18800 | ||
| 3430 | 2026.08.17 23:53:13.560819 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3431 | 2026.08.17 23:53:13.560837 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.76 GiB. | ||
| 3432 | 2026.08.17 23:53:13.561331 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_9_9_0 (state Temporary) | ||
| 3433 | 2026.08.17 23:53:13.561461 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_9_9_0 to 202608_9_9_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3434 | 2026.08.17 23:53:13.561543 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 18800 | ||
| 3435 | 2026.08.17 23:53:13.666374 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 68 | ||
| 3436 | 2026.08.17 23:53:13.674379 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3437 | 2026.08.17 23:53:13.674397 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.76 GiB. | ||
| 3438 | 2026.08.17 23:53:13.677930 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_9_9_0 (state Temporary) | ||
| 3439 | 2026.08.17 23:53:13.680612 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_9_9_0 to 202608_9_9_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3440 | 2026.08.17 23:53:13.681450 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 68 | ||
| 3441 | 2026.08.17 23:53:14.000404 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 459.75 MiB, peak 467.78 MiB, free memory in arenas 91.31 MiB, will set to 454.42 MiB (RSS), difference: -5.33 MiB | ||
| 3442 | 2026.08.17 23:53:18.821211 [ 424414 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73417840640, merge_with_ttl_allowedtrue) | ||
| 3443 | 2026.08.17 23:53:18.821228 [ 424414 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 21413ms | ||
| 3444 | 2026.08.17 23:53:20.736287 [ 424346 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73416624128, merge_with_ttl_allowedtrue) | ||
| 3445 | 2026.08.17 23:53:20.736311 [ 424346 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 33064ms | ||
| 3446 | 2026.08.17 23:53:21.006714 [ 424384 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3447 | 2026.08.17 23:53:21.006746 [ 424384 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3448 | 2026.08.17 23:53:21.061633 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2580 entries to flush up to offset 21380 | ||
| 3449 | 2026.08.17 23:53:21.062921 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3450 | 2026.08.17 23:53:21.062937 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.75 GiB. | ||
| 3451 | 2026.08.17 23:53:21.064540 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_10_10_0 (state Temporary) | ||
| 3452 | 2026.08.17 23:53:21.064681 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_10_10_0 to 202608_10_10_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3453 | 2026.08.17 23:53:21.064765 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 21380 | ||
| 3454 | 2026.08.17 23:53:21.182141 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 76 | ||
| 3455 | 2026.08.17 23:53:21.188541 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3456 | 2026.08.17 23:53:21.188564 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.75 GiB. | ||
| 3457 | 2026.08.17 23:53:21.191950 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_10_10_0 (state Temporary) | ||
| 3458 | 2026.08.17 23:53:21.194432 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_10_10_0 to 202608_10_10_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3459 | 2026.08.17 23:53:21.195223 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 76 | ||
| 3460 | 2026.08.17 23:53:21.698476 [ 424424 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73415862272, merge_with_ttl_allowedtrue) | ||
| 3461 | 2026.08.17 23:53:21.698502 [ 424424 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 35736ms | ||
| 3462 | 2026.08.17 23:53:25.282630 [ 424417 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 17752ms | ||
| 3463 | 2026.08.17 23:53:28.564848 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2262 entries to flush up to offset 23642 | ||
| 3464 | 2026.08.17 23:53:28.565972 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3465 | 2026.08.17 23:53:28.565988 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.74 GiB. | ||
| 3466 | 2026.08.17 23:53:28.566494 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_11_11_0 (state Temporary) | ||
| 3467 | 2026.08.17 23:53:28.566635 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_11_11_0 to 202608_11_11_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3468 | 2026.08.17 23:53:28.566735 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 23642 | ||
| 3469 | 2026.08.17 23:53:28.566748 [ 424360 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_6_1 to 202608_11_11_0 | ||
| 3470 | 2026.08.17 23:53:28.566789 [ 424360 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3471 | 2026.08.17 23:53:28.568050 [ 424360 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.74 GiB. | ||
| 3472 | 2026.08.17 23:53:28.568179 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_6_1 to 202608_11_11_0 into Compact with storage Full | ||
| 3473 | 2026.08.17 23:53:28.568237 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3474 | 2026.08.17 23:53:28.568252 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 3 marks from part 202608_1_6_1, total 11704 rows starting from the beginning of the part | ||
| 3475 | 2026.08.17 23:53:28.568296 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_7_7_0, total 2256 rows starting from the beginning of the part | ||
| 3476 | 2026.08.17 23:53:28.568311 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_8_8_0, total 2582 rows starting from the beginning of the part | ||
| 3477 | 2026.08.17 23:53:28.568328 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_9_9_0, total 2258 rows starting from the beginning of the part | ||
| 3478 | 2026.08.17 23:53:28.568344 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_10_10_0, total 2580 rows starting from the beginning of the part | ||
| 3479 | 2026.08.17 23:53:28.568365 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_11_11_0, total 2262 rows starting from the beginning of the part | ||
| 3480 | 2026.08.17 23:53:28.571242 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 23642 rows, containing 4 columns (4 merged, 0 gathered) in 0.003122732 sec., 7570934.681554485 rows/sec., 111.95 MiB/sec. | ||
| 3481 | 2026.08.17 23:53:28.571976 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Trace> MergedBlockOutputStream: filled checksums 202608_1_11_2 (state Temporary) | ||
| 3482 | 2026.08.17 23:53:28.572109 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_11_2 to 202608_1_11_2 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3483 | 2026.08.17 23:53:28.572135 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_11_2} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_6_1, 202608_11_11_0] -> 202608_1_11_2 | ||
| 3484 | 2026.08.17 23:53:28.572180 [ 424484 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.39 MiB. | ||
| 3485 | 2026.08.17 23:53:28.695295 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 83 | ||
| 3486 | 2026.08.17 23:53:28.702518 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3487 | 2026.08.17 23:53:28.702536 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.74 GiB. | ||
| 3488 | 2026.08.17 23:53:28.705858 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_11_11_0 (state Temporary) | ||
| 3489 | 2026.08.17 23:53:28.708505 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_11_11_0 to 202608_11_11_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3490 | 2026.08.17 23:53:28.708667 [ 424305 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_6_1 to 202608_11_11_0 | ||
| 3491 | 2026.08.17 23:53:28.708680 [ 424305 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3492 | 2026.08.17 23:53:28.708685 [ 424305 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.74 GiB. | ||
| 3493 | 2026.08.17 23:53:28.708745 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_6_1 to 202608_11_11_0 into Compact with storage Full | ||
| 3494 | 2026.08.17 23:53:28.709312 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 83 | ||
| 3495 | 2026.08.17 23:53:28.711574 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3496 | 2026.08.17 23:53:28.711960 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_6_1, total 46 rows starting from the beginning of the part | ||
| 3497 | 2026.08.17 23:53:28.713863 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_7_7_0, total 7 rows starting from the beginning of the part | ||
| 3498 | 2026.08.17 23:53:28.716785 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_8_8_0, total 8 rows starting from the beginning of the part | ||
| 3499 | 2026.08.17 23:53:28.718737 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_9_9_0, total 7 rows starting from the beginning of the part | ||
| 3500 | 2026.08.17 23:53:28.720610 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_10_10_0, total 8 rows starting from the beginning of the part | ||
| 3501 | 2026.08.17 23:53:28.722511 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_11_11_0, total 7 rows starting from the beginning of the part | ||
| 3502 | 2026.08.17 23:53:28.749019 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 83 rows, containing 679 columns (679 merged, 0 gathered) in 0.040299819 sec., 2059.5626000206103 rows/sec., 2.90 MiB/sec. | ||
| 3503 | 2026.08.17 23:53:28.749680 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Trace> MergedBlockOutputStream: filled checksums 202608_1_11_2 (state Temporary) | ||
| 3504 | 2026.08.17 23:53:28.753085 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_11_2 to 202608_1_11_2 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3505 | 2026.08.17 23:53:28.753115 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_11_2} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_6_1, 202608_11_11_0] -> 202608_1_11_2 | ||
| 3506 | 2026.08.17 23:53:28.753537 [ 424496 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 10.83 MiB. | ||
| 3507 | 2026.08.17 23:53:29.000402 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 457.19 MiB, peak 467.78 MiB, free memory in arenas 109.45 MiB, will set to 470.29 MiB (RSS), difference: 13.10 MiB | ||
| 3508 | 2026.08.17 23:53:32.019257 [ 424415 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Selected 5 parts from all_0_0_0 to all_4_4_0 | ||
| 3509 | 2026.08.17 23:53:32.019415 [ 424415 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 1 partitions with parts that may be merged: [all](max_total_size_to_merge=73408284672, merge_with_ttl_allowedtrue) | ||
| 3510 | 2026.08.17 23:53:32.020755 [ 424415 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Selected 5 parts from all_0_0_0 to all_4_4_0 | ||
| 3511 | 2026.08.17 23:53:32.023889 [ 424415 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Created log entry /clickhouse/tables/1/fields_uuid_local/log/log-0000000005 for merge all_0_4_1 | ||
| 3512 | 2026.08.17 23:53:32.023911 [ 424415 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Selected 5 parts from all_0_0_0 to all_4_4_0 | ||
| 3513 | 2026.08.17 23:53:32.023915 [ 424415 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 1 partitions with parts that may be merged: [all](max_total_size_to_merge=73408276480, merge_with_ttl_allowedtrue) | ||
| 3514 | 2026.08.17 23:53:32.024081 [ 424374 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000005 - log-0000000005 | ||
| 3515 | 2026.08.17 23:53:32.027165 [ 424374 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000005 to queue with type MERGE_PARTS with virtual parts [all_0_4_1] | ||
| 3516 | 2026.08.17 23:53:32.027175 [ 424374 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. | ||
| 3517 | 2026.08.17 23:53:32.027257 [ 424494 ] {} <Trace> eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1 (MergeFromLogEntryTask): Executing log entry to merge parts all_0_0_0, all_1_1_0, all_2_2_0, all_3_3_0, all_4_4_0 to all_0_4_1 | ||
| 3518 | 2026.08.17 23:53:32.027288 [ 424494 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3519 | 2026.08.17 23:53:32.027298 [ 424494 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.73 GiB. | ||
| 3520 | 2026.08.17 23:53:32.027378 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Debug> MergeTask::PrepareStage: Merging 5 parts: from all_0_0_0 to all_4_4_0 into Compact with storage Full | ||
| 3521 | 2026.08.17 23:53:32.027450 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3522 | 2026.08.17 23:53:32.027468 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part all_0_0_0, total 16 rows starting from the beginning of the part | ||
| 3523 | 2026.08.17 23:53:32.027518 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part all_1_1_0, total 16 rows starting from the beginning of the part | ||
| 3524 | 2026.08.17 23:53:32.027534 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part all_2_2_0, total 16 rows starting from the beginning of the part | ||
| 3525 | 2026.08.17 23:53:32.027548 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part all_3_3_0, total 16 rows starting from the beginning of the part | ||
| 3526 | 2026.08.17 23:53:32.027566 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Debug> MergeTreeSequentialSource: Reading 2 marks from part all_4_4_0, total 16 rows starting from the beginning of the part | ||
| 3527 | 2026.08.17 23:53:32.028016 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 80 rows, containing 5 columns (5 merged, 0 gathered) in 0.00068744 sec., 116373.79262190155 rows/sec., 8.93 MiB/sec. | ||
| 3528 | 2026.08.17 23:53:32.028097 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Trace> MergedBlockOutputStream: filled checksums all_0_4_1 (state Temporary) | ||
| 3529 | 2026.08.17 23:53:32.029600 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Renaming temporary part tmp_merge_all_0_4_1 to all_0_4_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3530 | 2026.08.17 23:53:32.029627 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Merged 5 parts: [all_0_0_0, all_4_4_0] -> all_0_4_1 | ||
| 3531 | 2026.08.17 23:53:32.029645 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Committing part all_0_4_1 to zookeeper | ||
| 3532 | 2026.08.17 23:53:32.033954 [ 424415 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 43426ms | ||
| 3533 | 2026.08.17 23:53:32.037167 [ 424494 ] {eaa5beef-895d-41af-915b-bd6fb56613c4::all_0_4_1} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Part all_0_4_1 committed to zookeeper | ||
| 3534 | 2026.08.17 23:53:32.046390 [ 424494 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 3.28 MiB. | ||
| 3535 | 2026.08.17 23:53:32.046425 [ 424335 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73408169984, merge_with_ttl_allowedtrue) | ||
| 3536 | 2026.08.17 23:53:32.046439 [ 424335 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 53632ms | ||
| 3537 | 2026.08.17 23:53:36.006826 [ 424339 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3538 | 2026.08.17 23:53:36.006850 [ 424339 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3539 | 2026.08.17 23:53:36.066816 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2578 entries to flush up to offset 26220 | ||
| 3540 | 2026.08.17 23:53:36.067942 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3541 | 2026.08.17 23:53:36.068521 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.73 GiB. | ||
| 3542 | 2026.08.17 23:53:36.068914 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_12_12_0 (state Temporary) | ||
| 3543 | 2026.08.17 23:53:36.069049 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_12_12_0 to 202608_12_12_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3544 | 2026.08.17 23:53:36.069133 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 26220 | ||
| 3545 | 2026.08.17 23:53:36.209382 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 91 | ||
| 3546 | 2026.08.17 23:53:36.217162 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3547 | 2026.08.17 23:53:36.217177 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.73 GiB. | ||
| 3548 | 2026.08.17 23:53:36.220649 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_12_12_0 (state Temporary) | ||
| 3549 | 2026.08.17 23:53:36.223272 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_12_12_0 to 202608_12_12_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3550 | 2026.08.17 23:53:36.224067 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 91 | ||
| 3551 | 2026.08.17 23:53:40.234326 [ 424337 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73402681344, merge_with_ttl_allowedtrue) | ||
| 3552 | 2026.08.17 23:53:40.234626 [ 424337 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 26689ms | ||
| 3553 | 2026.08.17 23:53:43.035326 [ 424418 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 21837ms | ||
| 3554 | 2026.08.17 23:53:43.569299 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2258 entries to flush up to offset 28478 | ||
| 3555 | 2026.08.17 23:53:43.571241 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3556 | 2026.08.17 23:53:43.571259 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.72 GiB. | ||
| 3557 | 2026.08.17 23:53:43.571757 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_13_13_0 (state Temporary) | ||
| 3558 | 2026.08.17 23:53:43.571897 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_13_13_0 to 202608_13_13_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3559 | 2026.08.17 23:53:43.571984 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 28478 | ||
| 3560 | 2026.08.17 23:53:43.724140 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 98 | ||
| 3561 | 2026.08.17 23:53:43.732236 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3562 | 2026.08.17 23:53:43.732252 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.72 GiB. | ||
| 3563 | 2026.08.17 23:53:43.736361 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_13_13_0 (state Temporary) | ||
| 3564 | 2026.08.17 23:53:43.740081 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_13_13_0 to 202608_13_13_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3565 | 2026.08.17 23:53:43.740940 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 98 | ||
| 3566 | 2026.08.17 23:53:51.006924 [ 424391 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3567 | 2026.08.17 23:53:51.006945 [ 424391 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3568 | 2026.08.17 23:53:51.072141 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 31054 | ||
| 3569 | 2026.08.17 23:53:51.073235 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3570 | 2026.08.17 23:53:51.073248 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.71 GiB. | ||
| 3571 | 2026.08.17 23:53:51.073744 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_14_14_0 (state Temporary) | ||
| 3572 | 2026.08.17 23:53:51.074419 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_14_14_0 to 202608_14_14_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3573 | 2026.08.17 23:53:51.074500 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 31054 | ||
| 3574 | 2026.08.17 23:53:51.241010 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 106 | ||
| 3575 | 2026.08.17 23:53:51.249613 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3576 | 2026.08.17 23:53:51.249627 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.71 GiB. | ||
| 3577 | 2026.08.17 23:53:51.253119 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_14_14_0 (state Temporary) | ||
| 3578 | 2026.08.17 23:53:51.256240 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_14_14_0 to 202608_14_14_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3579 | 2026.08.17 23:53:51.257060 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 106 | ||
| 3580 | 2026.08.17 23:53:53.800425 [ 424372 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73393635328, merge_with_ttl_allowedtrue) | ||
| 3581 | 2026.08.17 23:53:53.800446 [ 424372 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 39696ms | ||
| 3582 | 2026.08.17 23:53:57.434605 [ 424379 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73391237120, merge_with_ttl_allowedtrue) | ||
| 3583 | 2026.08.17 23:53:57.434622 [ 424379 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 43266ms | ||
| 3584 | 2026.08.17 23:53:58.574668 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2258 entries to flush up to offset 33312 | ||
| 3585 | 2026.08.17 23:53:58.575699 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3586 | 2026.08.17 23:53:58.576161 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.70 GiB. | ||
| 3587 | 2026.08.17 23:53:58.576664 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_15_15_0 (state Temporary) | ||
| 3588 | 2026.08.17 23:53:58.576805 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_15_15_0 to 202608_15_15_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3589 | 2026.08.17 23:53:58.576894 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 33312 | ||
| 3590 | 2026.08.17 23:53:58.757136 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 113 | ||
| 3591 | 2026.08.17 23:53:58.763889 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3592 | 2026.08.17 23:53:58.764404 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.70 GiB. | ||
| 3593 | 2026.08.17 23:53:58.767823 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_15_15_0 (state Temporary) | ||
| 3594 | 2026.08.17 23:53:58.770344 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_15_15_0 to 202608_15_15_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3595 | 2026.08.17 23:53:58.771174 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 113 | ||
| 3596 | 2026.08.17 23:54:04.872431 [ 424336 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 26795ms | ||
| 3597 | 2026.08.17 23:54:06.007027 [ 424355 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3598 | 2026.08.17 23:54:06.007053 [ 424355 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3599 | 2026.08.17 23:54:06.076985 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2580 entries to flush up to offset 35892 | ||
| 3600 | 2026.08.17 23:54:06.078177 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3601 | 2026.08.17 23:54:06.078194 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.69 GiB. | ||
| 3602 | 2026.08.17 23:54:06.078705 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_16_16_0 (state Temporary) | ||
| 3603 | 2026.08.17 23:54:06.078849 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_16_16_0 to 202608_16_16_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3604 | 2026.08.17 23:54:06.078940 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 35892 | ||
| 3605 | 2026.08.17 23:54:06.078947 [ 424328 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_11_2 to 202608_16_16_0 | ||
| 3606 | 2026.08.17 23:54:06.078971 [ 424328 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3607 | 2026.08.17 23:54:06.078978 [ 424328 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.69 GiB. | ||
| 3608 | 2026.08.17 23:54:06.079056 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_11_2 to 202608_16_16_0 into Compact with storage Full | ||
| 3609 | 2026.08.17 23:54:06.079108 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3610 | 2026.08.17 23:54:06.079122 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 4 marks from part 202608_1_11_2, total 23642 rows starting from the beginning of the part | ||
| 3611 | 2026.08.17 23:54:06.079170 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_12_12_0, total 2578 rows starting from the beginning of the part | ||
| 3612 | 2026.08.17 23:54:06.079186 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_13_13_0, total 2258 rows starting from the beginning of the part | ||
| 3613 | 2026.08.17 23:54:06.079203 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_14_14_0, total 2576 rows starting from the beginning of the part | ||
| 3614 | 2026.08.17 23:54:06.079217 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_15_15_0, total 2258 rows starting from the beginning of the part | ||
| 3615 | 2026.08.17 23:54:06.079235 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_16_16_0, total 2580 rows starting from the beginning of the part | ||
| 3616 | 2026.08.17 23:54:06.082737 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 35892 rows, containing 4 columns (4 merged, 0 gathered) in 0.003719603 sec., 9649416.886694629 rows/sec., 141.18 MiB/sec. | ||
| 3617 | 2026.08.17 23:54:06.082895 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Trace> MergedBlockOutputStream: filled checksums 202608_1_16_3 (state Temporary) | ||
| 3618 | 2026.08.17 23:54:06.083075 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_16_3 to 202608_1_16_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3619 | 2026.08.17 23:54:06.083100 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_16_3} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_11_2, 202608_16_16_0] -> 202608_1_16_3 | ||
| 3620 | 2026.08.17 23:54:06.083159 [ 424484 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.65 MiB. | ||
| 3621 | 2026.08.17 23:54:06.271244 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 121 | ||
| 3622 | 2026.08.17 23:54:06.278488 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3623 | 2026.08.17 23:54:06.278506 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.69 GiB. | ||
| 3624 | 2026.08.17 23:54:06.283287 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_16_16_0 (state Temporary) | ||
| 3625 | 2026.08.17 23:54:06.285791 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_16_16_0 to 202608_16_16_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3626 | 2026.08.17 23:54:06.285957 [ 424406 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_11_2 to 202608_16_16_0 | ||
| 3627 | 2026.08.17 23:54:06.285975 [ 424406 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3628 | 2026.08.17 23:54:06.285980 [ 424406 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.69 GiB. | ||
| 3629 | 2026.08.17 23:54:06.286117 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_11_2 to 202608_16_16_0 into Compact with storage Full | ||
| 3630 | 2026.08.17 23:54:06.286638 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 121 | ||
| 3631 | 2026.08.17 23:54:06.288968 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3632 | 2026.08.17 23:54:06.289360 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_11_2, total 83 rows starting from the beginning of the part | ||
| 3633 | 2026.08.17 23:54:06.291289 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_12_12_0, total 8 rows starting from the beginning of the part | ||
| 3634 | 2026.08.17 23:54:06.293183 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_13_13_0, total 7 rows starting from the beginning of the part | ||
| 3635 | 2026.08.17 23:54:06.296506 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_14_14_0, total 8 rows starting from the beginning of the part | ||
| 3636 | 2026.08.17 23:54:06.298400 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_15_15_0, total 7 rows starting from the beginning of the part | ||
| 3637 | 2026.08.17 23:54:06.300294 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_16_16_0, total 8 rows starting from the beginning of the part | ||
| 3638 | 2026.08.17 23:54:06.327826 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 121 rows, containing 679 columns (679 merged, 0 gathered) in 0.04176429 sec., 2897.211948293626 rows/sec., 3.25 MiB/sec. | ||
| 3639 | 2026.08.17 23:54:06.328616 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Trace> MergedBlockOutputStream: filled checksums 202608_1_16_3 (state Temporary) | ||
| 3640 | 2026.08.17 23:54:06.331982 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_16_3 to 202608_1_16_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3641 | 2026.08.17 23:54:06.332014 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_16_3} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_11_2, 202608_16_16_0] -> 202608_1_16_3 | ||
| 3642 | 2026.08.17 23:54:06.332432 [ 424493 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 10.91 MiB. | ||
| 3643 | 2026.08.17 23:54:06.923736 [ 424394 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73384857600, merge_with_ttl_allowedtrue) | ||
| 3644 | 2026.08.17 23:54:06.923750 [ 424394 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 32427ms | ||
| 3645 | 2026.08.17 23:54:07.000400 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 475.79 MiB, peak 485.92 MiB, free memory in arenas 117.82 MiB, will set to 487.50 MiB (RSS), difference: 11.72 MiB | ||
| 3646 | 2026.08.17 23:54:07.000804 [ 425081 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 8.657e-05 sec. | ||
| 3647 | 2026.08.17 23:54:13.579028 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2256 entries to flush up to offset 38148 | ||
| 3648 | 2026.08.17 23:54:13.580993 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3649 | 2026.08.17 23:54:13.581015 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.68 GiB. | ||
| 3650 | 2026.08.17 23:54:13.581486 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_17_17_0 (state Temporary) | ||
| 3651 | 2026.08.17 23:54:13.581629 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_17_17_0 to 202608_17_17_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3652 | 2026.08.17 23:54:13.581723 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 38148 | ||
| 3653 | 2026.08.17 23:54:13.786725 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 128 | ||
| 3654 | 2026.08.17 23:54:13.793735 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3655 | 2026.08.17 23:54:13.793757 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.68 GiB. | ||
| 3656 | 2026.08.17 23:54:13.798441 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_17_17_0 (state Temporary) | ||
| 3657 | 2026.08.17 23:54:13.801064 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_17_17_0 to 202608_17_17_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3658 | 2026.08.17 23:54:13.801971 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 128 | ||
| 3659 | 2026.08.17 23:54:14.000394 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 488.21 MiB, peak 496.24 MiB, free memory in arenas 125.35 MiB, will set to 491.10 MiB (RSS), difference: 2.89 MiB | ||
| 3660 | 2026.08.17 23:54:21.007143 [ 424294 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3661 | 2026.08.17 23:54:21.007167 [ 424294 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3662 | 2026.08.17 23:54:21.081812 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2586 entries to flush up to offset 40734 | ||
| 3663 | 2026.08.17 23:54:21.082924 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3664 | 2026.08.17 23:54:21.082939 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.67 GiB. | ||
| 3665 | 2026.08.17 23:54:21.083358 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_18_18_0 (state Temporary) | ||
| 3666 | 2026.08.17 23:54:21.083511 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_18_18_0 to 202608_18_18_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3667 | 2026.08.17 23:54:21.083607 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 40734 | ||
| 3668 | 2026.08.17 23:54:21.302054 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 136 | ||
| 3669 | 2026.08.17 23:54:21.308756 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3670 | 2026.08.17 23:54:21.308781 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.67 GiB. | ||
| 3671 | 2026.08.17 23:54:21.312178 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_18_18_0 (state Temporary) | ||
| 3672 | 2026.08.17 23:54:21.314772 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_18_18_0 to 202608_18_18_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3673 | 2026.08.17 23:54:21.315657 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 136 | ||
| 3674 | 2026.08.17 23:54:22.000393 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 491.83 MiB, peak 499.86 MiB, free memory in arenas 126.46 MiB, will set to 492.97 MiB (RSS), difference: 1.14 MiB | ||
| 3675 | 2026.08.17 23:54:24.322595 [ 423967 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3676 | 2026.08.17 23:54:24.322616 [ 425233 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3677 | 2026.08.17 23:54:24.322624 [ 423967 ] {} <Debug> TCP-Session: b4bf579f-bb78-4752-b495-a8647af52d2f Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3678 | 2026.08.17 23:54:24.322630 [ 425233 ] {} <Debug> TCP-Session: 8fe6f474-323d-482a-9bf7-187dbcbf0daf Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3679 | 2026.08.17 23:54:24.322674 [ 425231 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3680 | 2026.08.17 23:54:24.322681 [ 425234 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3681 | 2026.08.17 23:54:24.322697 [ 425234 ] {} <Debug> TCP-Session: 074a073d-d7a9-49fd-b507-2b476d13bb4f Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3682 | 2026.08.17 23:54:24.322699 [ 425231 ] {} <Debug> TCP-Session: c6025b94-9d1d-463c-9409-ab94e9cf3b6e Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3683 | 2026.08.17 23:54:24.322707 [ 423965 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3684 | 2026.08.17 23:54:24.322717 [ 425230 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3685 | 2026.08.17 23:54:24.322722 [ 423965 ] {} <Debug> TCP-Session: 27bdfc6f-0fd1-4d4e-9aa1-f0f003647bde Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3686 | 2026.08.17 23:54:24.322731 [ 425230 ] {} <Debug> TCP-Session: 4182f575-24e7-4d05-8da8-d33203d14843 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3687 | 2026.08.17 23:54:24.322783 [ 423966 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3688 | 2026.08.17 23:54:24.322793 [ 425232 ] {} <Debug> TCPHandler: Done processing connection. | ||
| 3689 | 2026.08.17 23:54:24.322795 [ 423966 ] {} <Debug> TCP-Session: 2d987302-ab25-4966-9203-77c40899ee2d Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3690 | 2026.08.17 23:54:24.322801 [ 425232 ] {} <Debug> TCP-Session: 58b4eed5-853b-4ff0-98d0-72afc2907cc9 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db | ||
| 3691 | 2026.08.17 23:54:25.678556 [ 424323 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73368305664, merge_with_ttl_allowedtrue) | ||
| 3692 | 2026.08.17 23:54:25.678578 [ 424323 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 3693 | 2026.08.17 23:54:28.583702 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2258 entries to flush up to offset 42992 | ||
| 3694 | 2026.08.17 23:54:28.585297 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3695 | 2026.08.17 23:54:28.585311 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3696 | 2026.08.17 23:54:28.585685 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_19_19_0 (state Temporary) | ||
| 3697 | 2026.08.17 23:54:28.585814 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_19_19_0 to 202608_19_19_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3698 | 2026.08.17 23:54:28.585898 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 42992 | ||
| 3699 | 2026.08.17 23:54:28.815738 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 143 | ||
| 3700 | 2026.08.17 23:54:28.822343 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3701 | 2026.08.17 23:54:28.822357 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3702 | 2026.08.17 23:54:28.825614 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_19_19_0 (state Temporary) | ||
| 3703 | 2026.08.17 23:54:28.828068 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_19_19_0 to 202608_19_19_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3704 | 2026.08.17 23:54:28.828817 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 143 | ||
| 3705 | 2026.08.17 23:54:29.000216 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 493.68 MiB, peak 501.71 MiB, free memory in arenas 138.50 MiB, will set to 491.09 MiB (RSS), difference: -2.60 MiB | ||
| 3706 | 2026.08.17 23:54:31.667555 [ 424412 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 33675ms | ||
| 3707 | 2026.08.17 23:54:33.496563 [ 424290 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73367945216, merge_with_ttl_allowedtrue) | ||
| 3708 | 2026.08.17 23:54:33.496575 [ 424290 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 49023ms | ||
| 3709 | 2026.08.17 23:54:36.007274 [ 424328 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3710 | 2026.08.17 23:54:36.007304 [ 424328 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3711 | 2026.08.17 23:54:36.086001 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 45568 | ||
| 3712 | 2026.08.17 23:54:36.087766 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3713 | 2026.08.17 23:54:36.087780 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3714 | 2026.08.17 23:54:36.088264 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_20_20_0 (state Temporary) | ||
| 3715 | 2026.08.17 23:54:36.088402 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_20_20_0 to 202608_20_20_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3716 | 2026.08.17 23:54:36.088484 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 45568 | ||
| 3717 | 2026.08.17 23:54:36.328898 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 151 | ||
| 3718 | 2026.08.17 23:54:36.336198 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3719 | 2026.08.17 23:54:36.336212 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3720 | 2026.08.17 23:54:36.339588 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_20_20_0 (state Temporary) | ||
| 3721 | 2026.08.17 23:54:36.342171 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_20_20_0 to 202608_20_20_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3722 | 2026.08.17 23:54:36.342936 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 151 | ||
| 3723 | 2026.08.17 23:54:37.000260 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 491.81 MiB, peak 501.71 MiB, free memory in arenas 122.41 MiB, will set to 485.48 MiB (RSS), difference: -6.34 MiB | ||
| 3724 | 2026.08.17 23:54:39.350864 [ 424384 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73367592960, merge_with_ttl_allowedtrue) | ||
| 3725 | 2026.08.17 23:54:39.350881 [ 424384 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 40241ms | ||
| 3726 | 2026.08.17 23:54:40.700727 [ 424358 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73367592960, merge_with_ttl_allowedtrue) | ||
| 3727 | 2026.08.17 23:54:40.700747 [ 424358 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 54368ms | ||
| 3728 | 2026.08.17 23:54:43.588576 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 47822 | ||
| 3729 | 2026.08.17 23:54:43.589671 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3730 | 2026.08.17 23:54:43.589684 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3731 | 2026.08.17 23:54:43.590141 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_21_21_0 (state Temporary) | ||
| 3732 | 2026.08.17 23:54:43.590278 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_21_21_0 to 202608_21_21_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3733 | 2026.08.17 23:54:43.590354 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 47822 | ||
| 3734 | 2026.08.17 23:54:43.590388 [ 424367 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_16_3 to 202608_21_21_0 | ||
| 3735 | 2026.08.17 23:54:43.590422 [ 424367 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3736 | 2026.08.17 23:54:43.590433 [ 424367 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3737 | 2026.08.17 23:54:43.590529 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_16_3 to 202608_21_21_0 into Compact with storage Full | ||
| 3738 | 2026.08.17 23:54:43.590586 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3739 | 2026.08.17 23:54:43.590599 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 6 marks from part 202608_1_16_3, total 35892 rows starting from the beginning of the part | ||
| 3740 | 2026.08.17 23:54:43.590635 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_17_17_0, total 2256 rows starting from the beginning of the part | ||
| 3741 | 2026.08.17 23:54:43.590651 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_18_18_0, total 2586 rows starting from the beginning of the part | ||
| 3742 | 2026.08.17 23:54:43.590668 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_19_19_0, total 2258 rows starting from the beginning of the part | ||
| 3743 | 2026.08.17 23:54:43.590683 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_20_20_0, total 2576 rows starting from the beginning of the part | ||
| 3744 | 2026.08.17 23:54:43.590697 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_21_21_0, total 2254 rows starting from the beginning of the part | ||
| 3745 | 2026.08.17 23:54:43.594667 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 47822 rows, containing 4 columns (4 merged, 0 gathered) in 0.004176863 sec., 11449262.281286217 rows/sec., 166.51 MiB/sec. | ||
| 3746 | 2026.08.17 23:54:43.594848 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Trace> MergedBlockOutputStream: filled checksums 202608_1_21_4 (state Temporary) | ||
| 3747 | 2026.08.17 23:54:43.594998 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_21_4 to 202608_1_21_4 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3748 | 2026.08.17 23:54:43.595020 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_21_4} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_16_3, 202608_21_21_0] -> 202608_1_21_4 | ||
| 3749 | 2026.08.17 23:54:43.595060 [ 424472 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.64 MiB. | ||
| 3750 | 2026.08.17 23:54:43.843019 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 158 | ||
| 3751 | 2026.08.17 23:54:43.849889 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3752 | 2026.08.17 23:54:43.849908 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3753 | 2026.08.17 23:54:43.855214 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_21_21_0 (state Temporary) | ||
| 3754 | 2026.08.17 23:54:43.857812 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_21_21_0 to 202608_21_21_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3755 | 2026.08.17 23:54:43.857973 [ 424377 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_16_3 to 202608_21_21_0 | ||
| 3756 | 2026.08.17 23:54:43.857986 [ 424377 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3757 | 2026.08.17 23:54:43.857990 [ 424377 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3758 | 2026.08.17 23:54:43.858110 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_16_3 to 202608_21_21_0 into Compact with storage Full | ||
| 3759 | 2026.08.17 23:54:43.858582 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 158 | ||
| 3760 | 2026.08.17 23:54:43.860909 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3761 | 2026.08.17 23:54:43.861230 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_16_3, total 121 rows starting from the beginning of the part | ||
| 3762 | 2026.08.17 23:54:43.863007 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_17_17_0, total 7 rows starting from the beginning of the part | ||
| 3763 | 2026.08.17 23:54:43.864821 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_18_18_0, total 8 rows starting from the beginning of the part | ||
| 3764 | 2026.08.17 23:54:43.866692 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_19_19_0, total 7 rows starting from the beginning of the part | ||
| 3765 | 2026.08.17 23:54:43.868536 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_20_20_0, total 8 rows starting from the beginning of the part | ||
| 3766 | 2026.08.17 23:54:43.870360 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_21_21_0, total 7 rows starting from the beginning of the part | ||
| 3767 | 2026.08.17 23:54:43.872495 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Trace> SortDescription: Compile sort description Date 1 1DateTime 1 1 | ||
| 3768 | 2026.08.17 23:54:43.901442 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 158 rows, containing 679 columns (679 merged, 0 gathered) in 0.043382391 sec., 3642.0307031947596 rows/sec., 3.66 MiB/sec. | ||
| 3769 | 2026.08.17 23:54:43.902153 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Trace> MergedBlockOutputStream: filled checksums 202608_1_21_4 (state Temporary) | ||
| 3770 | 2026.08.17 23:54:43.905515 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_21_4 to 202608_1_21_4 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3771 | 2026.08.17 23:54:43.905549 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_21_4} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_16_3, 202608_21_21_0] -> 202608_1_21_4 | ||
| 3772 | 2026.08.17 23:54:43.905950 [ 424475 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 11.99 MiB. | ||
| 3773 | 2026.08.17 23:54:44.000209 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 487.45 MiB, peak 501.71 MiB, free memory in arenas 121.89 MiB, will set to 483.42 MiB (RSS), difference: -4.03 MiB | ||
| 3774 | 2026.08.17 23:54:51.007399 [ 424294 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3775 | 2026.08.17 23:54:51.007423 [ 424294 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3776 | 2026.08.17 23:54:51.090445 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 50398 | ||
| 3777 | 2026.08.17 23:54:51.091671 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3778 | 2026.08.17 23:54:51.091684 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3779 | 2026.08.17 23:54:51.092159 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_22_22_0 (state Temporary) | ||
| 3780 | 2026.08.17 23:54:51.092293 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_22_22_0 to 202608_22_22_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3781 | 2026.08.17 23:54:51.092379 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 50398 | ||
| 3782 | 2026.08.17 23:54:51.358664 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 166 | ||
| 3783 | 2026.08.17 23:54:51.364998 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3784 | 2026.08.17 23:54:51.365011 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3785 | 2026.08.17 23:54:51.368281 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_22_22_0 (state Temporary) | ||
| 3786 | 2026.08.17 23:54:51.370779 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_22_22_0 to 202608_22_22_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3787 | 2026.08.17 23:54:51.371556 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 166 | ||
| 3788 | 2026.08.17 23:54:58.592598 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2256 entries to flush up to offset 52654 | ||
| 3789 | 2026.08.17 23:54:58.593594 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3790 | 2026.08.17 23:54:58.593608 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3791 | 2026.08.17 23:54:58.594082 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_23_23_0 (state Temporary) | ||
| 3792 | 2026.08.17 23:54:58.594218 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_23_23_0 to 202608_23_23_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3793 | 2026.08.17 23:54:58.594300 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 52654 | ||
| 3794 | 2026.08.17 23:54:58.871629 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 173 | ||
| 3795 | 2026.08.17 23:54:58.878607 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3796 | 2026.08.17 23:54:58.878621 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3797 | 2026.08.17 23:54:58.881914 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_23_23_0 (state Temporary) | ||
| 3798 | 2026.08.17 23:54:58.884373 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_23_23_0 to 202608_23_23_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3799 | 2026.08.17 23:54:58.885140 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 173 | ||
| 3800 | 2026.08.17 23:55:05.342674 [ 424299 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 41211ms | ||
| 3801 | 2026.08.17 23:55:06.007517 [ 424375 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3802 | 2026.08.17 23:55:06.007539 [ 424375 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3803 | 2026.08.17 23:55:06.094390 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 55230 | ||
| 3804 | 2026.08.17 23:55:06.095604 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3805 | 2026.08.17 23:55:06.095617 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.66 GiB. | ||
| 3806 | 2026.08.17 23:55:06.096076 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_24_24_0 (state Temporary) | ||
| 3807 | 2026.08.17 23:55:06.096198 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_24_24_0 to 202608_24_24_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3808 | 2026.08.17 23:55:06.096277 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 55230 | ||
| 3809 | 2026.08.17 23:55:06.385222 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 181 | ||
| 3810 | 2026.08.17 23:55:06.392824 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3811 | 2026.08.17 23:55:06.392838 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3812 | 2026.08.17 23:55:06.396267 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_24_24_0 (state Temporary) | ||
| 3813 | 2026.08.17 23:55:06.398887 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_24_24_0 to 202608_24_24_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3814 | 2026.08.17 23:55:06.399664 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 181 | ||
| 3815 | 2026.08.17 23:55:13.596370 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 57484 | ||
| 3816 | 2026.08.17 23:55:13.597440 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3817 | 2026.08.17 23:55:13.597454 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3818 | 2026.08.17 23:55:13.597916 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_25_25_0 (state Temporary) | ||
| 3819 | 2026.08.17 23:55:13.598044 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_25_25_0 to 202608_25_25_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3820 | 2026.08.17 23:55:13.598126 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 57484 | ||
| 3821 | 2026.08.17 23:55:13.899749 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 188 | ||
| 3822 | 2026.08.17 23:55:13.907477 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3823 | 2026.08.17 23:55:13.907492 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3824 | 2026.08.17 23:55:13.910872 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_25_25_0 (state Temporary) | ||
| 3825 | 2026.08.17 23:55:13.913439 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_25_25_0 to 202608_25_25_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3826 | 2026.08.17 23:55:13.914213 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 188 | ||
| 3827 | 2026.08.17 23:55:19.591988 [ 424402 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73365426176, merge_with_ttl_allowedtrue) | ||
| 3828 | 2026.08.17 23:55:19.592011 [ 424402 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 50519ms | ||
| 3829 | 2026.08.17 23:55:21.007628 [ 424404 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3830 | 2026.08.17 23:55:21.007657 [ 424404 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3831 | 2026.08.17 23:55:21.098219 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 60060 | ||
| 3832 | 2026.08.17 23:55:21.099312 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3833 | 2026.08.17 23:55:21.099324 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3834 | 2026.08.17 23:55:21.099680 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_26_26_0 (state Temporary) | ||
| 3835 | 2026.08.17 23:55:21.099803 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_26_26_0 to 202608_26_26_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3836 | 2026.08.17 23:55:21.099878 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 60060 | ||
| 3837 | 2026.08.17 23:55:21.099883 [ 424401 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_21_4 to 202608_26_26_0 | ||
| 3838 | 2026.08.17 23:55:21.099900 [ 424401 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3839 | 2026.08.17 23:55:21.099904 [ 424401 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3840 | 2026.08.17 23:55:21.100050 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_21_4 to 202608_26_26_0 into Compact with storage Full | ||
| 3841 | 2026.08.17 23:55:21.100101 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3842 | 2026.08.17 23:55:21.100117 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 7 marks from part 202608_1_21_4, total 47822 rows starting from the beginning of the part | ||
| 3843 | 2026.08.17 23:55:21.100160 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_22_22_0, total 2576 rows starting from the beginning of the part | ||
| 3844 | 2026.08.17 23:55:21.100188 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_23_23_0, total 2256 rows starting from the beginning of the part | ||
| 3845 | 2026.08.17 23:55:21.100204 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_24_24_0, total 2576 rows starting from the beginning of the part | ||
| 3846 | 2026.08.17 23:55:21.100221 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_25_25_0, total 2254 rows starting from the beginning of the part | ||
| 3847 | 2026.08.17 23:55:21.100233 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_26_26_0, total 2576 rows starting from the beginning of the part | ||
| 3848 | 2026.08.17 23:55:21.106139 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 60060 rows, containing 4 columns (4 merged, 0 gathered) in 0.006152105 sec., 9762512.180790152 rows/sec., 141.55 MiB/sec. | ||
| 3849 | 2026.08.17 23:55:21.106279 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Trace> MergedBlockOutputStream: filled checksums 202608_1_26_5 (state Temporary) | ||
| 3850 | 2026.08.17 23:55:21.106405 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_26_5 to 202608_1_26_5 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3851 | 2026.08.17 23:55:21.106427 [ 424473 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_26_5} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_21_4, 202608_26_26_0] -> 202608_1_26_5 | ||
| 3852 | 2026.08.17 23:55:21.106469 [ 424473 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.79 MiB. | ||
| 3853 | 2026.08.17 23:55:21.414296 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 196 | ||
| 3854 | 2026.08.17 23:55:21.421959 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3855 | 2026.08.17 23:55:21.421973 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3856 | 2026.08.17 23:55:21.425351 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_26_26_0 (state Temporary) | ||
| 3857 | 2026.08.17 23:55:21.427990 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_26_26_0 to 202608_26_26_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3858 | 2026.08.17 23:55:21.428180 [ 424309 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_21_4 to 202608_26_26_0 | ||
| 3859 | 2026.08.17 23:55:21.428220 [ 424309 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3860 | 2026.08.17 23:55:21.428231 [ 424309 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3861 | 2026.08.17 23:55:21.428371 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_21_4 to 202608_26_26_0 into Compact with storage Full | ||
| 3862 | 2026.08.17 23:55:21.428761 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 196 | ||
| 3863 | 2026.08.17 23:55:21.431117 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3864 | 2026.08.17 23:55:21.431494 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_21_4, total 158 rows starting from the beginning of the part | ||
| 3865 | 2026.08.17 23:55:21.433404 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_22_22_0, total 8 rows starting from the beginning of the part | ||
| 3866 | 2026.08.17 23:55:21.435253 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_23_23_0, total 7 rows starting from the beginning of the part | ||
| 3867 | 2026.08.17 23:55:21.437168 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_24_24_0, total 8 rows starting from the beginning of the part | ||
| 3868 | 2026.08.17 23:55:21.438960 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_25_25_0, total 7 rows starting from the beginning of the part | ||
| 3869 | 2026.08.17 23:55:21.440815 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_26_26_0, total 8 rows starting from the beginning of the part | ||
| 3870 | 2026.08.17 23:55:21.467370 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 196 rows, containing 679 columns (679 merged, 0 gathered) in 0.039051558 sec., 5019.005899841435 rows/sec., 4.54 MiB/sec. | ||
| 3871 | 2026.08.17 23:55:21.468096 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Trace> MergedBlockOutputStream: filled checksums 202608_1_26_5 (state Temporary) | ||
| 3872 | 2026.08.17 23:55:21.471416 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_26_5 to 202608_1_26_5 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3873 | 2026.08.17 23:55:21.471446 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_26_5} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_21_4, 202608_26_26_0] -> 202608_1_26_5 | ||
| 3874 | 2026.08.17 23:55:21.471840 [ 424470 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 14.65 MiB. | ||
| 3875 | 2026.08.17 23:55:22.000264 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 487.58 MiB, peak 501.71 MiB, free memory in arenas 123.89 MiB, will set to 495.48 MiB (RSS), difference: 7.91 MiB | ||
| 3876 | 2026.08.17 23:55:22.519686 [ 424354 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73365065728, merge_with_ttl_allowedtrue) | ||
| 3877 | 2026.08.17 23:55:22.519699 [ 424354 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 3878 | 2026.08.17 23:55:25.678709 [ 424410 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73364809728, merge_with_ttl_allowedtrue) | ||
| 3879 | 2026.08.17 23:55:25.678731 [ 424410 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 3880 | 2026.08.17 23:55:28.599972 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 62314 | ||
| 3881 | 2026.08.17 23:55:28.600985 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3882 | 2026.08.17 23:55:28.600999 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3883 | 2026.08.17 23:55:28.601546 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_27_27_0 (state Temporary) | ||
| 3884 | 2026.08.17 23:55:28.601675 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_27_27_0 to 202608_27_27_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3885 | 2026.08.17 23:55:28.601761 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 62314 | ||
| 3886 | 2026.08.17 23:55:28.928840 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 203 | ||
| 3887 | 2026.08.17 23:55:28.935982 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3888 | 2026.08.17 23:55:28.935997 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3889 | 2026.08.17 23:55:28.939368 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_27_27_0 (state Temporary) | ||
| 3890 | 2026.08.17 23:55:28.941937 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_27_27_0 to 202608_27_27_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3891 | 2026.08.17 23:55:28.942706 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 203 | ||
| 3892 | 2026.08.17 23:55:35.068864 [ 424411 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73364310016, merge_with_ttl_allowedtrue) | ||
| 3893 | 2026.08.17 23:55:35.068882 [ 424411 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 3894 | 2026.08.17 23:55:36.007747 [ 424397 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3895 | 2026.08.17 23:55:36.007767 [ 424397 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3896 | 2026.08.17 23:55:36.101930 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 64890 | ||
| 3897 | 2026.08.17 23:55:36.103018 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3898 | 2026.08.17 23:55:36.103031 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3899 | 2026.08.17 23:55:36.103475 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_28_28_0 (state Temporary) | ||
| 3900 | 2026.08.17 23:55:36.103605 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_28_28_0 to 202608_28_28_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3901 | 2026.08.17 23:55:36.103685 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 64890 | ||
| 3902 | 2026.08.17 23:55:36.442790 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 211 | ||
| 3903 | 2026.08.17 23:55:36.449970 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3904 | 2026.08.17 23:55:36.449984 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3905 | 2026.08.17 23:55:36.453373 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_28_28_0 (state Temporary) | ||
| 3906 | 2026.08.17 23:55:36.455981 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_28_28_0 to 202608_28_28_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3907 | 2026.08.17 23:55:36.456747 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 211 | ||
| 3908 | 2026.08.17 23:55:43.603778 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 67144 | ||
| 3909 | 2026.08.17 23:55:43.604766 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3910 | 2026.08.17 23:55:43.604777 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3911 | 2026.08.17 23:55:43.605105 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_29_29_0 (state Temporary) | ||
| 3912 | 2026.08.17 23:55:43.605230 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_29_29_0 to 202608_29_29_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3913 | 2026.08.17 23:55:43.605305 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 67144 | ||
| 3914 | 2026.08.17 23:55:43.956830 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 218 | ||
| 3915 | 2026.08.17 23:55:43.963300 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3916 | 2026.08.17 23:55:43.963315 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3917 | 2026.08.17 23:55:43.966688 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_29_29_0 (state Temporary) | ||
| 3918 | 2026.08.17 23:55:43.969106 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_29_29_0 to 202608_29_29_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3919 | 2026.08.17 23:55:43.969884 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 218 | ||
| 3920 | 2026.08.17 23:55:46.553805 [ 424358 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 52166ms | ||
| 3921 | 2026.08.17 23:55:51.007864 [ 424319 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3922 | 2026.08.17 23:55:51.007891 [ 424319 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3923 | 2026.08.17 23:55:51.105397 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 69720 | ||
| 3924 | 2026.08.17 23:55:51.106541 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3925 | 2026.08.17 23:55:51.106554 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3926 | 2026.08.17 23:55:51.106965 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_30_30_0 (state Temporary) | ||
| 3927 | 2026.08.17 23:55:51.107089 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_30_30_0 to 202608_30_30_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3928 | 2026.08.17 23:55:51.107188 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 69720 | ||
| 3929 | 2026.08.17 23:55:51.469966 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 226 | ||
| 3930 | 2026.08.17 23:55:51.477042 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3931 | 2026.08.17 23:55:51.477055 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3932 | 2026.08.17 23:55:51.480419 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_30_30_0 (state Temporary) | ||
| 3933 | 2026.08.17 23:55:51.482872 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_30_30_0 to 202608_30_30_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3934 | 2026.08.17 23:55:51.483677 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 226 | ||
| 3935 | 2026.08.17 23:55:58.607281 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 71974 | ||
| 3936 | 2026.08.17 23:55:58.608268 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3937 | 2026.08.17 23:55:58.608281 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3938 | 2026.08.17 23:55:58.608624 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_31_31_0 (state Temporary) | ||
| 3939 | 2026.08.17 23:55:58.608748 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_31_31_0 to 202608_31_31_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3940 | 2026.08.17 23:55:58.608829 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 71974 | ||
| 3941 | 2026.08.17 23:55:58.608835 [ 424408 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_26_5 to 202608_31_31_0 | ||
| 3942 | 2026.08.17 23:55:58.608851 [ 424408 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3943 | 2026.08.17 23:55:58.608856 [ 424408 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3944 | 2026.08.17 23:55:58.608998 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_26_5 to 202608_31_31_0 into Compact with storage Full | ||
| 3945 | 2026.08.17 23:55:58.609044 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3946 | 2026.08.17 23:55:58.609060 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 9 marks from part 202608_1_26_5, total 60060 rows starting from the beginning of the part | ||
| 3947 | 2026.08.17 23:55:58.609104 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_27_27_0, total 2254 rows starting from the beginning of the part | ||
| 3948 | 2026.08.17 23:55:58.609119 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_28_28_0, total 2576 rows starting from the beginning of the part | ||
| 3949 | 2026.08.17 23:55:58.609135 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_29_29_0, total 2254 rows starting from the beginning of the part | ||
| 3950 | 2026.08.17 23:55:58.609156 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_30_30_0, total 2576 rows starting from the beginning of the part | ||
| 3951 | 2026.08.17 23:55:58.609170 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_31_31_0, total 2254 rows starting from the beginning of the part | ||
| 3952 | 2026.08.17 23:55:58.614857 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 71974 rows, containing 4 columns (4 merged, 0 gathered) in 0.005923604 sec., 12150373.32002612 rows/sec., 175.73 MiB/sec. | ||
| 3953 | 2026.08.17 23:55:58.615021 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Trace> MergedBlockOutputStream: filled checksums 202608_1_31_6 (state Temporary) | ||
| 3954 | 2026.08.17 23:55:58.615166 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_31_6 to 202608_1_31_6 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3955 | 2026.08.17 23:55:58.615188 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_31_6} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_26_5, 202608_31_31_0] -> 202608_1_31_6 | ||
| 3956 | 2026.08.17 23:55:58.615234 [ 424495 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.79 MiB. | ||
| 3957 | 2026.08.17 23:55:58.983759 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 233 | ||
| 3958 | 2026.08.17 23:55:58.991059 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3959 | 2026.08.17 23:55:58.991073 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3960 | 2026.08.17 23:55:58.994473 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_31_31_0 (state Temporary) | ||
| 3961 | 2026.08.17 23:55:58.996997 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_31_31_0 to 202608_31_31_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3962 | 2026.08.17 23:55:58.997149 [ 424410 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_26_5 to 202608_31_31_0 | ||
| 3963 | 2026.08.17 23:55:58.997161 [ 424410 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3964 | 2026.08.17 23:55:58.997165 [ 424410 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3965 | 2026.08.17 23:55:58.997233 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_26_5 to 202608_31_31_0 into Compact with storage Full | ||
| 3966 | 2026.08.17 23:55:58.997776 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 233 | ||
| 3967 | 2026.08.17 23:55:59.000233 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 3968 | 2026.08.17 23:55:59.000560 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_26_5, total 196 rows starting from the beginning of the part | ||
| 3969 | 2026.08.17 23:55:59.002286 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_27_27_0, total 7 rows starting from the beginning of the part | ||
| 3970 | 2026.08.17 23:55:59.004003 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_28_28_0, total 8 rows starting from the beginning of the part | ||
| 3971 | 2026.08.17 23:55:59.005768 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_29_29_0, total 7 rows starting from the beginning of the part | ||
| 3972 | 2026.08.17 23:55:59.007512 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_30_30_0, total 8 rows starting from the beginning of the part | ||
| 3973 | 2026.08.17 23:55:59.009297 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_31_31_0, total 7 rows starting from the beginning of the part | ||
| 3974 | 2026.08.17 23:55:59.035776 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 233 rows, containing 679 columns (679 merged, 0 gathered) in 0.038569318 sec., 6041.071299212499 rows/sec., 4.79 MiB/sec. | ||
| 3975 | 2026.08.17 23:55:59.036524 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Trace> MergedBlockOutputStream: filled checksums 202608_1_31_6 (state Temporary) | ||
| 3976 | 2026.08.17 23:55:59.039760 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_31_6 to 202608_1_31_6 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3977 | 2026.08.17 23:55:59.039791 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_31_6} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_26_5, 202608_31_31_0] -> 202608_1_31_6 | ||
| 3978 | 2026.08.17 23:55:59.040196 [ 424496 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 11.50 MiB. | ||
| 3979 | 2026.08.17 23:56:00.000310 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 499.67 MiB, peak 510.42 MiB, free memory in arenas 124.85 MiB, will set to 504.54 MiB (RSS), difference: 4.87 MiB | ||
| 3980 | 2026.08.17 23:56:06.007985 [ 424420 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 3981 | 2026.08.17 23:56:06.008013 [ 424420 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 3982 | 2026.08.17 23:56:06.109004 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 74550 | ||
| 3983 | 2026.08.17 23:56:06.110089 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3984 | 2026.08.17 23:56:06.110102 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3985 | 2026.08.17 23:56:06.110575 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_32_32_0 (state Temporary) | ||
| 3986 | 2026.08.17 23:56:06.110706 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_32_32_0 to 202608_32_32_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3987 | 2026.08.17 23:56:06.110784 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 74550 | ||
| 3988 | 2026.08.17 23:56:06.497858 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 241 | ||
| 3989 | 2026.08.17 23:56:06.505695 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 3990 | 2026.08.17 23:56:06.505709 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 3991 | 2026.08.17 23:56:06.509082 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_32_32_0 (state Temporary) | ||
| 3992 | 2026.08.17 23:56:06.511687 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_32_32_0 to 202608_32_32_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 3993 | 2026.08.17 23:56:06.512459 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 241 | ||
| 3994 | 2026.08.17 23:56:07.000258 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 505.26 MiB, peak 513.29 MiB, free memory in arenas 114.74 MiB, will set to 500.61 MiB (RSS), difference: -4.65 MiB | ||
| 3995 | 2026.08.17 23:56:07.000817 [ 425081 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00012129 sec. | ||
| 3996 | 2026.08.17 23:56:10.111125 [ 424297 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73362132992, merge_with_ttl_allowedtrue) | ||
| 3997 | 2026.08.17 23:56:10.111154 [ 424297 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 3998 | 2026.08.17 23:56:13.610878 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 76804 | ||
| 3999 | 2026.08.17 23:56:13.611882 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4000 | 2026.08.17 23:56:13.611896 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 4001 | 2026.08.17 23:56:13.612258 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_33_33_0 (state Temporary) | ||
| 4002 | 2026.08.17 23:56:13.612388 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_33_33_0 to 202608_33_33_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4003 | 2026.08.17 23:56:13.612467 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 76804 | ||
| 4004 | 2026.08.17 23:56:14.012540 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 248 | ||
| 4005 | 2026.08.17 23:56:14.020156 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4006 | 2026.08.17 23:56:14.020169 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 4007 | 2026.08.17 23:56:14.023558 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_33_33_0 (state Temporary) | ||
| 4008 | 2026.08.17 23:56:14.026125 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_33_33_0 to 202608_33_33_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4009 | 2026.08.17 23:56:14.026898 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 248 | ||
| 4010 | 2026.08.17 23:56:21.008105 [ 424358 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4011 | 2026.08.17 23:56:21.008131 [ 424358 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4012 | 2026.08.17 23:56:21.112558 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 79380 | ||
| 4013 | 2026.08.17 23:56:21.113751 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4014 | 2026.08.17 23:56:21.113763 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 4015 | 2026.08.17 23:56:21.114230 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_34_34_0 (state Temporary) | ||
| 4016 | 2026.08.17 23:56:21.114359 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_34_34_0 to 202608_34_34_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4017 | 2026.08.17 23:56:21.114433 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 79380 | ||
| 4018 | 2026.08.17 23:56:21.526982 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 256 | ||
| 4019 | 2026.08.17 23:56:21.534854 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4020 | 2026.08.17 23:56:21.534871 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 4021 | 2026.08.17 23:56:21.538378 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_34_34_0 (state Temporary) | ||
| 4022 | 2026.08.17 23:56:21.540950 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_34_34_0 to 202608_34_34_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4023 | 2026.08.17 23:56:21.541729 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 256 | ||
| 4024 | 2026.08.17 23:56:22.519817 [ 424356 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73361555456, merge_with_ttl_allowedtrue) | ||
| 4025 | 2026.08.17 23:56:22.519839 [ 424356 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 4026 | 2026.08.17 23:56:25.678850 [ 424393 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73361438720, merge_with_ttl_allowedtrue) | ||
| 4027 | 2026.08.17 23:56:25.678874 [ 424393 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 4028 | 2026.08.17 23:56:28.614601 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 81634 | ||
| 4029 | 2026.08.17 23:56:28.615581 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4030 | 2026.08.17 23:56:28.615594 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 4031 | 2026.08.17 23:56:28.616048 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_35_35_0 (state Temporary) | ||
| 4032 | 2026.08.17 23:56:28.616177 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_35_35_0 to 202608_35_35_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4033 | 2026.08.17 23:56:28.616255 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 81634 | ||
| 4034 | 2026.08.17 23:56:29.041814 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 264 | ||
| 4035 | 2026.08.17 23:56:29.049441 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4036 | 2026.08.17 23:56:29.049456 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 4037 | 2026.08.17 23:56:29.052859 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_35_35_0 (state Temporary) | ||
| 4038 | 2026.08.17 23:56:29.055394 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_35_35_0 to 202608_35_35_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4039 | 2026.08.17 23:56:29.056190 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 264 | ||
| 4040 | 2026.08.17 23:56:34.000258 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 502.83 MiB, peak 513.29 MiB, free memory in arenas 106.53 MiB, will set to 493.34 MiB (RSS), difference: -9.49 MiB | ||
| 4041 | 2026.08.17 23:56:35.068995 [ 424338 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73361078272, merge_with_ttl_allowedtrue) | ||
| 4042 | 2026.08.17 23:56:35.069018 [ 424338 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 4043 | 2026.08.17 23:56:36.008218 [ 424324 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4044 | 2026.08.17 23:56:36.008240 [ 424324 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4045 | 2026.08.17 23:56:36.116345 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2578 entries to flush up to offset 84212 | ||
| 4046 | 2026.08.17 23:56:36.117525 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4047 | 2026.08.17 23:56:36.117539 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 4048 | 2026.08.17 23:56:36.118011 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_36_36_0 (state Temporary) | ||
| 4049 | 2026.08.17 23:56:36.118142 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_36_36_0 to 202608_36_36_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4050 | 2026.08.17 23:56:36.118220 [ 424410 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_31_6 to 202608_36_36_0 | ||
| 4051 | 2026.08.17 23:56:36.118228 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 84212 | ||
| 4052 | 2026.08.17 23:56:36.118234 [ 424410 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4053 | 2026.08.17 23:56:36.118239 [ 424410 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 4054 | 2026.08.17 23:56:36.118329 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_31_6 to 202608_36_36_0 into Compact with storage Full | ||
| 4055 | 2026.08.17 23:56:36.118378 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4056 | 2026.08.17 23:56:36.118391 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 10 marks from part 202608_1_31_6, total 71974 rows starting from the beginning of the part | ||
| 4057 | 2026.08.17 23:56:36.118426 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_32_32_0, total 2576 rows starting from the beginning of the part | ||
| 4058 | 2026.08.17 23:56:36.118445 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_33_33_0, total 2254 rows starting from the beginning of the part | ||
| 4059 | 2026.08.17 23:56:36.118462 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_34_34_0, total 2576 rows starting from the beginning of the part | ||
| 4060 | 2026.08.17 23:56:36.118475 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_35_35_0, total 2254 rows starting from the beginning of the part | ||
| 4061 | 2026.08.17 23:56:36.118490 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_36_36_0, total 2578 rows starting from the beginning of the part | ||
| 4062 | 2026.08.17 23:56:36.125177 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 84212 rows, containing 4 columns (4 merged, 0 gathered) in 0.006890575 sec., 12221331.31124761 rows/sec., 176.52 MiB/sec. | ||
| 4063 | 2026.08.17 23:56:36.125304 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Trace> MergedBlockOutputStream: filled checksums 202608_1_36_7 (state Temporary) | ||
| 4064 | 2026.08.17 23:56:36.125433 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_36_7 to 202608_1_36_7 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4065 | 2026.08.17 23:56:36.125456 [ 424475 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_36_7} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_31_6, 202608_36_36_0] -> 202608_1_36_7 | ||
| 4066 | 2026.08.17 23:56:36.125500 [ 424475 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 4067 | 2026.08.17 23:56:36.556269 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 271 | ||
| 4068 | 2026.08.17 23:56:36.564027 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4069 | 2026.08.17 23:56:36.564041 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 4070 | 2026.08.17 23:56:36.567437 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_36_36_0 (state Temporary) | ||
| 4071 | 2026.08.17 23:56:36.569963 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_36_36_0 to 202608_36_36_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4072 | 2026.08.17 23:56:36.570121 [ 424288 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_31_6 to 202608_36_36_0 | ||
| 4073 | 2026.08.17 23:56:36.570136 [ 424288 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4074 | 2026.08.17 23:56:36.570140 [ 424288 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.65 GiB. | ||
| 4075 | 2026.08.17 23:56:36.570286 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_31_6 to 202608_36_36_0 into Compact with storage Full | ||
| 4076 | 2026.08.17 23:56:36.570745 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 271 | ||
| 4077 | 2026.08.17 23:56:36.573649 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4078 | 2026.08.17 23:56:36.574019 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_31_6, total 233 rows starting from the beginning of the part | ||
| 4079 | 2026.08.17 23:56:36.575851 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_32_32_0, total 8 rows starting from the beginning of the part | ||
| 4080 | 2026.08.17 23:56:36.577669 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_33_33_0, total 7 rows starting from the beginning of the part | ||
| 4081 | 2026.08.17 23:56:36.579636 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_34_34_0, total 8 rows starting from the beginning of the part | ||
| 4082 | 2026.08.17 23:56:36.581443 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_35_35_0, total 8 rows starting from the beginning of the part | ||
| 4083 | 2026.08.17 23:56:36.583223 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_36_36_0, total 7 rows starting from the beginning of the part | ||
| 4084 | 2026.08.17 23:56:36.609558 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 271 rows, containing 679 columns (679 merged, 0 gathered) in 0.039330589 sec., 6890.31125366569 rows/sec., 4.96 MiB/sec. | ||
| 4085 | 2026.08.17 23:56:36.610333 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Trace> MergedBlockOutputStream: filled checksums 202608_1_36_7 (state Temporary) | ||
| 4086 | 2026.08.17 23:56:36.613608 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_36_7 to 202608_1_36_7 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4087 | 2026.08.17 23:56:36.613640 [ 424483 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_36_7} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_31_6, 202608_36_36_0] -> 202608_1_36_7 | ||
| 4088 | 2026.08.17 23:56:36.614048 [ 424483 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 12.85 MiB. | ||
| 4089 | 2026.08.17 23:56:37.000274 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 494.86 MiB, peak 513.29 MiB, free memory in arenas 111.13 MiB, will set to 493.67 MiB (RSS), difference: -1.19 MiB | ||
| 4090 | 2026.08.17 23:56:38.719921 [ 424311 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 4091 | 2026.08.17 23:56:43.618312 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 86466 | ||
| 4092 | 2026.08.17 23:56:43.619340 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4093 | 2026.08.17 23:56:43.619354 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4094 | 2026.08.17 23:56:43.619714 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_37_37_0 (state Temporary) | ||
| 4095 | 2026.08.17 23:56:43.619840 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_37_37_0 to 202608_37_37_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4096 | 2026.08.17 23:56:43.619921 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 86466 | ||
| 4097 | 2026.08.17 23:56:44.070818 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 279 | ||
| 4098 | 2026.08.17 23:56:44.078818 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4099 | 2026.08.17 23:56:44.078834 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4100 | 2026.08.17 23:56:44.082210 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_37_37_0 (state Temporary) | ||
| 4101 | 2026.08.17 23:56:44.084797 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_37_37_0 to 202608_37_37_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4102 | 2026.08.17 23:56:44.085603 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 279 | ||
| 4103 | 2026.08.17 23:56:51.008331 [ 424313 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4104 | 2026.08.17 23:56:51.008360 [ 424313 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4105 | 2026.08.17 23:56:51.120107 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 89042 | ||
| 4106 | 2026.08.17 23:56:51.121183 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4107 | 2026.08.17 23:56:51.121195 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4108 | 2026.08.17 23:56:51.121655 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_38_38_0 (state Temporary) | ||
| 4109 | 2026.08.17 23:56:51.121783 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_38_38_0 to 202608_38_38_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4110 | 2026.08.17 23:56:51.121863 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 89042 | ||
| 4111 | 2026.08.17 23:56:51.585687 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 286 | ||
| 4112 | 2026.08.17 23:56:51.592427 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4113 | 2026.08.17 23:56:51.592445 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4114 | 2026.08.17 23:56:51.595745 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_38_38_0 (state Temporary) | ||
| 4115 | 2026.08.17 23:56:51.598276 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_38_38_0 to 202608_38_38_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4116 | 2026.08.17 23:56:51.599063 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 286 | ||
| 4117 | 2026.08.17 23:56:58.622035 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2256 entries to flush up to offset 91298 | ||
| 4118 | 2026.08.17 23:56:58.623023 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4119 | 2026.08.17 23:56:58.623035 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4120 | 2026.08.17 23:56:58.623512 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_39_39_0 (state Temporary) | ||
| 4121 | 2026.08.17 23:56:58.623643 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_39_39_0 to 202608_39_39_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4122 | 2026.08.17 23:56:58.623720 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 91298 | ||
| 4123 | 2026.08.17 23:56:59.099146 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 294 | ||
| 4124 | 2026.08.17 23:56:59.106079 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4125 | 2026.08.17 23:56:59.106093 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4126 | 2026.08.17 23:56:59.109553 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_39_39_0 (state Temporary) | ||
| 4127 | 2026.08.17 23:56:59.112098 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_39_39_0 to 202608_39_39_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4128 | 2026.08.17 23:56:59.112882 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 294 | ||
| 4129 | 2026.08.17 23:57:00.000277 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 496.90 MiB, peak 513.29 MiB, free memory in arenas 108.56 MiB, will set to 498.24 MiB (RSS), difference: 1.34 MiB | ||
| 4130 | 2026.08.17 23:57:06.000523 [ 425081 ] {} <Trace> AsynchronousMetrics: Scanning /sys/block | ||
| 4131 | 2026.08.17 23:57:06.008459 [ 424309 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4132 | 2026.08.17 23:57:06.008482 [ 424309 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4133 | 2026.08.17 23:57:06.123904 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 93874 | ||
| 4134 | 2026.08.17 23:57:06.124991 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4135 | 2026.08.17 23:57:06.125003 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4136 | 2026.08.17 23:57:06.125479 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_40_40_0 (state Temporary) | ||
| 4137 | 2026.08.17 23:57:06.125613 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_40_40_0 to 202608_40_40_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4138 | 2026.08.17 23:57:06.125695 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 93874 | ||
| 4139 | 2026.08.17 23:57:06.612965 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 301 | ||
| 4140 | 2026.08.17 23:57:06.620507 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4141 | 2026.08.17 23:57:06.620520 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4142 | 2026.08.17 23:57:06.623957 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_40_40_0 (state Temporary) | ||
| 4143 | 2026.08.17 23:57:06.626502 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_40_40_0 to 202608_40_40_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4144 | 2026.08.17 23:57:06.627298 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 301 | ||
| 4145 | 2026.08.17 23:57:07.000199 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 498.96 MiB, peak 513.29 MiB, free memory in arenas 108.63 MiB, will set to 496.88 MiB (RSS), difference: -2.08 MiB | ||
| 4146 | 2026.08.17 23:57:10.111254 [ 424359 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73358897152, merge_with_ttl_allowedtrue) | ||
| 4147 | 2026.08.17 23:57:10.111276 [ 424359 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 4148 | 2026.08.17 23:57:13.625789 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 96128 | ||
| 4149 | 2026.08.17 23:57:13.626774 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4150 | 2026.08.17 23:57:13.626786 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4151 | 2026.08.17 23:57:13.627120 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_41_41_0 (state Temporary) | ||
| 4152 | 2026.08.17 23:57:13.627256 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_41_41_0 to 202608_41_41_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4153 | 2026.08.17 23:57:13.627332 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 96128 | ||
| 4154 | 2026.08.17 23:57:13.627345 [ 424422 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_36_7 to 202608_41_41_0 | ||
| 4155 | 2026.08.17 23:57:13.627373 [ 424422 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4156 | 2026.08.17 23:57:13.627379 [ 424422 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4157 | 2026.08.17 23:57:13.627456 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_36_7 to 202608_41_41_0 into Compact with storage Full | ||
| 4158 | 2026.08.17 23:57:13.627498 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4159 | 2026.08.17 23:57:13.627511 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 12 marks from part 202608_1_36_7, total 84212 rows starting from the beginning of the part | ||
| 4160 | 2026.08.17 23:57:13.627548 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_37_37_0, total 2254 rows starting from the beginning of the part | ||
| 4161 | 2026.08.17 23:57:13.627564 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_38_38_0, total 2576 rows starting from the beginning of the part | ||
| 4162 | 2026.08.17 23:57:13.627587 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_39_39_0, total 2256 rows starting from the beginning of the part | ||
| 4163 | 2026.08.17 23:57:13.627601 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_40_40_0, total 2576 rows starting from the beginning of the part | ||
| 4164 | 2026.08.17 23:57:13.627619 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_41_41_0, total 2254 rows starting from the beginning of the part | ||
| 4165 | 2026.08.17 23:57:13.634918 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 96128 rows, containing 4 columns (4 merged, 0 gathered) in 0.007499265 sec., 12818322.862307172 rows/sec., 184.88 MiB/sec. | ||
| 4166 | 2026.08.17 23:57:13.635100 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Trace> MergedBlockOutputStream: filled checksums 202608_1_41_8 (state Temporary) | ||
| 4167 | 2026.08.17 23:57:13.635258 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_41_8 to 202608_1_41_8 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4168 | 2026.08.17 23:57:13.635281 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_41_8} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_36_7, 202608_41_41_0] -> 202608_1_41_8 | ||
| 4169 | 2026.08.17 23:57:13.635322 [ 424494 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 4170 | 2026.08.17 23:57:14.000189 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 496.90 MiB, peak 513.29 MiB, free memory in arenas 101.91 MiB, will set to 498.30 MiB (RSS), difference: 1.40 MiB | ||
| 4171 | 2026.08.17 23:57:14.127381 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 309 | ||
| 4172 | 2026.08.17 23:57:14.134614 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4173 | 2026.08.17 23:57:14.134629 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4174 | 2026.08.17 23:57:14.137979 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_41_41_0 (state Temporary) | ||
| 4175 | 2026.08.17 23:57:14.140576 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_41_41_0 to 202608_41_41_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4176 | 2026.08.17 23:57:14.140739 [ 424329 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_36_7 to 202608_41_41_0 | ||
| 4177 | 2026.08.17 23:57:14.140754 [ 424329 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4178 | 2026.08.17 23:57:14.140759 [ 424329 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4179 | 2026.08.17 23:57:14.140899 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_36_7 to 202608_41_41_0 into Compact with storage Full | ||
| 4180 | 2026.08.17 23:57:14.141369 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 309 | ||
| 4181 | 2026.08.17 23:57:14.143588 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4182 | 2026.08.17 23:57:14.143901 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_36_7, total 271 rows starting from the beginning of the part | ||
| 4183 | 2026.08.17 23:57:14.145612 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_37_37_0, total 8 rows starting from the beginning of the part | ||
| 4184 | 2026.08.17 23:57:14.147412 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_38_38_0, total 7 rows starting from the beginning of the part | ||
| 4185 | 2026.08.17 23:57:14.149149 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_39_39_0, total 8 rows starting from the beginning of the part | ||
| 4186 | 2026.08.17 23:57:14.150815 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_40_40_0, total 7 rows starting from the beginning of the part | ||
| 4187 | 2026.08.17 23:57:14.152504 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_41_41_0, total 8 rows starting from the beginning of the part | ||
| 4188 | 2026.08.17 23:57:14.178872 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 309 rows, containing 679 columns (679 merged, 0 gathered) in 0.038023167 sec., 8126.624486592609 rows/sec., 5.64 MiB/sec. | ||
| 4189 | 2026.08.17 23:57:14.179673 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Trace> MergedBlockOutputStream: filled checksums 202608_1_41_8 (state Temporary) | ||
| 4190 | 2026.08.17 23:57:14.182934 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_41_8 to 202608_1_41_8 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4191 | 2026.08.17 23:57:14.182966 [ 424474 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_41_8} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_36_7, 202608_41_41_0] -> 202608_1_41_8 | ||
| 4192 | 2026.08.17 23:57:14.183393 [ 424474 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 14.65 MiB. | ||
| 4193 | 2026.08.17 23:57:15.000196 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 499.79 MiB, peak 513.67 MiB, free memory in arenas 104.51 MiB, will set to 503.47 MiB (RSS), difference: 3.68 MiB | ||
| 4194 | 2026.08.17 23:57:21.008563 [ 424376 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4195 | 2026.08.17 23:57:21.008590 [ 424376 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4196 | 2026.08.17 23:57:21.127424 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 98704 | ||
| 4197 | 2026.08.17 23:57:21.128723 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4198 | 2026.08.17 23:57:21.128738 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4199 | 2026.08.17 23:57:21.129171 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_42_42_0 (state Temporary) | ||
| 4200 | 2026.08.17 23:57:21.129303 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_42_42_0 to 202608_42_42_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4201 | 2026.08.17 23:57:21.129390 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 98704 | ||
| 4202 | 2026.08.17 23:57:21.641449 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 316 | ||
| 4203 | 2026.08.17 23:57:21.648651 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4204 | 2026.08.17 23:57:21.648666 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4205 | 2026.08.17 23:57:21.652042 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_42_42_0 (state Temporary) | ||
| 4206 | 2026.08.17 23:57:21.654584 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_42_42_0 to 202608_42_42_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4207 | 2026.08.17 23:57:21.655384 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 316 | ||
| 4208 | 2026.08.17 23:57:22.000366 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 504.19 MiB, peak 513.67 MiB, free memory in arenas 104.68 MiB, will set to 502.47 MiB (RSS), difference: -1.72 MiB | ||
| 4209 | 2026.08.17 23:57:22.519955 [ 424368 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73357875200, merge_with_ttl_allowedtrue) | ||
| 4210 | 2026.08.17 23:57:22.519971 [ 424368 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 4211 | 2026.08.17 23:57:25.678989 [ 424406 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73357758464, merge_with_ttl_allowedtrue) | ||
| 4212 | 2026.08.17 23:57:25.679008 [ 424406 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 4213 | 2026.08.17 23:57:28.629574 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 100958 | ||
| 4214 | 2026.08.17 23:57:28.630576 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4215 | 2026.08.17 23:57:28.630588 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4216 | 2026.08.17 23:57:28.631015 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_43_43_0 (state Temporary) | ||
| 4217 | 2026.08.17 23:57:28.631160 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_43_43_0 to 202608_43_43_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4218 | 2026.08.17 23:57:28.631243 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 100958 | ||
| 4219 | 2026.08.17 23:57:29.155467 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 324 | ||
| 4220 | 2026.08.17 23:57:29.163025 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4221 | 2026.08.17 23:57:29.163038 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4222 | 2026.08.17 23:57:29.166440 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_43_43_0 (state Temporary) | ||
| 4223 | 2026.08.17 23:57:29.169067 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_43_43_0 to 202608_43_43_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4224 | 2026.08.17 23:57:29.169845 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 324 | ||
| 4225 | 2026.08.17 23:57:35.069139 [ 424322 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73357402112, merge_with_ttl_allowedtrue) | ||
| 4226 | 2026.08.17 23:57:35.069154 [ 424322 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 4227 | 2026.08.17 23:57:36.008685 [ 424393 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4228 | 2026.08.17 23:57:36.008714 [ 424393 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4229 | 2026.08.17 23:57:36.131423 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 103534 | ||
| 4230 | 2026.08.17 23:57:36.132518 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4231 | 2026.08.17 23:57:36.132537 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4232 | 2026.08.17 23:57:36.133012 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_44_44_0 (state Temporary) | ||
| 4233 | 2026.08.17 23:57:36.133141 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_44_44_0 to 202608_44_44_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4234 | 2026.08.17 23:57:36.133225 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 103534 | ||
| 4235 | 2026.08.17 23:57:36.669923 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 331 | ||
| 4236 | 2026.08.17 23:57:36.677430 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4237 | 2026.08.17 23:57:36.677444 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4238 | 2026.08.17 23:57:36.680831 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_44_44_0 (state Temporary) | ||
| 4239 | 2026.08.17 23:57:36.683403 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_44_44_0 to 202608_44_44_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4240 | 2026.08.17 23:57:36.684182 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 331 | ||
| 4241 | 2026.08.17 23:57:38.720039 [ 424331 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 4242 | 2026.08.17 23:57:43.633317 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 105788 | ||
| 4243 | 2026.08.17 23:57:43.634321 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4244 | 2026.08.17 23:57:43.634334 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4245 | 2026.08.17 23:57:43.634687 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_45_45_0 (state Temporary) | ||
| 4246 | 2026.08.17 23:57:43.634813 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_45_45_0 to 202608_45_45_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4247 | 2026.08.17 23:57:43.634896 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 105788 | ||
| 4248 | 2026.08.17 23:57:44.184266 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 339 | ||
| 4249 | 2026.08.17 23:57:44.191188 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4250 | 2026.08.17 23:57:44.191201 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4251 | 2026.08.17 23:57:44.194538 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_45_45_0 (state Temporary) | ||
| 4252 | 2026.08.17 23:57:44.197050 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_45_45_0 to 202608_45_45_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4253 | 2026.08.17 23:57:44.197832 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 339 | ||
| 4254 | 2026.08.17 23:57:51.008808 [ 424409 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4255 | 2026.08.17 23:57:51.008828 [ 424409 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4256 | 2026.08.17 23:57:51.134987 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 108364 | ||
| 4257 | 2026.08.17 23:57:51.136091 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4258 | 2026.08.17 23:57:51.136104 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4259 | 2026.08.17 23:57:51.136447 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_46_46_0 (state Temporary) | ||
| 4260 | 2026.08.17 23:57:51.136582 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_46_46_0 to 202608_46_46_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4261 | 2026.08.17 23:57:51.136664 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 108364 | ||
| 4262 | 2026.08.17 23:57:51.136667 [ 424300 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_41_8 to 202608_46_46_0 | ||
| 4263 | 2026.08.17 23:57:51.136686 [ 424300 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4264 | 2026.08.17 23:57:51.136691 [ 424300 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4265 | 2026.08.17 23:57:51.136827 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_41_8 to 202608_46_46_0 into Compact with storage Full | ||
| 4266 | 2026.08.17 23:57:51.136875 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4267 | 2026.08.17 23:57:51.136889 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 13 marks from part 202608_1_41_8, total 96128 rows starting from the beginning of the part | ||
| 4268 | 2026.08.17 23:57:51.136935 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_42_42_0, total 2576 rows starting from the beginning of the part | ||
| 4269 | 2026.08.17 23:57:51.136951 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_43_43_0, total 2254 rows starting from the beginning of the part | ||
| 4270 | 2026.08.17 23:57:51.136968 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_44_44_0, total 2576 rows starting from the beginning of the part | ||
| 4271 | 2026.08.17 23:57:51.136984 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_45_45_0, total 2254 rows starting from the beginning of the part | ||
| 4272 | 2026.08.17 23:57:51.136996 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_46_46_0, total 2576 rows starting from the beginning of the part | ||
| 4273 | 2026.08.17 23:57:51.146008 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 108364 rows, containing 4 columns (4 merged, 0 gathered) in 0.009242837 sec., 11724105.921158189 rows/sec., 168.98 MiB/sec. | ||
| 4274 | 2026.08.17 23:57:51.146136 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Trace> MergedBlockOutputStream: filled checksums 202608_1_46_9 (state Temporary) | ||
| 4275 | 2026.08.17 23:57:51.146279 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_46_9 to 202608_1_46_9 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4276 | 2026.08.17 23:57:51.146302 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_46_9} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_41_8, 202608_46_46_0] -> 202608_1_46_9 | ||
| 4277 | 2026.08.17 23:57:51.146343 [ 424466 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.78 MiB. | ||
| 4278 | 2026.08.17 23:57:51.697916 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 346 | ||
| 4279 | 2026.08.17 23:57:51.705124 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4280 | 2026.08.17 23:57:51.705138 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4281 | 2026.08.17 23:57:51.708522 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_46_46_0 (state Temporary) | ||
| 4282 | 2026.08.17 23:57:51.711068 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_46_46_0 to 202608_46_46_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4283 | 2026.08.17 23:57:51.711246 [ 424366 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_41_8 to 202608_46_46_0 | ||
| 4284 | 2026.08.17 23:57:51.711259 [ 424366 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4285 | 2026.08.17 23:57:51.711263 [ 424366 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4286 | 2026.08.17 23:57:51.711399 [ 424480 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_41_8 to 202608_46_46_0 into Compact with storage Full | ||
| 4287 | 2026.08.17 23:57:51.711868 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 346 | ||
| 4288 | 2026.08.17 23:57:51.714743 [ 424480 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4289 | 2026.08.17 23:57:51.715051 [ 424480 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_41_8, total 309 rows starting from the beginning of the part | ||
| 4290 | 2026.08.17 23:57:51.716776 [ 424480 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_42_42_0, total 7 rows starting from the beginning of the part | ||
| 4291 | 2026.08.17 23:57:51.718462 [ 424480 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_43_43_0, total 8 rows starting from the beginning of the part | ||
| 4292 | 2026.08.17 23:57:51.720217 [ 424480 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_44_44_0, total 7 rows starting from the beginning of the part | ||
| 4293 | 2026.08.17 23:57:51.721960 [ 424480 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_45_45_0, total 8 rows starting from the beginning of the part | ||
| 4294 | 2026.08.17 23:57:51.723707 [ 424480 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_46_46_0, total 7 rows starting from the beginning of the part | ||
| 4295 | 2026.08.17 23:57:51.750306 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 346 rows, containing 679 columns (679 merged, 0 gathered) in 0.038964658 sec., 8879.841829998868 rows/sec., 5.95 MiB/sec. | ||
| 4296 | 2026.08.17 23:57:51.751637 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Trace> MergedBlockOutputStream: filled checksums 202608_1_46_9 (state Temporary) | ||
| 4297 | 2026.08.17 23:57:51.755256 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_46_9 to 202608_1_46_9 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4298 | 2026.08.17 23:57:51.755292 [ 424470 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_46_9} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_41_8, 202608_46_46_0] -> 202608_1_46_9 | ||
| 4299 | 2026.08.17 23:57:51.755766 [ 424470 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 14.66 MiB. | ||
| 4300 | 2026.08.17 23:57:52.600831 [ 424339 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 4 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks | ||
| 4301 | 2026.08.17 23:57:52.601002 [ 424339 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 303632ms, ratio: 0, points per minute: 0) | ||
| 4302 | 2026.08.17 23:57:53.061768 [ 424341 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 5 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks | ||
| 4303 | 2026.08.17 23:57:53.061959 [ 424341 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304093ms, ratio: 0, points per minute: 0) | ||
| 4304 | 2026.08.17 23:57:53.453786 [ 424412 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304485ms, ratio: 0, points per minute: 0) | ||
| 4305 | 2026.08.17 23:57:54.117915 [ 424326 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 5 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks | ||
| 4306 | 2026.08.17 23:57:54.118093 [ 424326 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 305262ms, ratio: 0, points per minute: 0) | ||
| 4307 | 2026.08.17 23:57:55.344869 [ 424314 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 306376ms, ratio: 0, points per minute: 0) | ||
| 4308 | 2026.08.17 23:57:58.636837 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 110618 | ||
| 4309 | 2026.08.17 23:57:58.637846 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4310 | 2026.08.17 23:57:58.637860 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4311 | 2026.08.17 23:57:58.638353 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_47_47_0 (state Temporary) | ||
| 4312 | 2026.08.17 23:57:58.638484 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_47_47_0 to 202608_47_47_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4313 | 2026.08.17 23:57:58.638568 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 110618 | ||
| 4314 | 2026.08.17 23:57:59.211952 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 354 | ||
| 4315 | 2026.08.17 23:57:59.219300 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4316 | 2026.08.17 23:57:59.219314 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4317 | 2026.08.17 23:57:59.222628 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_47_47_0 (state Temporary) | ||
| 4318 | 2026.08.17 23:57:59.225122 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_47_47_0 to 202608_47_47_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4319 | 2026.08.17 23:57:59.225899 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 354 | ||
| 4320 | 2026.08.17 23:58:06.008921 [ 424325 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4321 | 2026.08.17 23:58:06.008948 [ 424325 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4322 | 2026.08.17 23:58:06.138661 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 113194 | ||
| 4323 | 2026.08.17 23:58:06.139875 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4324 | 2026.08.17 23:58:06.139890 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4325 | 2026.08.17 23:58:06.140388 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_48_48_0 (state Temporary) | ||
| 4326 | 2026.08.17 23:58:06.140531 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_48_48_0 to 202608_48_48_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4327 | 2026.08.17 23:58:06.140621 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 113194 | ||
| 4328 | 2026.08.17 23:58:06.725984 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 361 | ||
| 4329 | 2026.08.17 23:58:06.732839 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4330 | 2026.08.17 23:58:06.732853 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.64 GiB. | ||
| 4331 | 2026.08.17 23:58:06.736124 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_48_48_0 (state Temporary) | ||
| 4332 | 2026.08.17 23:58:06.738582 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_48_48_0 to 202608_48_48_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4333 | 2026.08.17 23:58:06.739377 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 361 | ||
| 4334 | 2026.08.17 23:58:07.000598 [ 425081 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 7.974e-05 sec. | ||
| 4335 | 2026.08.17 23:58:10.111386 [ 424403 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73355202560, merge_with_ttl_allowedtrue) | ||
| 4336 | 2026.08.17 23:58:10.111407 [ 424403 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 4337 | 2026.08.17 23:58:13.640714 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 115448 | ||
| 4338 | 2026.08.17 23:58:13.641818 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4339 | 2026.08.17 23:58:13.641832 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4340 | 2026.08.17 23:58:13.642316 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_49_49_0 (state Temporary) | ||
| 4341 | 2026.08.17 23:58:13.642451 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_49_49_0 to 202608_49_49_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4342 | 2026.08.17 23:58:13.642532 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 115448 | ||
| 4343 | 2026.08.17 23:58:14.239459 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 369 | ||
| 4344 | 2026.08.17 23:58:14.246775 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4345 | 2026.08.17 23:58:14.246789 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4346 | 2026.08.17 23:58:14.250181 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_49_49_0 (state Temporary) | ||
| 4347 | 2026.08.17 23:58:14.252638 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_49_49_0 to 202608_49_49_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4348 | 2026.08.17 23:58:14.253428 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 369 | ||
| 4349 | 2026.08.17 23:58:21.009050 [ 424359 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4350 | 2026.08.17 23:58:21.009071 [ 424359 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4351 | 2026.08.17 23:58:21.142708 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 118024 | ||
| 4352 | 2026.08.17 23:58:21.143820 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4353 | 2026.08.17 23:58:21.143834 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4354 | 2026.08.17 23:58:21.144308 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_50_50_0 (state Temporary) | ||
| 4355 | 2026.08.17 23:58:21.144443 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_50_50_0 to 202608_50_50_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4356 | 2026.08.17 23:58:21.144529 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 118024 | ||
| 4357 | 2026.08.17 23:58:21.753512 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 376 | ||
| 4358 | 2026.08.17 23:58:21.761588 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4359 | 2026.08.17 23:58:21.761604 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4360 | 2026.08.17 23:58:21.765008 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_50_50_0 (state Temporary) | ||
| 4361 | 2026.08.17 23:58:21.767500 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_50_50_0 to 202608_50_50_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4362 | 2026.08.17 23:58:21.768279 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 376 | ||
| 4363 | 2026.08.17 23:58:22.520086 [ 424335 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73354620928, merge_with_ttl_allowedtrue) | ||
| 4364 | 2026.08.17 23:58:22.520097 [ 424335 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 4365 | 2026.08.17 23:58:25.679120 [ 424291 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73354506240, merge_with_ttl_allowedtrue) | ||
| 4366 | 2026.08.17 23:58:25.679151 [ 424291 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 4367 | 2026.08.17 23:58:28.644620 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 120278 | ||
| 4368 | 2026.08.17 23:58:28.645706 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4369 | 2026.08.17 23:58:28.645718 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4370 | 2026.08.17 23:58:28.646198 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_51_51_0 (state Temporary) | ||
| 4371 | 2026.08.17 23:58:28.646338 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_51_51_0 to 202608_51_51_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4372 | 2026.08.17 23:58:28.646408 [ 424366 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_46_9 to 202608_51_51_0 | ||
| 4373 | 2026.08.17 23:58:28.646422 [ 424366 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4374 | 2026.08.17 23:58:28.646426 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 120278 | ||
| 4375 | 2026.08.17 23:58:28.646426 [ 424366 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4376 | 2026.08.17 23:58:28.646503 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_46_9 to 202608_51_51_0 into Compact with storage Full | ||
| 4377 | 2026.08.17 23:58:28.646551 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4378 | 2026.08.17 23:58:28.646564 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 15 marks from part 202608_1_46_9, total 108364 rows starting from the beginning of the part | ||
| 4379 | 2026.08.17 23:58:28.646602 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_47_47_0, total 2254 rows starting from the beginning of the part | ||
| 4380 | 2026.08.17 23:58:28.646620 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_48_48_0, total 2576 rows starting from the beginning of the part | ||
| 4381 | 2026.08.17 23:58:28.646636 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_49_49_0, total 2254 rows starting from the beginning of the part | ||
| 4382 | 2026.08.17 23:58:28.646651 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_50_50_0, total 2576 rows starting from the beginning of the part | ||
| 4383 | 2026.08.17 23:58:28.646665 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_51_51_0, total 2254 rows starting from the beginning of the part | ||
| 4384 | 2026.08.17 23:58:28.655092 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 120278 rows, containing 4 columns (4 merged, 0 gathered) in 0.008624766 sec., 13945653.713967428 rows/sec., 200.81 MiB/sec. | ||
| 4385 | 2026.08.17 23:58:28.655264 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Trace> MergedBlockOutputStream: filled checksums 202608_1_51_10 (state Temporary) | ||
| 4386 | 2026.08.17 23:58:28.655385 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_51_10 to 202608_1_51_10 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4387 | 2026.08.17 23:58:28.655407 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_51_10} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_46_9, 202608_51_51_0] -> 202608_1_51_10 | ||
| 4388 | 2026.08.17 23:58:28.655447 [ 424472 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 4389 | 2026.08.17 23:58:29.000191 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 509.03 MiB, peak 520.42 MiB, free memory in arenas 95.46 MiB, will set to 511.07 MiB (RSS), difference: 2.04 MiB | ||
| 4390 | 2026.08.17 23:58:29.268363 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 384 | ||
| 4391 | 2026.08.17 23:58:29.276255 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4392 | 2026.08.17 23:58:29.276274 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4393 | 2026.08.17 23:58:29.279658 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_51_51_0 (state Temporary) | ||
| 4394 | 2026.08.17 23:58:29.282214 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_51_51_0 to 202608_51_51_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4395 | 2026.08.17 23:58:29.282407 [ 424412 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_46_9 to 202608_51_51_0 | ||
| 4396 | 2026.08.17 23:58:29.282419 [ 424412 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4397 | 2026.08.17 23:58:29.282423 [ 424412 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4398 | 2026.08.17 23:58:29.282560 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_46_9 to 202608_51_51_0 into Compact with storage Full | ||
| 4399 | 2026.08.17 23:58:29.283023 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 384 | ||
| 4400 | 2026.08.17 23:58:29.285617 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4401 | 2026.08.17 23:58:29.285956 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_46_9, total 346 rows starting from the beginning of the part | ||
| 4402 | 2026.08.17 23:58:29.287773 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_47_47_0, total 8 rows starting from the beginning of the part | ||
| 4403 | 2026.08.17 23:58:29.289529 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_48_48_0, total 7 rows starting from the beginning of the part | ||
| 4404 | 2026.08.17 23:58:29.291367 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_49_49_0, total 8 rows starting from the beginning of the part | ||
| 4405 | 2026.08.17 23:58:29.293173 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_50_50_0, total 7 rows starting from the beginning of the part | ||
| 4406 | 2026.08.17 23:58:29.294986 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_51_51_0, total 8 rows starting from the beginning of the part | ||
| 4407 | 2026.08.17 23:58:29.322541 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 384 rows, containing 679 columns (679 merged, 0 gathered) in 0.040036359 sec., 9591.28176465797 rows/sec., 6.29 MiB/sec. | ||
| 4408 | 2026.08.17 23:58:29.323503 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Trace> MergedBlockOutputStream: filled checksums 202608_1_51_10 (state Temporary) | ||
| 4409 | 2026.08.17 23:58:29.326843 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_51_10 to 202608_1_51_10 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4410 | 2026.08.17 23:58:29.326877 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_51_10} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_46_9, 202608_51_51_0] -> 202608_1_51_10 | ||
| 4411 | 2026.08.17 23:58:29.327327 [ 424489 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 14.65 MiB. | ||
| 4412 | 2026.08.17 23:58:30.000192 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 512.56 MiB, peak 526.44 MiB, free memory in arenas 109.33 MiB, will set to 519.81 MiB (RSS), difference: 7.25 MiB | ||
| 4413 | 2026.08.17 23:58:35.069261 [ 424302 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73353840640, merge_with_ttl_allowedtrue) | ||
| 4414 | 2026.08.17 23:58:35.069286 [ 424302 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 4415 | 2026.08.17 23:58:36.009165 [ 424380 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4416 | 2026.08.17 23:58:36.009188 [ 424380 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4417 | 2026.08.17 23:58:36.146517 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 122854 | ||
| 4418 | 2026.08.17 23:58:36.147902 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4419 | 2026.08.17 23:58:36.147915 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4420 | 2026.08.17 23:58:36.148396 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_52_52_0 (state Temporary) | ||
| 4421 | 2026.08.17 23:58:36.148527 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_52_52_0 to 202608_52_52_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4422 | 2026.08.17 23:58:36.148612 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 122854 | ||
| 4423 | 2026.08.17 23:58:36.783109 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 391 | ||
| 4424 | 2026.08.17 23:58:36.791413 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4425 | 2026.08.17 23:58:36.791428 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4426 | 2026.08.17 23:58:36.794843 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_52_52_0 (state Temporary) | ||
| 4427 | 2026.08.17 23:58:36.797482 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_52_52_0 to 202608_52_52_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4428 | 2026.08.17 23:58:36.798273 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 391 | ||
| 4429 | 2026.08.17 23:58:37.000352 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 520.50 MiB, peak 528.53 MiB, free memory in arenas 109.21 MiB, will set to 519.18 MiB (RSS), difference: -1.32 MiB | ||
| 4430 | 2026.08.17 23:58:38.720155 [ 424388 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 4431 | 2026.08.17 23:58:43.648705 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 125108 | ||
| 4432 | 2026.08.17 23:58:43.649711 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4433 | 2026.08.17 23:58:43.649723 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4434 | 2026.08.17 23:58:43.650087 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_53_53_0 (state Temporary) | ||
| 4435 | 2026.08.17 23:58:43.650220 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_53_53_0 to 202608_53_53_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4436 | 2026.08.17 23:58:43.650302 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 125108 | ||
| 4437 | 2026.08.17 23:58:44.298356 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 399 | ||
| 4438 | 2026.08.17 23:58:44.306483 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4439 | 2026.08.17 23:58:44.306501 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4440 | 2026.08.17 23:58:44.309885 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_53_53_0 (state Temporary) | ||
| 4441 | 2026.08.17 23:58:44.312545 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_53_53_0 to 202608_53_53_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4442 | 2026.08.17 23:58:44.313334 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 399 | ||
| 4443 | 2026.08.17 23:58:51.009279 [ 424391 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4444 | 2026.08.17 23:58:51.009302 [ 424391 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4445 | 2026.08.17 23:58:51.150392 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 127684 | ||
| 4446 | 2026.08.17 23:58:51.151604 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4447 | 2026.08.17 23:58:51.151618 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4448 | 2026.08.17 23:58:51.152092 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_54_54_0 (state Temporary) | ||
| 4449 | 2026.08.17 23:58:51.152227 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_54_54_0 to 202608_54_54_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4450 | 2026.08.17 23:58:51.152310 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 127684 | ||
| 4451 | 2026.08.17 23:58:51.813416 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 406 | ||
| 4452 | 2026.08.17 23:58:51.820691 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4453 | 2026.08.17 23:58:51.820705 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4454 | 2026.08.17 23:58:51.824096 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_54_54_0 (state Temporary) | ||
| 4455 | 2026.08.17 23:58:51.826697 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_54_54_0 to 202608_54_54_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4456 | 2026.08.17 23:58:51.827784 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 406 | ||
| 4457 | 2026.08.17 23:58:52.000187 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 520.40 MiB, peak 528.53 MiB, free memory in arenas 100.05 MiB, will set to 518.11 MiB (RSS), difference: -2.28 MiB | ||
| 4458 | 2026.08.17 23:58:58.652405 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 129938 | ||
| 4459 | 2026.08.17 23:58:58.653419 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4460 | 2026.08.17 23:58:58.653431 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4461 | 2026.08.17 23:58:58.653786 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_55_55_0 (state Temporary) | ||
| 4462 | 2026.08.17 23:58:58.653915 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_55_55_0 to 202608_55_55_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4463 | 2026.08.17 23:58:58.653999 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 129938 | ||
| 4464 | 2026.08.17 23:58:59.327868 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 414 | ||
| 4465 | 2026.08.17 23:58:59.335722 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4466 | 2026.08.17 23:58:59.335736 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4467 | 2026.08.17 23:58:59.339127 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_55_55_0 (state Temporary) | ||
| 4468 | 2026.08.17 23:58:59.341767 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_55_55_0 to 202608_55_55_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4469 | 2026.08.17 23:58:59.342555 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 414 | ||
| 4470 | 2026.08.17 23:59:00.000196 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 518.83 MiB, peak 528.53 MiB, free memory in arenas 109.27 MiB, will set to 521.29 MiB (RSS), difference: 2.46 MiB | ||
| 4471 | 2026.08.17 23:59:06.009396 [ 424411 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4472 | 2026.08.17 23:59:06.009419 [ 424411 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4473 | 2026.08.17 23:59:06.154089 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 132514 | ||
| 4474 | 2026.08.17 23:59:06.155211 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4475 | 2026.08.17 23:59:06.155225 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4476 | 2026.08.17 23:59:06.155584 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_56_56_0 (state Temporary) | ||
| 4477 | 2026.08.17 23:59:06.155716 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_56_56_0 to 202608_56_56_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4478 | 2026.08.17 23:59:06.155801 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 132514 | ||
| 4479 | 2026.08.17 23:59:06.155801 [ 424397 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_51_10 to 202608_56_56_0 | ||
| 4480 | 2026.08.17 23:59:06.155824 [ 424397 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4481 | 2026.08.17 23:59:06.155830 [ 424397 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4482 | 2026.08.17 23:59:06.155925 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_51_10 to 202608_56_56_0 into Compact with storage Full | ||
| 4483 | 2026.08.17 23:59:06.156680 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4484 | 2026.08.17 23:59:06.156695 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 16 marks from part 202608_1_51_10, total 120278 rows starting from the beginning of the part | ||
| 4485 | 2026.08.17 23:59:06.156734 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_52_52_0, total 2576 rows starting from the beginning of the part | ||
| 4486 | 2026.08.17 23:59:06.156752 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_53_53_0, total 2254 rows starting from the beginning of the part | ||
| 4487 | 2026.08.17 23:59:06.156766 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_54_54_0, total 2576 rows starting from the beginning of the part | ||
| 4488 | 2026.08.17 23:59:06.156780 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_55_55_0, total 2254 rows starting from the beginning of the part | ||
| 4489 | 2026.08.17 23:59:06.156801 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_56_56_0, total 2576 rows starting from the beginning of the part | ||
| 4490 | 2026.08.17 23:59:06.165954 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 132514 rows, containing 4 columns (4 merged, 0 gathered) in 0.010069897 sec., 13159419.604788411 rows/sec., 189.41 MiB/sec. | ||
| 4491 | 2026.08.17 23:59:06.166076 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Trace> MergedBlockOutputStream: filled checksums 202608_1_56_11 (state Temporary) | ||
| 4492 | 2026.08.17 23:59:06.166208 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_56_11 to 202608_1_56_11 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4493 | 2026.08.17 23:59:06.166233 [ 424493 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_56_11} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_51_10, 202608_56_56_0] -> 202608_1_56_11 | ||
| 4494 | 2026.08.17 23:59:06.166275 [ 424493 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 4495 | 2026.08.17 23:59:06.842638 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 421 | ||
| 4496 | 2026.08.17 23:59:06.849910 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4497 | 2026.08.17 23:59:06.849927 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4498 | 2026.08.17 23:59:06.853385 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_56_56_0 (state Temporary) | ||
| 4499 | 2026.08.17 23:59:06.856092 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_56_56_0 to 202608_56_56_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4500 | 2026.08.17 23:59:06.856282 [ 424321 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_51_10 to 202608_56_56_0 | ||
| 4501 | 2026.08.17 23:59:06.856306 [ 424321 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4502 | 2026.08.17 23:59:06.856310 [ 424321 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4503 | 2026.08.17 23:59:06.856385 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_51_10 to 202608_56_56_0 into Compact with storage Full | ||
| 4504 | 2026.08.17 23:59:06.857019 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 421 | ||
| 4505 | 2026.08.17 23:59:06.860068 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4506 | 2026.08.17 23:59:06.860414 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_51_10, total 384 rows starting from the beginning of the part | ||
| 4507 | 2026.08.17 23:59:06.862189 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_52_52_0, total 7 rows starting from the beginning of the part | ||
| 4508 | 2026.08.17 23:59:06.863958 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_53_53_0, total 8 rows starting from the beginning of the part | ||
| 4509 | 2026.08.17 23:59:06.865768 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_54_54_0, total 7 rows starting from the beginning of the part | ||
| 4510 | 2026.08.17 23:59:06.867514 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_55_55_0, total 8 rows starting from the beginning of the part | ||
| 4511 | 2026.08.17 23:59:06.869247 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_56_56_0, total 7 rows starting from the beginning of the part | ||
| 4512 | 2026.08.17 23:59:06.896550 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 421 rows, containing 679 columns (679 merged, 0 gathered) in 0.040194249 sec., 10474.135242581593 rows/sec., 6.69 MiB/sec. | ||
| 4513 | 2026.08.17 23:59:06.897414 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Trace> MergedBlockOutputStream: filled checksums 202608_1_56_11 (state Temporary) | ||
| 4514 | 2026.08.17 23:59:06.900752 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_56_11 to 202608_1_56_11 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4515 | 2026.08.17 23:59:06.900789 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_56_11} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_51_10, 202608_56_56_0] -> 202608_1_56_11 | ||
| 4516 | 2026.08.17 23:59:06.901235 [ 424495 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 14.63 MiB. | ||
| 4517 | 2026.08.17 23:59:07.000203 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 522.78 MiB, peak 536.65 MiB, free memory in arenas 112.09 MiB, will set to 530.72 MiB (RSS), difference: 7.94 MiB | ||
| 4518 | 2026.08.17 23:59:10.111518 [ 424414 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73351628800, merge_with_ttl_allowedtrue) | ||
| 4519 | 2026.08.17 23:59:10.111532 [ 424414 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 4520 | 2026.08.17 23:59:13.656002 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 134768 | ||
| 4521 | 2026.08.17 23:59:13.657013 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4522 | 2026.08.17 23:59:13.657027 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4523 | 2026.08.17 23:59:13.657500 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_57_57_0 (state Temporary) | ||
| 4524 | 2026.08.17 23:59:13.657631 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_57_57_0 to 202608_57_57_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4525 | 2026.08.17 23:59:13.657714 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 134768 | ||
| 4526 | 2026.08.17 23:59:14.357113 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 429 | ||
| 4527 | 2026.08.17 23:59:14.364589 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4528 | 2026.08.17 23:59:14.364604 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4529 | 2026.08.17 23:59:14.367989 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_57_57_0 (state Temporary) | ||
| 4530 | 2026.08.17 23:59:14.370562 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_57_57_0 to 202608_57_57_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4531 | 2026.08.17 23:59:14.371607 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 429 | ||
| 4532 | 2026.08.17 23:59:19.000187 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 531.30 MiB, peak 539.53 MiB, free memory in arenas 97.18 MiB, will set to 526.29 MiB (RSS), difference: -5.01 MiB | ||
| 4533 | 2026.08.17 23:59:21.009510 [ 424371 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4534 | 2026.08.17 23:59:21.009531 [ 424371 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4535 | 2026.08.17 23:59:21.157802 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 137344 | ||
| 4536 | 2026.08.17 23:59:21.158901 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4537 | 2026.08.17 23:59:21.158913 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4538 | 2026.08.17 23:59:21.159473 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_58_58_0 (state Temporary) | ||
| 4539 | 2026.08.17 23:59:21.159611 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_58_58_0 to 202608_58_58_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4540 | 2026.08.17 23:59:21.159697 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 137344 | ||
| 4541 | 2026.08.17 23:59:21.871683 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 436 | ||
| 4542 | 2026.08.17 23:59:21.879527 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4543 | 2026.08.17 23:59:21.879541 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4544 | 2026.08.17 23:59:21.882928 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_58_58_0 (state Temporary) | ||
| 4545 | 2026.08.17 23:59:21.885516 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_58_58_0 to 202608_58_58_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4546 | 2026.08.17 23:59:21.886305 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 436 | ||
| 4547 | 2026.08.17 23:59:22.520215 [ 424393 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73350891520, merge_with_ttl_allowedtrue) | ||
| 4548 | 2026.08.17 23:59:22.520226 [ 424393 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 4549 | 2026.08.17 23:59:25.679259 [ 424344 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73350776832, merge_with_ttl_allowedtrue) | ||
| 4550 | 2026.08.17 23:59:25.679284 [ 424344 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 4551 | 2026.08.17 23:59:28.659791 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 139598 | ||
| 4552 | 2026.08.17 23:59:28.660839 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4553 | 2026.08.17 23:59:28.660852 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4554 | 2026.08.17 23:59:28.661225 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_59_59_0 (state Temporary) | ||
| 4555 | 2026.08.17 23:59:28.661358 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_59_59_0 to 202608_59_59_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4556 | 2026.08.17 23:59:28.661443 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 139598 | ||
| 4557 | 2026.08.17 23:59:29.386384 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 444 | ||
| 4558 | 2026.08.17 23:59:29.393711 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4559 | 2026.08.17 23:59:29.393725 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4560 | 2026.08.17 23:59:29.397119 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_59_59_0 (state Temporary) | ||
| 4561 | 2026.08.17 23:59:29.399680 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_59_59_0 to 202608_59_59_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4562 | 2026.08.17 23:59:29.400483 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 444 | ||
| 4563 | 2026.08.17 23:59:31.000195 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 528.31 MiB, peak 539.53 MiB, free memory in arenas 92.05 MiB, will set to 526.38 MiB (RSS), difference: -1.93 MiB | ||
| 4564 | 2026.08.17 23:59:35.069387 [ 424422 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73350416384, merge_with_ttl_allowedtrue) | ||
| 4565 | 2026.08.17 23:59:35.069408 [ 424422 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 4566 | 2026.08.17 23:59:36.009625 [ 424308 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4567 | 2026.08.17 23:59:36.009649 [ 424308 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4568 | 2026.08.17 23:59:36.161536 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 142174 | ||
| 4569 | 2026.08.17 23:59:36.162743 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4570 | 2026.08.17 23:59:36.162756 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4571 | 2026.08.17 23:59:36.163223 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_60_60_0 (state Temporary) | ||
| 4572 | 2026.08.17 23:59:36.163353 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_60_60_0 to 202608_60_60_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4573 | 2026.08.17 23:59:36.163439 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 142174 | ||
| 4574 | 2026.08.17 23:59:36.900567 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 451 | ||
| 4575 | 2026.08.17 23:59:36.908125 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4576 | 2026.08.17 23:59:36.908139 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4577 | 2026.08.17 23:59:36.911523 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_60_60_0 (state Temporary) | ||
| 4578 | 2026.08.17 23:59:36.914095 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_60_60_0 to 202608_60_60_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4579 | 2026.08.17 23:59:36.914894 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 451 | ||
| 4580 | 2026.08.17 23:59:38.720273 [ 424340 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 4581 | 2026.08.17 23:59:43.663620 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 144428 | ||
| 4582 | 2026.08.17 23:59:43.664629 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4583 | 2026.08.17 23:59:43.664646 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4584 | 2026.08.17 23:59:43.665101 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_61_61_0 (state Temporary) | ||
| 4585 | 2026.08.17 23:59:43.665236 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_61_61_0 to 202608_61_61_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4586 | 2026.08.17 23:59:43.665319 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 144428 | ||
| 4587 | 2026.08.17 23:59:43.665325 [ 424411 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_56_11 to 202608_61_61_0 | ||
| 4588 | 2026.08.17 23:59:43.665350 [ 424411 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4589 | 2026.08.17 23:59:43.665356 [ 424411 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.63 GiB. | ||
| 4590 | 2026.08.17 23:59:43.665452 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_56_11 to 202608_61_61_0 into Compact with storage Full | ||
| 4591 | 2026.08.17 23:59:43.665511 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4592 | 2026.08.17 23:59:43.665525 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 18 marks from part 202608_1_56_11, total 132514 rows starting from the beginning of the part | ||
| 4593 | 2026.08.17 23:59:43.665564 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_57_57_0, total 2254 rows starting from the beginning of the part | ||
| 4594 | 2026.08.17 23:59:43.665584 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_58_58_0, total 2576 rows starting from the beginning of the part | ||
| 4595 | 2026.08.17 23:59:43.665600 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_59_59_0, total 2254 rows starting from the beginning of the part | ||
| 4596 | 2026.08.17 23:59:43.665614 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_60_60_0, total 2576 rows starting from the beginning of the part | ||
| 4597 | 2026.08.17 23:59:43.665629 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_61_61_0, total 2254 rows starting from the beginning of the part | ||
| 4598 | 2026.08.17 23:59:43.675744 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 144428 rows, containing 4 columns (4 merged, 0 gathered) in 0.010331457 sec., 13979441.621835139 rows/sec., 201.08 MiB/sec. | ||
| 4599 | 2026.08.17 23:59:43.675934 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Trace> MergedBlockOutputStream: filled checksums 202608_1_61_12 (state Temporary) | ||
| 4600 | 2026.08.17 23:59:43.676065 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_61_12 to 202608_1_61_12 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4601 | 2026.08.17 23:59:43.676089 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_61_12} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_56_11, 202608_61_61_0] -> 202608_1_61_12 | ||
| 4602 | 2026.08.17 23:59:43.676130 [ 424466 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 4603 | 2026.08.17 23:59:44.000200 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 527.19 MiB, peak 539.53 MiB, free memory in arenas 101.40 MiB, will set to 530.05 MiB (RSS), difference: 2.85 MiB | ||
| 4604 | 2026.08.17 23:59:44.414974 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 459 | ||
| 4605 | 2026.08.17 23:59:44.422296 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4606 | 2026.08.17 23:59:44.422313 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4607 | 2026.08.17 23:59:44.425723 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_61_61_0 (state Temporary) | ||
| 4608 | 2026.08.17 23:59:44.428309 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_61_61_0 to 202608_61_61_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4609 | 2026.08.17 23:59:44.428482 [ 424297 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_56_11 to 202608_61_61_0 | ||
| 4610 | 2026.08.17 23:59:44.428497 [ 424297 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4611 | 2026.08.17 23:59:44.428502 [ 424297 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4612 | 2026.08.17 23:59:44.428578 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_56_11 to 202608_61_61_0 into Compact with storage Full | ||
| 4613 | 2026.08.17 23:59:44.429120 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 459 | ||
| 4614 | 2026.08.17 23:59:44.431527 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4615 | 2026.08.17 23:59:44.431840 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_56_11, total 421 rows starting from the beginning of the part | ||
| 4616 | 2026.08.17 23:59:44.433555 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_57_57_0, total 8 rows starting from the beginning of the part | ||
| 4617 | 2026.08.17 23:59:44.435265 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_58_58_0, total 7 rows starting from the beginning of the part | ||
| 4618 | 2026.08.17 23:59:44.437073 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_59_59_0, total 8 rows starting from the beginning of the part | ||
| 4619 | 2026.08.17 23:59:44.438762 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_60_60_0, total 7 rows starting from the beginning of the part | ||
| 4620 | 2026.08.17 23:59:44.440444 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_61_61_0, total 8 rows starting from the beginning of the part | ||
| 4621 | 2026.08.17 23:59:44.466656 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 459 rows, containing 679 columns (679 merged, 0 gathered) in 0.038111128 sec., 12043.726441264083 rows/sec., 7.58 MiB/sec. | ||
| 4622 | 2026.08.17 23:59:44.467500 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Trace> MergedBlockOutputStream: filled checksums 202608_1_61_12 (state Temporary) | ||
| 4623 | 2026.08.17 23:59:44.470812 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_61_12 to 202608_1_61_12 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4624 | 2026.08.17 23:59:44.470848 [ 424495 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_61_12} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_56_11, 202608_61_61_0] -> 202608_1_61_12 | ||
| 4625 | 2026.08.17 23:59:44.471281 [ 424495 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 14.63 MiB. | ||
| 4626 | 2026.08.17 23:59:45.000200 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 531.51 MiB, peak 545.39 MiB, free memory in arenas 103.22 MiB, will set to 533.43 MiB (RSS), difference: 1.91 MiB | ||
| 4627 | 2026.08.17 23:59:51.009740 [ 424388 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4628 | 2026.08.17 23:59:51.009764 [ 424388 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4629 | 2026.08.17 23:59:51.165411 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 147004 | ||
| 4630 | 2026.08.17 23:59:51.166532 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4631 | 2026.08.17 23:59:51.166545 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4632 | 2026.08.17 23:59:51.166910 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_62_62_0 (state Temporary) | ||
| 4633 | 2026.08.17 23:59:51.167035 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_62_62_0 to 202608_62_62_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4634 | 2026.08.17 23:59:51.167119 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 147004 | ||
| 4635 | 2026.08.17 23:59:51.929204 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 466 | ||
| 4636 | 2026.08.17 23:59:51.936501 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4637 | 2026.08.17 23:59:51.936514 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4638 | 2026.08.17 23:59:51.939902 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_62_62_0 (state Temporary) | ||
| 4639 | 2026.08.17 23:59:51.942341 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_62_62_0 to 202608_62_62_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4640 | 2026.08.17 23:59:51.943128 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 466 | ||
| 4641 | 2026.08.17 23:59:58.667214 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 149258 | ||
| 4642 | 2026.08.17 23:59:58.668320 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4643 | 2026.08.17 23:59:58.668334 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4644 | 2026.08.17 23:59:58.668811 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_63_63_0 (state Temporary) | ||
| 4645 | 2026.08.17 23:59:58.668937 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_63_63_0 to 202608_63_63_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4646 | 2026.08.17 23:59:58.669019 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 149258 | ||
| 4647 | 2026.08.17 23:59:59.443222 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 474 | ||
| 4648 | 2026.08.17 23:59:59.451015 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4649 | 2026.08.17 23:59:59.451030 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4650 | 2026.08.17 23:59:59.454445 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_63_63_0 (state Temporary) | ||
| 4651 | 2026.08.17 23:59:59.456974 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_63_63_0 to 202608_63_63_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4652 | 2026.08.17 23:59:59.457768 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 474 | ||
| 4653 | 2026.08.18 00:00:06.009859 [ 424408 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4654 | 2026.08.18 00:00:06.009900 [ 424408 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4655 | 2026.08.18 00:00:06.169193 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 151834 | ||
| 4656 | 2026.08.18 00:00:06.170322 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4657 | 2026.08.18 00:00:06.170336 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4658 | 2026.08.18 00:00:06.170827 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_64_64_0 (state Temporary) | ||
| 4659 | 2026.08.18 00:00:06.170958 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_64_64_0 to 202608_64_64_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4660 | 2026.08.18 00:00:06.171045 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 151834 | ||
| 4661 | 2026.08.18 00:00:06.957855 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 481 | ||
| 4662 | 2026.08.18 00:00:06.966006 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4663 | 2026.08.18 00:00:06.966023 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4664 | 2026.08.18 00:00:06.969441 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_64_64_0 (state Temporary) | ||
| 4665 | 2026.08.18 00:00:06.971990 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_64_64_0 to 202608_64_64_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4666 | 2026.08.18 00:00:06.972772 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 481 | ||
| 4667 | 2026.08.18 00:00:07.000626 [ 425081 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 7.734e-05 sec. | ||
| 4668 | 2026.08.18 00:00:10.111643 [ 424422 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73347823616, merge_with_ttl_allowedtrue) | ||
| 4669 | 2026.08.18 00:00:10.111657 [ 424422 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 4670 | 2026.08.18 00:00:13.671220 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 154088 | ||
| 4671 | 2026.08.18 00:00:13.672331 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4672 | 2026.08.18 00:00:13.672343 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4673 | 2026.08.18 00:00:13.672830 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_65_65_0 (state Temporary) | ||
| 4674 | 2026.08.18 00:00:13.672958 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_65_65_0 to 202608_65_65_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4675 | 2026.08.18 00:00:13.673044 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 154088 | ||
| 4676 | 2026.08.18 00:00:14.472854 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 489 | ||
| 4677 | 2026.08.18 00:00:14.481022 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4678 | 2026.08.18 00:00:14.481036 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4679 | 2026.08.18 00:00:14.484425 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_65_65_0 (state Temporary) | ||
| 4680 | 2026.08.18 00:00:14.486929 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_65_65_0 to 202608_65_65_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4681 | 2026.08.18 00:00:14.487748 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 489 | ||
| 4682 | 2026.08.18 00:00:21.010078 [ 424321 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4683 | 2026.08.18 00:00:21.010097 [ 424321 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4684 | 2026.08.18 00:00:21.173240 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 156664 | ||
| 4685 | 2026.08.18 00:00:21.174367 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4686 | 2026.08.18 00:00:21.174379 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4687 | 2026.08.18 00:00:21.174738 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_66_66_0 (state Temporary) | ||
| 4688 | 2026.08.18 00:00:21.174864 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_66_66_0 to 202608_66_66_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4689 | 2026.08.18 00:00:21.174942 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 156664 | ||
| 4690 | 2026.08.18 00:00:21.174959 [ 424286 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_61_12 to 202608_66_66_0 | ||
| 4691 | 2026.08.18 00:00:21.174980 [ 424286 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4692 | 2026.08.18 00:00:21.174985 [ 424286 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4693 | 2026.08.18 00:00:21.175077 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_61_12 to 202608_66_66_0 into Compact with storage Full | ||
| 4694 | 2026.08.18 00:00:21.175141 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4695 | 2026.08.18 00:00:21.175157 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 19 marks from part 202608_1_61_12, total 144428 rows starting from the beginning of the part | ||
| 4696 | 2026.08.18 00:00:21.175201 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_62_62_0, total 2576 rows starting from the beginning of the part | ||
| 4697 | 2026.08.18 00:00:21.175224 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_63_63_0, total 2254 rows starting from the beginning of the part | ||
| 4698 | 2026.08.18 00:00:21.175246 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_64_64_0, total 2576 rows starting from the beginning of the part | ||
| 4699 | 2026.08.18 00:00:21.175265 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_65_65_0, total 2254 rows starting from the beginning of the part | ||
| 4700 | 2026.08.18 00:00:21.175291 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_66_66_0, total 2576 rows starting from the beginning of the part | ||
| 4701 | 2026.08.18 00:00:21.186104 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 156664 rows, containing 4 columns (4 merged, 0 gathered) in 0.011071438 sec., 14150284.723628495 rows/sec., 203.48 MiB/sec. | ||
| 4702 | 2026.08.18 00:00:21.186238 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Trace> MergedBlockOutputStream: filled checksums 202608_1_66_13 (state Temporary) | ||
| 4703 | 2026.08.18 00:00:21.186365 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_66_13 to 202608_1_66_13 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4704 | 2026.08.18 00:00:21.186388 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_66_13} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_61_12, 202608_66_66_0] -> 202608_1_66_13 | ||
| 4705 | 2026.08.18 00:00:21.186427 [ 424470 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 4706 | 2026.08.18 00:00:21.987832 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 496 | ||
| 4707 | 2026.08.18 00:00:21.996195 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4708 | 2026.08.18 00:00:21.996208 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4709 | 2026.08.18 00:00:21.999595 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_66_66_0 (state Temporary) | ||
| 4710 | 2026.08.18 00:00:22.000195 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 545.20 MiB, peak 545.39 MiB, free memory in arenas 86.97 MiB, will set to 537.05 MiB (RSS), difference: -8.15 MiB | ||
| 4711 | 2026.08.18 00:00:22.002163 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_66_66_0 to 202608_66_66_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4712 | 2026.08.18 00:00:22.002339 [ 424290 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_61_12 to 202608_66_66_0 | ||
| 4713 | 2026.08.18 00:00:22.002351 [ 424290 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4714 | 2026.08.18 00:00:22.002355 [ 424290 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4715 | 2026.08.18 00:00:22.002425 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_61_12 to 202608_66_66_0 into Compact with storage Full | ||
| 4716 | 2026.08.18 00:00:22.003049 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 496 | ||
| 4717 | 2026.08.18 00:00:22.006449 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4718 | 2026.08.18 00:00:22.006806 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_61_12, total 459 rows starting from the beginning of the part | ||
| 4719 | 2026.08.18 00:00:22.008773 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_62_62_0, total 7 rows starting from the beginning of the part | ||
| 4720 | 2026.08.18 00:00:22.010519 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_63_63_0, total 8 rows starting from the beginning of the part | ||
| 4721 | 2026.08.18 00:00:22.012471 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_64_64_0, total 7 rows starting from the beginning of the part | ||
| 4722 | 2026.08.18 00:00:22.014206 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_65_65_0, total 8 rows starting from the beginning of the part | ||
| 4723 | 2026.08.18 00:00:22.015950 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_66_66_0, total 7 rows starting from the beginning of the part | ||
| 4724 | 2026.08.18 00:00:22.042012 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 496 rows, containing 679 columns (679 merged, 0 gathered) in 0.039613198 sec., 12521.07946447545 rows/sec., 7.72 MiB/sec. | ||
| 4725 | 2026.08.18 00:00:22.042884 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Trace> MergedBlockOutputStream: filled checksums 202608_1_66_13 (state Temporary) | ||
| 4726 | 2026.08.18 00:00:22.046152 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_66_13 to 202608_1_66_13 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4727 | 2026.08.18 00:00:22.046185 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_66_13} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_61_12, 202608_66_66_0] -> 202608_1_66_13 | ||
| 4728 | 2026.08.18 00:00:22.046616 [ 424494 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 14.63 MiB. | ||
| 4729 | 2026.08.18 00:00:22.520434 [ 424336 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73347080192, merge_with_ttl_allowedtrue) | ||
| 4730 | 2026.08.18 00:00:22.520451 [ 424336 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 4731 | 2026.08.18 00:00:23.000220 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 529.78 MiB, peak 545.39 MiB, free memory in arenas 96.66 MiB, will set to 538.07 MiB (RSS), difference: 8.30 MiB | ||
| 4732 | 2026.08.18 00:00:25.679478 [ 424337 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73346807808, merge_with_ttl_allowedtrue) | ||
| 4733 | 2026.08.18 00:00:25.679492 [ 424337 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 4734 | 2026.08.18 00:00:28.675038 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 158918 | ||
| 4735 | 2026.08.18 00:00:28.676192 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4736 | 2026.08.18 00:00:28.676207 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4737 | 2026.08.18 00:00:28.676582 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_67_67_0 (state Temporary) | ||
| 4738 | 2026.08.18 00:00:28.676724 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_67_67_0 to 202608_67_67_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4739 | 2026.08.18 00:00:28.676809 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 158918 | ||
| 4740 | 2026.08.18 00:00:29.503224 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 504 | ||
| 4741 | 2026.08.18 00:00:29.511489 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4742 | 2026.08.18 00:00:29.511510 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4743 | 2026.08.18 00:00:29.514867 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_67_67_0 (state Temporary) | ||
| 4744 | 2026.08.18 00:00:29.517474 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_67_67_0 to 202608_67_67_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4745 | 2026.08.18 00:00:29.518253 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 504 | ||
| 4746 | 2026.08.18 00:00:35.069524 [ 424365 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73346283520, merge_with_ttl_allowedtrue) | ||
| 4747 | 2026.08.18 00:00:35.069539 [ 424365 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 4748 | 2026.08.18 00:00:36.010264 [ 424310 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4749 | 2026.08.18 00:00:36.010289 [ 424310 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4750 | 2026.08.18 00:00:36.176976 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 161494 | ||
| 4751 | 2026.08.18 00:00:36.178230 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4752 | 2026.08.18 00:00:36.178244 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4753 | 2026.08.18 00:00:36.178694 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_68_68_0 (state Temporary) | ||
| 4754 | 2026.08.18 00:00:36.178812 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_68_68_0 to 202608_68_68_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4755 | 2026.08.18 00:00:36.178885 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 161494 | ||
| 4756 | 2026.08.18 00:00:37.018329 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 511 | ||
| 4757 | 2026.08.18 00:00:37.026851 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4758 | 2026.08.18 00:00:37.026865 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4759 | 2026.08.18 00:00:37.030408 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_68_68_0 (state Temporary) | ||
| 4760 | 2026.08.18 00:00:37.032989 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_68_68_0 to 202608_68_68_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4761 | 2026.08.18 00:00:37.033772 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 511 | ||
| 4762 | 2026.08.18 00:00:38.720395 [ 424331 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 4763 | 2026.08.18 00:00:43.679059 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 163748 | ||
| 4764 | 2026.08.18 00:00:43.680304 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4765 | 2026.08.18 00:00:43.680318 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4766 | 2026.08.18 00:00:43.680800 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_69_69_0 (state Temporary) | ||
| 4767 | 2026.08.18 00:00:43.680929 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_69_69_0 to 202608_69_69_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4768 | 2026.08.18 00:00:43.681011 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 163748 | ||
| 4769 | 2026.08.18 00:00:44.533932 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 519 | ||
| 4770 | 2026.08.18 00:00:44.542554 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4771 | 2026.08.18 00:00:44.542568 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4772 | 2026.08.18 00:00:44.545969 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_69_69_0 (state Temporary) | ||
| 4773 | 2026.08.18 00:00:44.548605 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_69_69_0 to 202608_69_69_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4774 | 2026.08.18 00:00:44.549386 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 519 | ||
| 4775 | 2026.08.18 00:00:51.009289 [ 424555 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_1_0, 202608_2_2_0, 202608_3_3_0, 202608_4_4_0, 202608_5_5_0, 202608_6_6_0] | ||
| 4776 | 2026.08.18 00:00:51.009306 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_1_0, 202608_2_2_0, 202608_3_3_0, 202608_4_4_0, 202608_5_5_0, 202608_6_6_0] | ||
| 4777 | 2026.08.18 00:00:51.010216 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_1_0, 202608_2_2_0, 202608_3_3_0, 202608_4_4_0, 202608_5_5_0, 202608_6_6_0] | ||
| 4778 | 2026.08.18 00:00:51.010376 [ 424300 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4779 | 2026.08.18 00:00:51.010403 [ 424300 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4780 | 2026.08.18 00:00:51.181198 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2578 entries to flush up to offset 166326 | ||
| 4781 | 2026.08.18 00:00:51.182419 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4782 | 2026.08.18 00:00:51.182433 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4783 | 2026.08.18 00:00:51.182806 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_70_70_0 (state Temporary) | ||
| 4784 | 2026.08.18 00:00:51.182937 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_70_70_0 to 202608_70_70_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4785 | 2026.08.18 00:00:51.183016 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 166326 | ||
| 4786 | 2026.08.18 00:00:52.049544 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 527 | ||
| 4787 | 2026.08.18 00:00:52.058082 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4788 | 2026.08.18 00:00:52.058095 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4789 | 2026.08.18 00:00:52.061477 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_70_70_0 (state Temporary) | ||
| 4790 | 2026.08.18 00:00:52.064060 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_70_70_0 to 202608_70_70_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4791 | 2026.08.18 00:00:52.064277 [ 424720 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_1_0, 202608_2_2_0, 202608_3_3_0, 202608_4_4_0, 202608_5_5_0, 202608_6_6_0] | ||
| 4792 | 2026.08.18 00:00:52.064287 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_1_0, 202608_2_2_0, 202608_3_3_0, 202608_4_4_0, 202608_5_5_0, 202608_6_6_0] | ||
| 4793 | 2026.08.18 00:00:52.064841 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 527 | ||
| 4794 | 2026.08.18 00:00:52.065027 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_1_0, 202608_2_2_0, 202608_3_3_0, 202608_4_4_0, 202608_5_5_0, 202608_6_6_0] | ||
| 4795 | 2026.08.18 00:00:53.000248 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 535.79 MiB, peak 547.82 MiB, free memory in arenas 87.06 MiB, will set to 528.50 MiB (RSS), difference: -7.29 MiB | ||
| 4796 | 2026.08.18 00:00:58.683187 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 168580 | ||
| 4797 | 2026.08.18 00:00:58.684363 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4798 | 2026.08.18 00:00:58.684377 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4799 | 2026.08.18 00:00:58.684861 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_71_71_0 (state Temporary) | ||
| 4800 | 2026.08.18 00:00:58.684992 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_71_71_0 to 202608_71_71_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4801 | 2026.08.18 00:00:58.685072 [ 424398 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_66_13 to 202608_71_71_0 | ||
| 4802 | 2026.08.18 00:00:58.685079 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 168580 | ||
| 4803 | 2026.08.18 00:00:58.685093 [ 424398 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4804 | 2026.08.18 00:00:58.685098 [ 424398 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4805 | 2026.08.18 00:00:58.685181 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_66_13 to 202608_71_71_0 into Compact with storage Full | ||
| 4806 | 2026.08.18 00:00:58.685238 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4807 | 2026.08.18 00:00:58.685253 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 21 marks from part 202608_1_66_13, total 156664 rows starting from the beginning of the part | ||
| 4808 | 2026.08.18 00:00:58.685295 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_67_67_0, total 2254 rows starting from the beginning of the part | ||
| 4809 | 2026.08.18 00:00:58.685315 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_68_68_0, total 2576 rows starting from the beginning of the part | ||
| 4810 | 2026.08.18 00:00:58.685339 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_69_69_0, total 2254 rows starting from the beginning of the part | ||
| 4811 | 2026.08.18 00:00:58.685354 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_70_70_0, total 2578 rows starting from the beginning of the part | ||
| 4812 | 2026.08.18 00:00:58.685373 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_71_71_0, total 2254 rows starting from the beginning of the part | ||
| 4813 | 2026.08.18 00:00:58.696807 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 168580 rows, containing 4 columns (4 merged, 0 gathered) in 0.011665568 sec., 14451075.164106883 rows/sec., 207.70 MiB/sec. | ||
| 4814 | 2026.08.18 00:00:58.696968 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Trace> MergedBlockOutputStream: filled checksums 202608_1_71_14 (state Temporary) | ||
| 4815 | 2026.08.18 00:00:58.697095 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_71_14 to 202608_1_71_14 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4816 | 2026.08.18 00:00:58.697117 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_71_14} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_66_13, 202608_71_71_0] -> 202608_1_71_14 | ||
| 4817 | 2026.08.18 00:00:58.697160 [ 424474 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 4818 | 2026.08.18 00:00:59.000191 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 528.52 MiB, peak 547.82 MiB, free memory in arenas 90.12 MiB, will set to 524.88 MiB (RSS), difference: -3.64 MiB | ||
| 4819 | 2026.08.18 00:00:59.565004 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 534 | ||
| 4820 | 2026.08.18 00:00:59.573109 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4821 | 2026.08.18 00:00:59.573122 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4822 | 2026.08.18 00:00:59.576510 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_71_71_0 (state Temporary) | ||
| 4823 | 2026.08.18 00:00:59.579117 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_71_71_0 to 202608_71_71_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4824 | 2026.08.18 00:00:59.579302 [ 424302 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_66_13 to 202608_71_71_0 | ||
| 4825 | 2026.08.18 00:00:59.579326 [ 424302 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4826 | 2026.08.18 00:00:59.579332 [ 424302 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4827 | 2026.08.18 00:00:59.579398 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_66_13 to 202608_71_71_0 into Compact with storage Full | ||
| 4828 | 2026.08.18 00:00:59.579997 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 534 | ||
| 4829 | 2026.08.18 00:00:59.583059 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4830 | 2026.08.18 00:00:59.583526 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_66_13, total 496 rows starting from the beginning of the part | ||
| 4831 | 2026.08.18 00:00:59.585575 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_67_67_0, total 8 rows starting from the beginning of the part | ||
| 4832 | 2026.08.18 00:00:59.587452 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_68_68_0, total 7 rows starting from the beginning of the part | ||
| 4833 | 2026.08.18 00:00:59.589352 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_69_69_0, total 8 rows starting from the beginning of the part | ||
| 4834 | 2026.08.18 00:00:59.591204 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_70_70_0, total 8 rows starting from the beginning of the part | ||
| 4835 | 2026.08.18 00:00:59.593053 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_71_71_0, total 7 rows starting from the beginning of the part | ||
| 4836 | 2026.08.18 00:00:59.621276 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 534 rows, containing 679 columns (679 merged, 0 gathered) in 0.04190679 sec., 12742.565106991015 rows/sec., 7.78 MiB/sec. | ||
| 4837 | 2026.08.18 00:00:59.622417 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Trace> MergedBlockOutputStream: filled checksums 202608_1_71_14 (state Temporary) | ||
| 4838 | 2026.08.18 00:00:59.625852 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_71_14 to 202608_1_71_14 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4839 | 2026.08.18 00:00:59.625892 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_71_14} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_66_13, 202608_71_71_0] -> 202608_1_71_14 | ||
| 4840 | 2026.08.18 00:00:59.626352 [ 424475 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 15.47 MiB. | ||
| 4841 | 2026.08.18 00:01:00.000192 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 526.34 MiB, peak 547.82 MiB, free memory in arenas 112.51 MiB, will set to 543.14 MiB (RSS), difference: 16.80 MiB | ||
| 4842 | 2026.08.18 00:01:06.010487 [ 424356 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4843 | 2026.08.18 00:01:06.010515 [ 424356 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4844 | 2026.08.18 00:01:06.185274 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 171156 | ||
| 4845 | 2026.08.18 00:01:06.186521 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4846 | 2026.08.18 00:01:06.186535 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4847 | 2026.08.18 00:01:06.186929 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_72_72_0 (state Temporary) | ||
| 4848 | 2026.08.18 00:01:06.187066 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_72_72_0 to 202608_72_72_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4849 | 2026.08.18 00:01:06.187173 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 171156 | ||
| 4850 | 2026.08.18 00:01:07.080086 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 542 | ||
| 4851 | 2026.08.18 00:01:07.088215 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4852 | 2026.08.18 00:01:07.088230 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4853 | 2026.08.18 00:01:07.091826 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_72_72_0 (state Temporary) | ||
| 4854 | 2026.08.18 00:01:07.094380 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_72_72_0 to 202608_72_72_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4855 | 2026.08.18 00:01:07.095210 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 542 | ||
| 4856 | 2026.08.18 00:01:10.111779 [ 424310 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345980416, merge_with_ttl_allowedtrue) | ||
| 4857 | 2026.08.18 00:01:10.111809 [ 424310 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 4858 | 2026.08.18 00:01:13.687366 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 173410 | ||
| 4859 | 2026.08.18 00:01:13.688407 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4860 | 2026.08.18 00:01:13.688421 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4861 | 2026.08.18 00:01:13.688901 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_73_73_0 (state Temporary) | ||
| 4862 | 2026.08.18 00:01:13.689030 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_73_73_0 to 202608_73_73_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4863 | 2026.08.18 00:01:13.689113 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 173410 | ||
| 4864 | 2026.08.18 00:01:14.595388 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 549 | ||
| 4865 | 2026.08.18 00:01:14.602820 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4866 | 2026.08.18 00:01:14.602833 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4867 | 2026.08.18 00:01:14.606242 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_73_73_0 (state Temporary) | ||
| 4868 | 2026.08.18 00:01:14.608770 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_73_73_0 to 202608_73_73_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4869 | 2026.08.18 00:01:14.609578 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 549 | ||
| 4870 | 2026.08.18 00:01:21.010608 [ 424410 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4871 | 2026.08.18 00:01:21.010638 [ 424410 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4872 | 2026.08.18 00:01:21.189286 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 175986 | ||
| 4873 | 2026.08.18 00:01:21.190604 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4874 | 2026.08.18 00:01:21.190618 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4875 | 2026.08.18 00:01:21.191165 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_74_74_0 (state Temporary) | ||
| 4876 | 2026.08.18 00:01:21.191309 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_74_74_0 to 202608_74_74_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4877 | 2026.08.18 00:01:21.191396 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 175986 | ||
| 4878 | 2026.08.18 00:01:22.109755 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 557 | ||
| 4879 | 2026.08.18 00:01:22.116896 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4880 | 2026.08.18 00:01:22.116909 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4881 | 2026.08.18 00:01:22.120212 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_74_74_0 (state Temporary) | ||
| 4882 | 2026.08.18 00:01:22.122673 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_74_74_0 to 202608_74_74_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4883 | 2026.08.18 00:01:22.123481 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 557 | ||
| 4884 | 2026.08.18 00:01:22.520647 [ 424416 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345402880, merge_with_ttl_allowedtrue) | ||
| 4885 | 2026.08.18 00:01:22.520663 [ 424416 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 4886 | 2026.08.18 00:01:25.679601 [ 424291 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345284096, merge_with_ttl_allowedtrue) | ||
| 4887 | 2026.08.18 00:01:25.679616 [ 424291 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 4888 | 2026.08.18 00:01:28.515887 [ 424720 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_6_1, 202608_7_7_0, 202608_8_8_0, 202608_9_9_0, 202608_10_10_0, 202608_11_11_0] | ||
| 4889 | 2026.08.18 00:01:28.515899 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_6_1, 202608_7_7_0, 202608_8_8_0, 202608_9_9_0, 202608_10_10_0, 202608_11_11_0] | ||
| 4890 | 2026.08.18 00:01:28.516650 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_6_1, 202608_7_7_0, 202608_8_8_0, 202608_9_9_0, 202608_10_10_0, 202608_11_11_0] | ||
| 4891 | 2026.08.18 00:01:28.691504 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 178240 | ||
| 4892 | 2026.08.18 00:01:28.692451 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4893 | 2026.08.18 00:01:28.692462 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4894 | 2026.08.18 00:01:28.692779 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_75_75_0 (state Temporary) | ||
| 4895 | 2026.08.18 00:01:28.692893 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_75_75_0 to 202608_75_75_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4896 | 2026.08.18 00:01:28.692967 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 178240 | ||
| 4897 | 2026.08.18 00:01:29.000212 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 541.73 MiB, peak 553.92 MiB, free memory in arenas 95.64 MiB, will set to 538.50 MiB (RSS), difference: -3.23 MiB | ||
| 4898 | 2026.08.18 00:01:29.428200 [ 424552 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_6_1, 202608_7_7_0, 202608_8_8_0, 202608_9_9_0, 202608_10_10_0, 202608_11_11_0] | ||
| 4899 | 2026.08.18 00:01:29.428209 [ 424552 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_6_1, 202608_7_7_0, 202608_8_8_0, 202608_9_9_0, 202608_10_10_0, 202608_11_11_0] | ||
| 4900 | 2026.08.18 00:01:29.428884 [ 424552 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_6_1, 202608_7_7_0, 202608_8_8_0, 202608_9_9_0, 202608_10_10_0, 202608_11_11_0] | ||
| 4901 | 2026.08.18 00:01:29.623563 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 564 | ||
| 4902 | 2026.08.18 00:01:29.634466 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4903 | 2026.08.18 00:01:29.634482 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4904 | 2026.08.18 00:01:29.638417 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_75_75_0 (state Temporary) | ||
| 4905 | 2026.08.18 00:01:29.641218 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_75_75_0 to 202608_75_75_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4906 | 2026.08.18 00:01:29.642040 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 564 | ||
| 4907 | 2026.08.18 00:01:35.069673 [ 424406 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73346220032, merge_with_ttl_allowedtrue) | ||
| 4908 | 2026.08.18 00:01:35.069697 [ 424406 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 4909 | 2026.08.18 00:01:36.010748 [ 424378 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4910 | 2026.08.18 00:01:36.010781 [ 424378 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4911 | 2026.08.18 00:01:36.193149 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 180816 | ||
| 4912 | 2026.08.18 00:01:36.194644 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4913 | 2026.08.18 00:01:36.194661 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4914 | 2026.08.18 00:01:36.195098 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_76_76_0 (state Temporary) | ||
| 4915 | 2026.08.18 00:01:36.195283 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_76_76_0 to 202608_76_76_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4916 | 2026.08.18 00:01:36.195379 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 180816 | ||
| 4917 | 2026.08.18 00:01:36.195379 [ 424394 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_71_14 to 202608_76_76_0 | ||
| 4918 | 2026.08.18 00:01:36.195407 [ 424394 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4919 | 2026.08.18 00:01:36.195413 [ 424394 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4920 | 2026.08.18 00:01:36.195596 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_71_14 to 202608_76_76_0 into Compact with storage Full | ||
| 4921 | 2026.08.18 00:01:36.195659 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4922 | 2026.08.18 00:01:36.195677 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 22 marks from part 202608_1_71_14, total 168580 rows starting from the beginning of the part | ||
| 4923 | 2026.08.18 00:01:36.195735 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_72_72_0, total 2576 rows starting from the beginning of the part | ||
| 4924 | 2026.08.18 00:01:36.195755 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_73_73_0, total 2254 rows starting from the beginning of the part | ||
| 4925 | 2026.08.18 00:01:36.195776 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_74_74_0, total 2576 rows starting from the beginning of the part | ||
| 4926 | 2026.08.18 00:01:36.195803 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_75_75_0, total 2254 rows starting from the beginning of the part | ||
| 4927 | 2026.08.18 00:01:36.195821 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_76_76_0, total 2576 rows starting from the beginning of the part | ||
| 4928 | 2026.08.18 00:01:36.210113 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 180816 rows, containing 4 columns (4 merged, 0 gathered) in 0.01459932 sec., 12385234.380779378 rows/sec., 177.97 MiB/sec. | ||
| 4929 | 2026.08.18 00:01:36.210239 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Trace> MergedBlockOutputStream: filled checksums 202608_1_76_15 (state Temporary) | ||
| 4930 | 2026.08.18 00:01:36.210407 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_76_15 to 202608_1_76_15 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4931 | 2026.08.18 00:01:36.210430 [ 424478 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_76_15} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_71_14, 202608_76_76_0] -> 202608_1_76_15 | ||
| 4932 | 2026.08.18 00:01:36.210470 [ 424478 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.79 MiB. | ||
| 4933 | 2026.08.18 00:01:37.142200 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 572 | ||
| 4934 | 2026.08.18 00:01:37.149599 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4935 | 2026.08.18 00:01:37.149612 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4936 | 2026.08.18 00:01:37.153011 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_76_76_0 (state Temporary) | ||
| 4937 | 2026.08.18 00:01:37.155706 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_76_76_0 to 202608_76_76_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4938 | 2026.08.18 00:01:37.155870 [ 424407 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_71_14 to 202608_76_76_0 | ||
| 4939 | 2026.08.18 00:01:37.155885 [ 424407 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4940 | 2026.08.18 00:01:37.155889 [ 424407 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4941 | 2026.08.18 00:01:37.155959 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_71_14 to 202608_76_76_0 into Compact with storage Full | ||
| 4942 | 2026.08.18 00:01:37.156589 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 572 | ||
| 4943 | 2026.08.18 00:01:37.159312 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 4944 | 2026.08.18 00:01:37.159731 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_71_14, total 534 rows starting from the beginning of the part | ||
| 4945 | 2026.08.18 00:01:37.161690 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_72_72_0, total 8 rows starting from the beginning of the part | ||
| 4946 | 2026.08.18 00:01:37.163687 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_73_73_0, total 7 rows starting from the beginning of the part | ||
| 4947 | 2026.08.18 00:01:37.165585 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_74_74_0, total 8 rows starting from the beginning of the part | ||
| 4948 | 2026.08.18 00:01:37.167451 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_75_75_0, total 7 rows starting from the beginning of the part | ||
| 4949 | 2026.08.18 00:01:37.169263 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_76_76_0, total 8 rows starting from the beginning of the part | ||
| 4950 | 2026.08.18 00:01:37.198018 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 572 rows, containing 679 columns (679 merged, 0 gathered) in 0.04208404 sec., 13591.850972482678 rows/sec., 8.11 MiB/sec. | ||
| 4951 | 2026.08.18 00:01:37.200542 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Trace> MergedBlockOutputStream: filled checksums 202608_1_76_15 (state Temporary) | ||
| 4952 | 2026.08.18 00:01:37.204070 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_76_15 to 202608_1_76_15 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4953 | 2026.08.18 00:01:37.204111 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_76_15} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_71_14, 202608_76_76_0] -> 202608_1_76_15 | ||
| 4954 | 2026.08.18 00:01:37.204561 [ 424475 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 4955 | 2026.08.18 00:01:38.000226 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 541.29 MiB, peak 559.19 MiB, free memory in arenas 96.50 MiB, will set to 552.97 MiB (RSS), difference: 11.68 MiB | ||
| 4956 | 2026.08.18 00:01:38.720601 [ 424384 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 4957 | 2026.08.18 00:01:43.696362 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 183070 | ||
| 4958 | 2026.08.18 00:01:43.697329 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4959 | 2026.08.18 00:01:43.697341 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4960 | 2026.08.18 00:01:43.697663 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_77_77_0 (state Temporary) | ||
| 4961 | 2026.08.18 00:01:43.697782 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_77_77_0 to 202608_77_77_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4962 | 2026.08.18 00:01:43.697854 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 183070 | ||
| 4963 | 2026.08.18 00:01:44.000326 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 552.88 MiB, peak 561.08 MiB, free memory in arenas 84.08 MiB, will set to 549.27 MiB (RSS), difference: -3.61 MiB | ||
| 4964 | 2026.08.18 00:01:44.656673 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 579 | ||
| 4965 | 2026.08.18 00:01:44.663950 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4966 | 2026.08.18 00:01:44.663964 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4967 | 2026.08.18 00:01:44.667352 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_77_77_0 (state Temporary) | ||
| 4968 | 2026.08.18 00:01:44.669957 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_77_77_0 to 202608_77_77_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4969 | 2026.08.18 00:01:44.670780 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 579 | ||
| 4970 | 2026.08.18 00:01:46.000331 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 550.74 MiB, peak 561.08 MiB, free memory in arenas 70.36 MiB, will set to 546.91 MiB (RSS), difference: -3.83 MiB | ||
| 4971 | 2026.08.18 00:01:49.000257 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 546.91 MiB, peak 561.08 MiB, free memory in arenas 55.86 MiB, will set to 534.52 MiB (RSS), difference: -12.39 MiB | ||
| 4972 | 2026.08.18 00:01:51.010958 [ 424369 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 4973 | 2026.08.18 00:01:51.010984 [ 424369 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 4974 | 2026.08.18 00:01:51.198037 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 185646 | ||
| 4975 | 2026.08.18 00:01:51.199245 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4976 | 2026.08.18 00:01:51.199258 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4977 | 2026.08.18 00:01:51.199717 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_78_78_0 (state Temporary) | ||
| 4978 | 2026.08.18 00:01:51.199841 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_78_78_0 to 202608_78_78_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4979 | 2026.08.18 00:01:51.199915 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 185646 | ||
| 4980 | 2026.08.18 00:01:52.000252 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 534.53 MiB, peak 561.08 MiB, free memory in arenas 66.78 MiB, will set to 533.26 MiB (RSS), difference: -1.27 MiB | ||
| 4981 | 2026.08.18 00:01:52.170947 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 587 | ||
| 4982 | 2026.08.18 00:01:52.178834 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4983 | 2026.08.18 00:01:52.178848 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4984 | 2026.08.18 00:01:52.182241 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_78_78_0 (state Temporary) | ||
| 4985 | 2026.08.18 00:01:52.184858 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_78_78_0 to 202608_78_78_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4986 | 2026.08.18 00:01:52.185676 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 587 | ||
| 4987 | 2026.08.18 00:01:58.700021 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 187900 | ||
| 4988 | 2026.08.18 00:01:58.700992 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4989 | 2026.08.18 00:01:58.701004 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4990 | 2026.08.18 00:01:58.701398 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_79_79_0 (state Temporary) | ||
| 4991 | 2026.08.18 00:01:58.701516 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_79_79_0 to 202608_79_79_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4992 | 2026.08.18 00:01:58.701584 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 187900 | ||
| 4993 | 2026.08.18 00:01:59.685761 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 594 | ||
| 4994 | 2026.08.18 00:01:59.694017 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 4995 | 2026.08.18 00:01:59.694030 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 4996 | 2026.08.18 00:01:59.697528 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_79_79_0 (state Temporary) | ||
| 4997 | 2026.08.18 00:01:59.700097 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_79_79_0 to 202608_79_79_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 4998 | 2026.08.18 00:01:59.700910 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 594 | ||
| 4999 | 2026.08.18 00:02:06.011166 [ 424397 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5000 | 2026.08.18 00:02:06.011188 [ 424397 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5001 | 2026.08.18 00:02:06.201767 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 190476 | ||
| 5002 | 2026.08.18 00:02:06.202954 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5003 | 2026.08.18 00:02:06.202968 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5004 | 2026.08.18 00:02:06.203416 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_80_80_0 (state Temporary) | ||
| 5005 | 2026.08.18 00:02:06.203547 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_80_80_0 to 202608_80_80_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5006 | 2026.08.18 00:02:06.203622 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 190476 | ||
| 5007 | 2026.08.18 00:02:06.203665 [ 424555 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_11_2, 202608_12_12_0, 202608_13_13_0, 202608_14_14_0, 202608_15_15_0, 202608_16_16_0] | ||
| 5008 | 2026.08.18 00:02:06.203669 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_11_2, 202608_12_12_0, 202608_13_13_0, 202608_14_14_0, 202608_15_15_0, 202608_16_16_0] | ||
| 5009 | 2026.08.18 00:02:06.204320 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_11_2, 202608_12_12_0, 202608_13_13_0, 202608_14_14_0, 202608_15_15_0, 202608_16_16_0] | ||
| 5010 | 2026.08.18 00:02:06.326627 [ 424720 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_11_2, 202608_12_12_0, 202608_13_13_0, 202608_14_14_0, 202608_15_15_0, 202608_16_16_0] | ||
| 5011 | 2026.08.18 00:02:06.326639 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_11_2, 202608_12_12_0, 202608_13_13_0, 202608_14_14_0, 202608_15_15_0, 202608_16_16_0] | ||
| 5012 | 2026.08.18 00:02:06.327501 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_11_2, 202608_12_12_0, 202608_13_13_0, 202608_14_14_0, 202608_15_15_0, 202608_16_16_0] | ||
| 5013 | 2026.08.18 00:02:07.000407 [ 425081 ] {} <Trace> AsynchronousMetrics: Scanning /sys/block | ||
| 5014 | 2026.08.18 00:02:07.000673 [ 425081 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 7.06e-05 sec. | ||
| 5015 | 2026.08.18 00:02:07.201084 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 602 | ||
| 5016 | 2026.08.18 00:02:07.208946 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5017 | 2026.08.18 00:02:07.208960 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5018 | 2026.08.18 00:02:07.212353 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_80_80_0 (state Temporary) | ||
| 5019 | 2026.08.18 00:02:07.214852 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_80_80_0 to 202608_80_80_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5020 | 2026.08.18 00:02:07.215679 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 602 | ||
| 5021 | 2026.08.18 00:02:10.112009 [ 424378 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345935360, merge_with_ttl_allowedtrue) | ||
| 5022 | 2026.08.18 00:02:10.112042 [ 424378 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 5023 | 2026.08.18 00:02:13.703716 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 192730 | ||
| 5024 | 2026.08.18 00:02:13.704721 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5025 | 2026.08.18 00:02:13.704733 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5026 | 2026.08.18 00:02:13.705164 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_81_81_0 (state Temporary) | ||
| 5027 | 2026.08.18 00:02:13.705377 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_81_81_0 to 202608_81_81_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5028 | 2026.08.18 00:02:13.705455 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 192730 | ||
| 5029 | 2026.08.18 00:02:13.705579 [ 424320 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_76_15 to 202608_81_81_0 | ||
| 5030 | 2026.08.18 00:02:13.705599 [ 424320 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5031 | 2026.08.18 00:02:13.705604 [ 424320 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5032 | 2026.08.18 00:02:13.705685 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_76_15 to 202608_81_81_0 into Compact with storage Full | ||
| 5033 | 2026.08.18 00:02:13.705748 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5034 | 2026.08.18 00:02:13.705762 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 24 marks from part 202608_1_76_15, total 180816 rows starting from the beginning of the part | ||
| 5035 | 2026.08.18 00:02:13.705801 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_77_77_0, total 2254 rows starting from the beginning of the part | ||
| 5036 | 2026.08.18 00:02:13.705819 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_78_78_0, total 2576 rows starting from the beginning of the part | ||
| 5037 | 2026.08.18 00:02:13.705837 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_79_79_0, total 2254 rows starting from the beginning of the part | ||
| 5038 | 2026.08.18 00:02:13.705853 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_80_80_0, total 2576 rows starting from the beginning of the part | ||
| 5039 | 2026.08.18 00:02:13.705869 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_81_81_0, total 2254 rows starting from the beginning of the part | ||
| 5040 | 2026.08.18 00:02:13.719066 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 192730 rows, containing 4 columns (4 merged, 0 gathered) in 0.01341785 sec., 14363702.083418729 rows/sec., 206.32 MiB/sec. | ||
| 5041 | 2026.08.18 00:02:13.719338 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Trace> MergedBlockOutputStream: filled checksums 202608_1_81_16 (state Temporary) | ||
| 5042 | 2026.08.18 00:02:13.719467 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_81_16 to 202608_1_81_16 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5043 | 2026.08.18 00:02:13.719491 [ 424470 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_81_16} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_76_15, 202608_81_81_0] -> 202608_1_81_16 | ||
| 5044 | 2026.08.18 00:02:13.719534 [ 424470 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 5045 | 2026.08.18 00:02:14.000259 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 533.40 MiB, peak 561.08 MiB, free memory in arenas 61.13 MiB, will set to 530.70 MiB (RSS), difference: -2.70 MiB | ||
| 5046 | 2026.08.18 00:02:14.715765 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 609 | ||
| 5047 | 2026.08.18 00:02:14.724111 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5048 | 2026.08.18 00:02:14.724126 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5049 | 2026.08.18 00:02:14.727545 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_81_81_0 (state Temporary) | ||
| 5050 | 2026.08.18 00:02:14.730121 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_81_81_0 to 202608_81_81_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5051 | 2026.08.18 00:02:14.730296 [ 424333 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_76_15 to 202608_81_81_0 | ||
| 5052 | 2026.08.18 00:02:14.730315 [ 424333 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5053 | 2026.08.18 00:02:14.730320 [ 424333 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5054 | 2026.08.18 00:02:14.730397 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_76_15 to 202608_81_81_0 into Compact with storage Full | ||
| 5055 | 2026.08.18 00:02:14.731348 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 609 | ||
| 5056 | 2026.08.18 00:02:14.734246 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5057 | 2026.08.18 00:02:14.734637 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_76_15, total 572 rows starting from the beginning of the part | ||
| 5058 | 2026.08.18 00:02:14.736529 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_77_77_0, total 7 rows starting from the beginning of the part | ||
| 5059 | 2026.08.18 00:02:14.738398 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_78_78_0, total 8 rows starting from the beginning of the part | ||
| 5060 | 2026.08.18 00:02:14.740318 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_79_79_0, total 7 rows starting from the beginning of the part | ||
| 5061 | 2026.08.18 00:02:14.742161 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_80_80_0, total 8 rows starting from the beginning of the part | ||
| 5062 | 2026.08.18 00:02:14.744001 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_81_81_0, total 7 rows starting from the beginning of the part | ||
| 5063 | 2026.08.18 00:02:14.772821 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 609 rows, containing 679 columns (679 merged, 0 gathered) in 0.0424565 sec., 14344.093366151237 rows/sec., 8.46 MiB/sec. | ||
| 5064 | 2026.08.18 00:02:14.773771 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Trace> MergedBlockOutputStream: filled checksums 202608_1_81_16 (state Temporary) | ||
| 5065 | 2026.08.18 00:02:14.777241 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_81_16 to 202608_1_81_16 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5066 | 2026.08.18 00:02:14.777277 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_81_16} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_76_15, 202608_81_81_0] -> 202608_1_81_16 | ||
| 5067 | 2026.08.18 00:02:14.777737 [ 424485 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 5068 | 2026.08.18 00:02:15.000258 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 532.16 MiB, peak 561.08 MiB, free memory in arenas 84.09 MiB, will set to 540.99 MiB (RSS), difference: 8.83 MiB | ||
| 5069 | 2026.08.18 00:02:21.011283 [ 424312 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5070 | 2026.08.18 00:02:21.011308 [ 424312 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5071 | 2026.08.18 00:02:21.205629 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 195306 | ||
| 5072 | 2026.08.18 00:02:21.206804 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5073 | 2026.08.18 00:02:21.206818 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5074 | 2026.08.18 00:02:21.207339 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_82_82_0 (state Temporary) | ||
| 5075 | 2026.08.18 00:02:21.207481 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_82_82_0 to 202608_82_82_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5076 | 2026.08.18 00:02:21.207560 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 195306 | ||
| 5077 | 2026.08.18 00:02:22.231423 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 617 | ||
| 5078 | 2026.08.18 00:02:22.238482 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5079 | 2026.08.18 00:02:22.238495 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5080 | 2026.08.18 00:02:22.241894 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_82_82_0 (state Temporary) | ||
| 5081 | 2026.08.18 00:02:22.244330 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_82_82_0 to 202608_82_82_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5082 | 2026.08.18 00:02:22.245154 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 617 | ||
| 5083 | 2026.08.18 00:02:22.520888 [ 424404 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345499136, merge_with_ttl_allowedtrue) | ||
| 5084 | 2026.08.18 00:02:22.520909 [ 424404 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 5085 | 2026.08.18 00:02:25.679732 [ 424399 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345384448, merge_with_ttl_allowedtrue) | ||
| 5086 | 2026.08.18 00:02:25.679757 [ 424399 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 5087 | 2026.08.18 00:02:28.707641 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 197560 | ||
| 5088 | 2026.08.18 00:02:28.708676 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5089 | 2026.08.18 00:02:28.708689 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5090 | 2026.08.18 00:02:28.709098 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_83_83_0 (state Temporary) | ||
| 5091 | 2026.08.18 00:02:28.709241 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_83_83_0 to 202608_83_83_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5092 | 2026.08.18 00:02:28.709316 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 197560 | ||
| 5093 | 2026.08.18 00:02:29.745314 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 624 | ||
| 5094 | 2026.08.18 00:02:29.752918 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5095 | 2026.08.18 00:02:29.752931 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5096 | 2026.08.18 00:02:29.756334 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_83_83_0 (state Temporary) | ||
| 5097 | 2026.08.18 00:02:29.758726 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_83_83_0 to 202608_83_83_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5098 | 2026.08.18 00:02:29.759521 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 624 | ||
| 5099 | 2026.08.18 00:02:35.069886 [ 424409 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345021952, merge_with_ttl_allowedtrue) | ||
| 5100 | 2026.08.18 00:02:35.069899 [ 424409 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 5101 | 2026.08.18 00:02:36.011410 [ 424317 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5102 | 2026.08.18 00:02:36.011441 [ 424317 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5103 | 2026.08.18 00:02:36.209495 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 200136 | ||
| 5104 | 2026.08.18 00:02:36.210754 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5105 | 2026.08.18 00:02:36.210767 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5106 | 2026.08.18 00:02:36.211274 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_84_84_0 (state Temporary) | ||
| 5107 | 2026.08.18 00:02:36.211405 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_84_84_0 to 202608_84_84_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5108 | 2026.08.18 00:02:36.211482 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 200136 | ||
| 5109 | 2026.08.18 00:02:37.259595 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 632 | ||
| 5110 | 2026.08.18 00:02:37.267973 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5111 | 2026.08.18 00:02:37.267987 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5112 | 2026.08.18 00:02:37.271398 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_84_84_0 (state Temporary) | ||
| 5113 | 2026.08.18 00:02:37.274011 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_84_84_0 to 202608_84_84_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5114 | 2026.08.18 00:02:37.274826 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 632 | ||
| 5115 | 2026.08.18 00:02:38.720793 [ 424411 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 5116 | 2026.08.18 00:02:43.711657 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 202390 | ||
| 5117 | 2026.08.18 00:02:43.712757 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5118 | 2026.08.18 00:02:43.712769 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5119 | 2026.08.18 00:02:43.713210 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_85_85_0 (state Temporary) | ||
| 5120 | 2026.08.18 00:02:43.713328 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_85_85_0 to 202608_85_85_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5121 | 2026.08.18 00:02:43.713402 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 202390 | ||
| 5122 | 2026.08.18 00:02:43.713441 [ 424555 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_16_3, 202608_17_17_0, 202608_18_18_0, 202608_19_19_0, 202608_20_20_0, 202608_21_21_0] | ||
| 5123 | 2026.08.18 00:02:43.713450 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_16_3, 202608_17_17_0, 202608_18_18_0, 202608_19_19_0, 202608_20_20_0, 202608_21_21_0] | ||
| 5124 | 2026.08.18 00:02:43.714107 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_16_3, 202608_17_17_0, 202608_18_18_0, 202608_19_19_0, 202608_20_20_0, 202608_21_21_0] | ||
| 5125 | 2026.08.18 00:02:43.722394 [ 424720 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_16_3, 202608_17_17_0, 202608_18_18_0, 202608_19_19_0, 202608_20_20_0, 202608_21_21_0] | ||
| 5126 | 2026.08.18 00:02:43.722406 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_16_3, 202608_17_17_0, 202608_18_18_0, 202608_19_19_0, 202608_20_20_0, 202608_21_21_0] | ||
| 5127 | 2026.08.18 00:02:43.723229 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_16_3, 202608_17_17_0, 202608_18_18_0, 202608_19_19_0, 202608_20_20_0, 202608_21_21_0] | ||
| 5128 | 2026.08.18 00:02:44.000282 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 540.09 MiB, peak 561.08 MiB, free memory in arenas 78.78 MiB, will set to 537.62 MiB (RSS), difference: -2.47 MiB | ||
| 5129 | 2026.08.18 00:02:44.774992 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 639 | ||
| 5130 | 2026.08.18 00:02:44.783686 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5131 | 2026.08.18 00:02:44.783701 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5132 | 2026.08.18 00:02:44.787114 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_85_85_0 (state Temporary) | ||
| 5133 | 2026.08.18 00:02:44.789780 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_85_85_0 to 202608_85_85_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5134 | 2026.08.18 00:02:44.790592 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 639 | ||
| 5135 | 2026.08.18 00:02:45.000263 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 538.33 MiB, peak 561.08 MiB, free memory in arenas 88.19 MiB, will set to 540.81 MiB (RSS), difference: 2.48 MiB | ||
| 5136 | 2026.08.18 00:02:49.000287 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 540.81 MiB, peak 561.08 MiB, free memory in arenas 77.08 MiB, will set to 539.80 MiB (RSS), difference: -1.00 MiB | ||
| 5137 | 2026.08.18 00:02:51.011527 [ 424367 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5138 | 2026.08.18 00:02:51.011549 [ 424367 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5139 | 2026.08.18 00:02:51.213582 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 204966 | ||
| 5140 | 2026.08.18 00:02:51.214823 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5141 | 2026.08.18 00:02:51.214836 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5142 | 2026.08.18 00:02:51.215347 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_86_86_0 (state Temporary) | ||
| 5143 | 2026.08.18 00:02:51.215479 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_86_86_0 to 202608_86_86_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5144 | 2026.08.18 00:02:51.215569 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 204966 | ||
| 5145 | 2026.08.18 00:02:51.215578 [ 424351 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_81_16 to 202608_86_86_0 | ||
| 5146 | 2026.08.18 00:02:51.215604 [ 424351 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5147 | 2026.08.18 00:02:51.215611 [ 424351 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5148 | 2026.08.18 00:02:51.215723 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_81_16 to 202608_86_86_0 into Compact with storage Full | ||
| 5149 | 2026.08.18 00:02:51.215780 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5150 | 2026.08.18 00:02:51.215800 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 25 marks from part 202608_1_81_16, total 192730 rows starting from the beginning of the part | ||
| 5151 | 2026.08.18 00:02:51.215840 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_82_82_0, total 2576 rows starting from the beginning of the part | ||
| 5152 | 2026.08.18 00:02:51.215862 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_83_83_0, total 2254 rows starting from the beginning of the part | ||
| 5153 | 2026.08.18 00:02:51.215878 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_84_84_0, total 2576 rows starting from the beginning of the part | ||
| 5154 | 2026.08.18 00:02:51.215895 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_85_85_0, total 2254 rows starting from the beginning of the part | ||
| 5155 | 2026.08.18 00:02:51.215918 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_86_86_0, total 2576 rows starting from the beginning of the part | ||
| 5156 | 2026.08.18 00:02:51.229742 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 204966 rows, containing 4 columns (4 merged, 0 gathered) in 0.01406697 sec., 14570728.451116338 rows/sec., 209.27 MiB/sec. | ||
| 5157 | 2026.08.18 00:02:51.229861 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Trace> MergedBlockOutputStream: filled checksums 202608_1_86_17 (state Temporary) | ||
| 5158 | 2026.08.18 00:02:51.229988 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_86_17 to 202608_1_86_17 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5159 | 2026.08.18 00:02:51.230011 [ 424496 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_86_17} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_81_16, 202608_86_86_0] -> 202608_1_86_17 | ||
| 5160 | 2026.08.18 00:02:51.230053 [ 424496 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 5161 | 2026.08.18 00:02:52.000259 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 539.79 MiB, peak 561.08 MiB, free memory in arenas 96.95 MiB, will set to 536.30 MiB (RSS), difference: -3.49 MiB | ||
| 5162 | 2026.08.18 00:02:52.290768 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 647 | ||
| 5163 | 2026.08.18 00:02:52.297915 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5164 | 2026.08.18 00:02:52.297930 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5165 | 2026.08.18 00:02:52.301254 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_86_86_0 (state Temporary) | ||
| 5166 | 2026.08.18 00:02:52.303822 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_86_86_0 to 202608_86_86_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5167 | 2026.08.18 00:02:52.303993 [ 424393 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_81_16 to 202608_86_86_0 | ||
| 5168 | 2026.08.18 00:02:52.304008 [ 424393 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5169 | 2026.08.18 00:02:52.304013 [ 424393 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5170 | 2026.08.18 00:02:52.304095 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_81_16 to 202608_86_86_0 into Compact with storage Full | ||
| 5171 | 2026.08.18 00:02:52.304673 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 647 | ||
| 5172 | 2026.08.18 00:02:52.307609 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5173 | 2026.08.18 00:02:52.307984 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_81_16, total 609 rows starting from the beginning of the part | ||
| 5174 | 2026.08.18 00:02:52.309871 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_82_82_0, total 8 rows starting from the beginning of the part | ||
| 5175 | 2026.08.18 00:02:52.311766 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_83_83_0, total 7 rows starting from the beginning of the part | ||
| 5176 | 2026.08.18 00:02:52.313640 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_84_84_0, total 8 rows starting from the beginning of the part | ||
| 5177 | 2026.08.18 00:02:52.315507 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_85_85_0, total 7 rows starting from the beginning of the part | ||
| 5178 | 2026.08.18 00:02:52.317358 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_86_86_0, total 8 rows starting from the beginning of the part | ||
| 5179 | 2026.08.18 00:02:52.346376 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 647 rows, containing 679 columns (679 merged, 0 gathered) in 0.04231494 sec., 15290.107938236471 rows/sec., 8.94 MiB/sec. | ||
| 5180 | 2026.08.18 00:02:52.347348 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Trace> MergedBlockOutputStream: filled checksums 202608_1_86_17 (state Temporary) | ||
| 5181 | 2026.08.18 00:02:52.350755 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_86_17 to 202608_1_86_17 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5182 | 2026.08.18 00:02:52.350794 [ 424475 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_86_17} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_81_16, 202608_86_86_0] -> 202608_1_86_17 | ||
| 5183 | 2026.08.18 00:02:52.351255 [ 424475 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 5184 | 2026.08.18 00:02:53.000290 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 537.77 MiB, peak 561.08 MiB, free memory in arenas 106.86 MiB, will set to 551.74 MiB (RSS), difference: 13.98 MiB | ||
| 5185 | 2026.08.18 00:02:54.495540 [ 424343 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301894ms, ratio: 0, points per minute: 0) | ||
| 5186 | 2026.08.18 00:02:56.967284 [ 424352 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301621ms, ratio: 0, points per minute: 0) | ||
| 5187 | 2026.08.18 00:02:58.715660 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 207220 | ||
| 5188 | 2026.08.18 00:02:58.716661 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5189 | 2026.08.18 00:02:58.716672 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5190 | 2026.08.18 00:02:58.717208 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_87_87_0 (state Temporary) | ||
| 5191 | 2026.08.18 00:02:58.717337 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_87_87_0 to 202608_87_87_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5192 | 2026.08.18 00:02:58.717412 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 207220 | ||
| 5193 | 2026.08.18 00:02:59.804770 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 654 | ||
| 5194 | 2026.08.18 00:02:59.815534 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5195 | 2026.08.18 00:02:59.815553 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5196 | 2026.08.18 00:02:59.819729 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_87_87_0 (state Temporary) | ||
| 5197 | 2026.08.18 00:02:59.822680 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_87_87_0 to 202608_87_87_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5198 | 2026.08.18 00:02:59.823544 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 654 | ||
| 5199 | 2026.08.18 00:03:01.658141 [ 424410 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Found 5 old parts to remove. Parts: [all_0_0_0, all_1_1_0, all_2_2_0, all_3_3_0, all_4_4_0] | ||
| 5200 | 2026.08.18 00:03:01.658152 [ 424410 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Removing 5 old parts from ZooKeeper | ||
| 5201 | 2026.08.18 00:03:01.675627 [ 424410 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Removed 5 old parts from ZooKeeper. Removing them from filesystem. | ||
| 5202 | 2026.08.18 00:03:01.675635 [ 424410 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Removing 5 parts from filesystem (serially): Parts: [all_0_0_0, all_1_1_0, all_2_2_0, all_3_3_0, all_4_4_0] | ||
| 5203 | 2026.08.18 00:03:01.676141 [ 424410 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Removing 5 parts from memory: Parts: [all_0_0_0, all_1_1_0, all_2_2_0, all_3_3_0, all_4_4_0] | ||
| 5204 | 2026.08.18 00:03:01.676146 [ 424410 ] {} <Debug> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Removed 5 old parts | ||
| 5205 | 2026.08.18 00:03:01.676469 [ 424410 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 1.2820513, interval: 308613ms, ratio: 0.008547009, points per minute: 0.24925417) | ||
| 5206 | 2026.08.18 00:03:02.114397 [ 424316 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 308659ms, ratio: 0, points per minute: 0) | ||
| 5207 | 2026.08.18 00:03:03.277204 [ 424335 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Found 5 old parts to remove. Parts: [all_0_0_0, all_1_1_0, all_2_2_0, all_3_3_0, all_4_4_0] | ||
| 5208 | 2026.08.18 00:03:03.277212 [ 424335 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Removing 5 old parts from ZooKeeper | ||
| 5209 | 2026.08.18 00:03:03.284704 [ 424335 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Removed 5 old parts from ZooKeeper. Removing them from filesystem. | ||
| 5210 | 2026.08.18 00:03:03.284709 [ 424335 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Removing 5 parts from filesystem (serially): Parts: [all_0_0_0, all_1_1_0, all_2_2_0, all_3_3_0, all_4_4_0] | ||
| 5211 | 2026.08.18 00:03:03.285219 [ 424335 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Removing 5 parts from memory: Parts: [all_0_0_0, all_1_1_0, all_2_2_0, all_3_3_0, all_4_4_0] | ||
| 5212 | 2026.08.18 00:03:03.285223 [ 424335 ] {} <Debug> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Removed 5 old parts | ||
| 5213 | 2026.08.18 00:03:03.285528 [ 424335 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 1.2820513, interval: 309165ms, ratio: 0.008547009, points per minute: 0.24880916) | ||
| 5214 | 2026.08.18 00:03:06.011643 [ 424329 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5215 | 2026.08.18 00:03:06.011661 [ 424329 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5216 | 2026.08.18 00:03:06.217614 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 209796 | ||
| 5217 | 2026.08.18 00:03:06.218858 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5218 | 2026.08.18 00:03:06.218872 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5219 | 2026.08.18 00:03:06.219365 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_88_88_0 (state Temporary) | ||
| 5220 | 2026.08.18 00:03:06.219492 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_88_88_0 to 202608_88_88_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5221 | 2026.08.18 00:03:06.219567 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 209796 | ||
| 5222 | 2026.08.18 00:03:07.323708 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 662 | ||
| 5223 | 2026.08.18 00:03:07.331354 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5224 | 2026.08.18 00:03:07.331369 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5225 | 2026.08.18 00:03:07.334755 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_88_88_0 (state Temporary) | ||
| 5226 | 2026.08.18 00:03:07.337380 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_88_88_0 to 202608_88_88_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5227 | 2026.08.18 00:03:07.338184 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 662 | ||
| 5228 | 2026.08.18 00:03:10.112236 [ 424341 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345292288, merge_with_ttl_allowedtrue) | ||
| 5229 | 2026.08.18 00:03:10.112251 [ 424341 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 5230 | 2026.08.18 00:03:13.719819 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 212050 | ||
| 5231 | 2026.08.18 00:03:13.720758 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5232 | 2026.08.18 00:03:13.720770 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5233 | 2026.08.18 00:03:13.721206 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_89_89_0 (state Temporary) | ||
| 5234 | 2026.08.18 00:03:13.721329 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_89_89_0 to 202608_89_89_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5235 | 2026.08.18 00:03:13.721395 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 212050 | ||
| 5236 | 2026.08.18 00:03:14.838330 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 669 | ||
| 5237 | 2026.08.18 00:03:14.846103 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5238 | 2026.08.18 00:03:14.846118 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5239 | 2026.08.18 00:03:14.849503 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_89_89_0 (state Temporary) | ||
| 5240 | 2026.08.18 00:03:14.852114 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_89_89_0 to 202608_89_89_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5241 | 2026.08.18 00:03:14.852928 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 669 | ||
| 5242 | 2026.08.18 00:03:16.000306 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 553.85 MiB, peak 561.84 MiB, free memory in arenas 95.04 MiB, will set to 552.35 MiB (RSS), difference: -1.50 MiB | ||
| 5243 | 2026.08.18 00:03:21.011757 [ 424390 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5244 | 2026.08.18 00:03:21.011784 [ 424390 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5245 | 2026.08.18 00:03:21.080584 [ 424552 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_21_4, 202608_22_22_0, 202608_23_23_0, 202608_24_24_0, 202608_25_25_0, 202608_26_26_0] | ||
| 5246 | 2026.08.18 00:03:21.080594 [ 424552 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_21_4, 202608_22_22_0, 202608_23_23_0, 202608_24_24_0, 202608_25_25_0, 202608_26_26_0] | ||
| 5247 | 2026.08.18 00:03:21.081269 [ 424552 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_21_4, 202608_22_22_0, 202608_23_23_0, 202608_24_24_0, 202608_25_25_0, 202608_26_26_0] | ||
| 5248 | 2026.08.18 00:03:21.221652 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 214626 | ||
| 5249 | 2026.08.18 00:03:21.222701 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5250 | 2026.08.18 00:03:21.222717 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5251 | 2026.08.18 00:03:21.223182 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_90_90_0 (state Temporary) | ||
| 5252 | 2026.08.18 00:03:21.223327 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_90_90_0 to 202608_90_90_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5253 | 2026.08.18 00:03:21.223395 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 214626 | ||
| 5254 | 2026.08.18 00:03:22.353089 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 677 | ||
| 5255 | 2026.08.18 00:03:22.360708 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5256 | 2026.08.18 00:03:22.360722 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5257 | 2026.08.18 00:03:22.364129 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_90_90_0 (state Temporary) | ||
| 5258 | 2026.08.18 00:03:22.366749 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_90_90_0 to 202608_90_90_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5259 | 2026.08.18 00:03:22.366963 [ 424561 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_21_4, 202608_22_22_0, 202608_23_23_0, 202608_24_24_0, 202608_25_25_0, 202608_26_26_0] | ||
| 5260 | 2026.08.18 00:03:22.366971 [ 424561 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_21_4, 202608_22_22_0, 202608_23_23_0, 202608_24_24_0, 202608_25_25_0, 202608_26_26_0] | ||
| 5261 | 2026.08.18 00:03:22.367563 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 677 | ||
| 5262 | 2026.08.18 00:03:22.367780 [ 424561 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_21_4, 202608_22_22_0, 202608_23_23_0, 202608_24_24_0, 202608_25_25_0, 202608_26_26_0] | ||
| 5263 | 2026.08.18 00:03:22.521101 [ 424388 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73347184640, merge_with_ttl_allowedtrue) | ||
| 5264 | 2026.08.18 00:03:22.521113 [ 424388 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 5265 | 2026.08.18 00:03:23.000255 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 548.86 MiB, peak 561.84 MiB, free memory in arenas 94.02 MiB, will set to 535.85 MiB (RSS), difference: -13.01 MiB | ||
| 5266 | 2026.08.18 00:03:25.679970 [ 424400 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73347557376, merge_with_ttl_allowedtrue) | ||
| 5267 | 2026.08.18 00:03:25.679994 [ 424400 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 5268 | 2026.08.18 00:03:28.723487 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 216880 | ||
| 5269 | 2026.08.18 00:03:28.724532 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5270 | 2026.08.18 00:03:28.724545 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5271 | 2026.08.18 00:03:28.724966 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_91_91_0 (state Temporary) | ||
| 5272 | 2026.08.18 00:03:28.725080 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_91_91_0 to 202608_91_91_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5273 | 2026.08.18 00:03:28.725149 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 216880 | ||
| 5274 | 2026.08.18 00:03:28.725155 [ 424385 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_86_17 to 202608_91_91_0 | ||
| 5275 | 2026.08.18 00:03:28.725174 [ 424385 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5276 | 2026.08.18 00:03:28.725178 [ 424385 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5277 | 2026.08.18 00:03:28.725268 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_86_17 to 202608_91_91_0 into Compact with storage Full | ||
| 5278 | 2026.08.18 00:03:28.725325 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5279 | 2026.08.18 00:03:28.725339 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 27 marks from part 202608_1_86_17, total 204966 rows starting from the beginning of the part | ||
| 5280 | 2026.08.18 00:03:28.725380 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_87_87_0, total 2254 rows starting from the beginning of the part | ||
| 5281 | 2026.08.18 00:03:28.725401 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_88_88_0, total 2576 rows starting from the beginning of the part | ||
| 5282 | 2026.08.18 00:03:28.725419 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_89_89_0, total 2254 rows starting from the beginning of the part | ||
| 5283 | 2026.08.18 00:03:28.725434 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_90_90_0, total 2576 rows starting from the beginning of the part | ||
| 5284 | 2026.08.18 00:03:28.725449 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_91_91_0, total 2254 rows starting from the beginning of the part | ||
| 5285 | 2026.08.18 00:03:28.739268 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 216880 rows, containing 4 columns (4 merged, 0 gathered) in 0.01404144 sec., 15445709.2719835 rows/sec., 221.76 MiB/sec. | ||
| 5286 | 2026.08.18 00:03:28.739437 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Trace> MergedBlockOutputStream: filled checksums 202608_1_91_18 (state Temporary) | ||
| 5287 | 2026.08.18 00:03:28.739566 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_91_18 to 202608_1_91_18 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5288 | 2026.08.18 00:03:28.739589 [ 424495 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_91_18} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_86_17, 202608_91_91_0] -> 202608_1_91_18 | ||
| 5289 | 2026.08.18 00:03:28.739628 [ 424495 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 5290 | 2026.08.18 00:03:29.000272 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 535.87 MiB, peak 561.84 MiB, free memory in arenas 107.20 MiB, will set to 539.05 MiB (RSS), difference: 3.19 MiB | ||
| 5291 | 2026.08.18 00:03:29.867727 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 684 | ||
| 5292 | 2026.08.18 00:03:29.875326 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5293 | 2026.08.18 00:03:29.875339 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5294 | 2026.08.18 00:03:29.878668 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_91_91_0 (state Temporary) | ||
| 5295 | 2026.08.18 00:03:29.881229 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_91_91_0 to 202608_91_91_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5296 | 2026.08.18 00:03:29.881395 [ 424344 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_86_17 to 202608_91_91_0 | ||
| 5297 | 2026.08.18 00:03:29.881421 [ 424344 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5298 | 2026.08.18 00:03:29.881427 [ 424344 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5299 | 2026.08.18 00:03:29.881507 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_86_17 to 202608_91_91_0 into Compact with storage Full | ||
| 5300 | 2026.08.18 00:03:29.882031 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 684 | ||
| 5301 | 2026.08.18 00:03:29.884471 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5302 | 2026.08.18 00:03:29.884798 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_86_17, total 647 rows starting from the beginning of the part | ||
| 5303 | 2026.08.18 00:03:29.886665 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_87_87_0, total 7 rows starting from the beginning of the part | ||
| 5304 | 2026.08.18 00:03:29.888526 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_88_88_0, total 8 rows starting from the beginning of the part | ||
| 5305 | 2026.08.18 00:03:29.890435 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_89_89_0, total 7 rows starting from the beginning of the part | ||
| 5306 | 2026.08.18 00:03:29.892311 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_90_90_0, total 8 rows starting from the beginning of the part | ||
| 5307 | 2026.08.18 00:03:29.894148 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_91_91_0, total 7 rows starting from the beginning of the part | ||
| 5308 | 2026.08.18 00:03:29.923036 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 684 rows, containing 679 columns (679 merged, 0 gathered) in 0.04155753 sec., 16459.111020313285 rows/sec., 9.54 MiB/sec. | ||
| 5309 | 2026.08.18 00:03:29.924001 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Trace> MergedBlockOutputStream: filled checksums 202608_1_91_18 (state Temporary) | ||
| 5310 | 2026.08.18 00:03:29.927373 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_91_18 to 202608_1_91_18 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5311 | 2026.08.18 00:03:29.927414 [ 424472 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_91_18} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_86_17, 202608_91_91_0] -> 202608_1_91_18 | ||
| 5312 | 2026.08.18 00:03:29.927872 [ 424472 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.66 MiB. | ||
| 5313 | 2026.08.18 00:03:30.000189 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 540.54 MiB, peak 561.84 MiB, free memory in arenas 116.55 MiB, will set to 553.97 MiB (RSS), difference: 13.43 MiB | ||
| 5314 | 2026.08.18 00:03:35.070093 [ 424372 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73347493888, merge_with_ttl_allowedtrue) | ||
| 5315 | 2026.08.18 00:03:35.070113 [ 424372 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 5316 | 2026.08.18 00:03:36.011868 [ 424374 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5317 | 2026.08.18 00:03:36.011891 [ 424374 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5318 | 2026.08.18 00:03:36.225330 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 219456 | ||
| 5319 | 2026.08.18 00:03:36.226477 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5320 | 2026.08.18 00:03:36.226489 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5321 | 2026.08.18 00:03:36.226873 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_92_92_0 (state Temporary) | ||
| 5322 | 2026.08.18 00:03:36.227007 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_92_92_0 to 202608_92_92_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5323 | 2026.08.18 00:03:36.227096 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 219456 | ||
| 5324 | 2026.08.18 00:03:37.382192 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 692 | ||
| 5325 | 2026.08.18 00:03:37.389474 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5326 | 2026.08.18 00:03:37.389489 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5327 | 2026.08.18 00:03:37.392821 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_92_92_0 (state Temporary) | ||
| 5328 | 2026.08.18 00:03:37.395396 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_92_92_0 to 202608_92_92_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5329 | 2026.08.18 00:03:37.396190 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 692 | ||
| 5330 | 2026.08.18 00:03:38.720998 [ 424307 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 5331 | 2026.08.18 00:03:43.727262 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 221710 | ||
| 5332 | 2026.08.18 00:03:43.728683 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5333 | 2026.08.18 00:03:43.728695 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5334 | 2026.08.18 00:03:43.729156 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_93_93_0 (state Temporary) | ||
| 5335 | 2026.08.18 00:03:43.729279 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_93_93_0 to 202608_93_93_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5336 | 2026.08.18 00:03:43.729351 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 221710 | ||
| 5337 | 2026.08.18 00:03:44.896262 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 699 | ||
| 5338 | 2026.08.18 00:03:44.903559 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5339 | 2026.08.18 00:03:44.903577 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5340 | 2026.08.18 00:03:44.906953 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_93_93_0 (state Temporary) | ||
| 5341 | 2026.08.18 00:03:44.909530 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_93_93_0 to 202608_93_93_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5342 | 2026.08.18 00:03:44.910338 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 699 | ||
| 5343 | 2026.08.18 00:03:45.000251 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 556.03 MiB, peak 564.06 MiB, free memory in arenas 111.37 MiB, will set to 554.09 MiB (RSS), difference: -1.94 MiB | ||
| 5344 | 2026.08.18 00:03:51.012063 [ 424375 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5345 | 2026.08.18 00:03:51.012085 [ 424375 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5346 | 2026.08.18 00:03:51.229441 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 224286 | ||
| 5347 | 2026.08.18 00:03:51.231593 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5348 | 2026.08.18 00:03:51.231606 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5349 | 2026.08.18 00:03:51.231947 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_94_94_0 (state Temporary) | ||
| 5350 | 2026.08.18 00:03:51.232066 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_94_94_0 to 202608_94_94_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5351 | 2026.08.18 00:03:51.232134 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 224286 | ||
| 5352 | 2026.08.18 00:03:52.000167 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 554.10 MiB, peak 564.06 MiB, free memory in arenas 96.88 MiB, will set to 552.54 MiB (RSS), difference: -1.56 MiB | ||
| 5353 | 2026.08.18 00:03:52.410515 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 707 | ||
| 5354 | 2026.08.18 00:03:52.417619 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5355 | 2026.08.18 00:03:52.417633 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5356 | 2026.08.18 00:03:52.421005 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_94_94_0 (state Temporary) | ||
| 5357 | 2026.08.18 00:03:52.423532 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_94_94_0 to 202608_94_94_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5358 | 2026.08.18 00:03:52.424327 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 707 | ||
| 5359 | 2026.08.18 00:03:58.000182 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 558.08 MiB, peak 564.06 MiB, free memory in arenas 96.80 MiB, will set to 554.08 MiB (RSS), difference: -4.00 MiB | ||
| 5360 | 2026.08.18 00:03:58.733331 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 226540 | ||
| 5361 | 2026.08.18 00:03:58.734319 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5362 | 2026.08.18 00:03:58.734332 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5363 | 2026.08.18 00:03:58.734772 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_95_95_0 (state Temporary) | ||
| 5364 | 2026.08.18 00:03:58.734898 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_95_95_0 to 202608_95_95_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5365 | 2026.08.18 00:03:58.734979 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 226540 | ||
| 5366 | 2026.08.18 00:03:58.735033 [ 424720 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_26_5, 202608_27_27_0, 202608_28_28_0, 202608_29_29_0, 202608_30_30_0, 202608_31_31_0] | ||
| 5367 | 2026.08.18 00:03:58.735044 [ 424720 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_26_5, 202608_27_27_0, 202608_28_28_0, 202608_29_29_0, 202608_30_30_0, 202608_31_31_0] | ||
| 5368 | 2026.08.18 00:03:58.735742 [ 424720 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_26_5, 202608_27_27_0, 202608_28_28_0, 202608_29_29_0, 202608_30_30_0, 202608_31_31_0] | ||
| 5369 | 2026.08.18 00:03:59.000262 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 554.08 MiB, peak 564.06 MiB, free memory in arenas 96.79 MiB, will set to 537.66 MiB (RSS), difference: -16.42 MiB | ||
| 5370 | 2026.08.18 00:03:59.137835 [ 424552 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_26_5, 202608_27_27_0, 202608_28_28_0, 202608_29_29_0, 202608_30_30_0, 202608_31_31_0] | ||
| 5371 | 2026.08.18 00:03:59.137844 [ 424552 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_26_5, 202608_27_27_0, 202608_28_28_0, 202608_29_29_0, 202608_30_30_0, 202608_31_31_0] | ||
| 5372 | 2026.08.18 00:03:59.138584 [ 424552 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_26_5, 202608_27_27_0, 202608_28_28_0, 202608_29_29_0, 202608_30_30_0, 202608_31_31_0] | ||
| 5373 | 2026.08.18 00:03:59.924496 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 714 | ||
| 5374 | 2026.08.18 00:03:59.931140 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5375 | 2026.08.18 00:03:59.931153 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5376 | 2026.08.18 00:03:59.934430 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_95_95_0 (state Temporary) | ||
| 5377 | 2026.08.18 00:03:59.936899 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_95_95_0 to 202608_95_95_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5378 | 2026.08.18 00:03:59.937687 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 714 | ||
| 5379 | 2026.08.18 00:04:00.000258 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 534.37 MiB, peak 564.06 MiB, free memory in arenas 82.82 MiB, will set to 535.91 MiB (RSS), difference: 1.54 MiB | ||
| 5380 | 2026.08.18 00:04:06.012270 [ 424402 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5381 | 2026.08.18 00:04:06.012304 [ 424402 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5382 | 2026.08.18 00:04:06.235159 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 229116 | ||
| 5383 | 2026.08.18 00:04:06.236222 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5384 | 2026.08.18 00:04:06.236232 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5385 | 2026.08.18 00:04:06.236797 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_96_96_0 (state Temporary) | ||
| 5386 | 2026.08.18 00:04:06.236946 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_96_96_0 to 202608_96_96_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5387 | 2026.08.18 00:04:06.237020 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 229116 | ||
| 5388 | 2026.08.18 00:04:06.237032 [ 424344 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_91_18 to 202608_96_96_0 | ||
| 5389 | 2026.08.18 00:04:06.237060 [ 424344 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5390 | 2026.08.18 00:04:06.237072 [ 424344 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5391 | 2026.08.18 00:04:06.237170 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_91_18 to 202608_96_96_0 into Compact with storage Full | ||
| 5392 | 2026.08.18 00:04:06.237228 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5393 | 2026.08.18 00:04:06.237243 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 28 marks from part 202608_1_91_18, total 216880 rows starting from the beginning of the part | ||
| 5394 | 2026.08.18 00:04:06.237287 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_92_92_0, total 2576 rows starting from the beginning of the part | ||
| 5395 | 2026.08.18 00:04:06.237314 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_93_93_0, total 2254 rows starting from the beginning of the part | ||
| 5396 | 2026.08.18 00:04:06.237331 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_94_94_0, total 2576 rows starting from the beginning of the part | ||
| 5397 | 2026.08.18 00:04:06.237349 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_95_95_0, total 2254 rows starting from the beginning of the part | ||
| 5398 | 2026.08.18 00:04:06.237370 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_96_96_0, total 2576 rows starting from the beginning of the part | ||
| 5399 | 2026.08.18 00:04:06.251923 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 229116 rows, containing 4 columns (4 merged, 0 gathered) in 0.014798111 sec., 15482786.958416518 rows/sec., 222.27 MiB/sec. | ||
| 5400 | 2026.08.18 00:04:06.252122 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Trace> MergedBlockOutputStream: filled checksums 202608_1_96_19 (state Temporary) | ||
| 5401 | 2026.08.18 00:04:06.252249 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_96_19 to 202608_1_96_19 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5402 | 2026.08.18 00:04:06.252271 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_96_19} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_91_18, 202608_96_96_0] -> 202608_1_96_19 | ||
| 5403 | 2026.08.18 00:04:06.252311 [ 424483 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 5404 | 2026.08.18 00:04:07.000283 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 535.95 MiB, peak 564.06 MiB, free memory in arenas 106.82 MiB, will set to 539.79 MiB (RSS), difference: 3.85 MiB | ||
| 5405 | 2026.08.18 00:04:07.000587 [ 425081 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 8.2331e-05 sec. | ||
| 5406 | 2026.08.18 00:04:07.437761 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 722 | ||
| 5407 | 2026.08.18 00:04:07.444724 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5408 | 2026.08.18 00:04:07.444739 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5409 | 2026.08.18 00:04:07.448175 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_96_96_0 (state Temporary) | ||
| 5410 | 2026.08.18 00:04:07.450610 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_96_96_0 to 202608_96_96_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5411 | 2026.08.18 00:04:07.450779 [ 424352 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_91_18 to 202608_96_96_0 | ||
| 5412 | 2026.08.18 00:04:07.450794 [ 424352 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5413 | 2026.08.18 00:04:07.450798 [ 424352 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5414 | 2026.08.18 00:04:07.450871 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_91_18 to 202608_96_96_0 into Compact with storage Full | ||
| 5415 | 2026.08.18 00:04:07.451524 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 722 | ||
| 5416 | 2026.08.18 00:04:07.454640 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5417 | 2026.08.18 00:04:07.454979 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_91_18, total 684 rows starting from the beginning of the part | ||
| 5418 | 2026.08.18 00:04:07.456763 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_92_92_0, total 8 rows starting from the beginning of the part | ||
| 5419 | 2026.08.18 00:04:07.458547 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_93_93_0, total 7 rows starting from the beginning of the part | ||
| 5420 | 2026.08.18 00:04:07.460319 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_94_94_0, total 8 rows starting from the beginning of the part | ||
| 5421 | 2026.08.18 00:04:07.462022 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_95_95_0, total 7 rows starting from the beginning of the part | ||
| 5422 | 2026.08.18 00:04:07.463720 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_96_96_0, total 8 rows starting from the beginning of the part | ||
| 5423 | 2026.08.18 00:04:07.491238 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 722 rows, containing 679 columns (679 merged, 0 gathered) in 0.040393948 sec., 17873.964684016526 rows/sec., 10.27 MiB/sec. | ||
| 5424 | 2026.08.18 00:04:07.492229 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Trace> MergedBlockOutputStream: filled checksums 202608_1_96_19 (state Temporary) | ||
| 5425 | 2026.08.18 00:04:07.495777 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_96_19 to 202608_1_96_19 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5426 | 2026.08.18 00:04:07.495815 [ 424493 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_96_19} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_91_18, 202608_96_96_0] -> 202608_1_96_19 | ||
| 5427 | 2026.08.18 00:04:07.496333 [ 424493 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 5428 | 2026.08.18 00:04:08.000250 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 541.26 MiB, peak 564.06 MiB, free memory in arenas 101.51 MiB, will set to 542.86 MiB (RSS), difference: 1.60 MiB | ||
| 5429 | 2026.08.18 00:04:10.112346 [ 424324 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73347182592, merge_with_ttl_allowedtrue) | ||
| 5430 | 2026.08.18 00:04:10.112376 [ 424324 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 5431 | 2026.08.18 00:04:13.737191 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 231370 | ||
| 5432 | 2026.08.18 00:04:13.738258 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5433 | 2026.08.18 00:04:13.738270 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5434 | 2026.08.18 00:04:13.738726 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_97_97_0 (state Temporary) | ||
| 5435 | 2026.08.18 00:04:13.738854 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_97_97_0 to 202608_97_97_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5436 | 2026.08.18 00:04:13.738926 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 231370 | ||
| 5437 | 2026.08.18 00:04:14.951689 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 729 | ||
| 5438 | 2026.08.18 00:04:14.959263 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5439 | 2026.08.18 00:04:14.959277 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5440 | 2026.08.18 00:04:14.962589 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_97_97_0 (state Temporary) | ||
| 5441 | 2026.08.18 00:04:14.965080 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_97_97_0 to 202608_97_97_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5442 | 2026.08.18 00:04:14.965867 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 729 | ||
| 5443 | 2026.08.18 00:04:15.000248 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 543.45 MiB, peak 564.06 MiB, free memory in arenas 104.77 MiB, will set to 541.36 MiB (RSS), difference: -2.09 MiB | ||
| 5444 | 2026.08.18 00:04:21.012388 [ 424350 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5445 | 2026.08.18 00:04:21.012412 [ 424350 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5446 | 2026.08.18 00:04:21.239110 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 233946 | ||
| 5447 | 2026.08.18 00:04:21.240225 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5448 | 2026.08.18 00:04:21.240238 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5449 | 2026.08.18 00:04:21.240596 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_98_98_0 (state Temporary) | ||
| 5450 | 2026.08.18 00:04:21.240722 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_98_98_0 to 202608_98_98_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5451 | 2026.08.18 00:04:21.240796 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 233946 | ||
| 5452 | 2026.08.18 00:04:22.466023 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 737 | ||
| 5453 | 2026.08.18 00:04:22.473132 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5454 | 2026.08.18 00:04:22.473151 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5455 | 2026.08.18 00:04:22.476567 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_98_98_0 (state Temporary) | ||
| 5456 | 2026.08.18 00:04:22.479144 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_98_98_0 to 202608_98_98_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5457 | 2026.08.18 00:04:22.479928 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 737 | ||
| 5458 | 2026.08.18 00:04:22.521303 [ 424361 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73346498560, merge_with_ttl_allowedtrue) | ||
| 5459 | 2026.08.18 00:04:22.521317 [ 424361 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 5460 | 2026.08.18 00:04:25.680186 [ 424355 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73346301952, merge_with_ttl_allowedtrue) | ||
| 5461 | 2026.08.18 00:04:25.680205 [ 424355 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 5462 | 2026.08.18 00:04:28.740963 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 236200 | ||
| 5463 | 2026.08.18 00:04:28.741894 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5464 | 2026.08.18 00:04:28.741905 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5465 | 2026.08.18 00:04:28.742443 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_99_99_0 (state Temporary) | ||
| 5466 | 2026.08.18 00:04:28.742567 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_99_99_0 to 202608_99_99_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5467 | 2026.08.18 00:04:28.742635 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 236200 | ||
| 5468 | 2026.08.18 00:04:29.980086 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 744 | ||
| 5469 | 2026.08.18 00:04:29.987144 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5470 | 2026.08.18 00:04:29.987157 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5471 | 2026.08.18 00:04:29.990488 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_99_99_0 (state Temporary) | ||
| 5472 | 2026.08.18 00:04:29.992945 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_99_99_0 to 202608_99_99_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5473 | 2026.08.18 00:04:29.993726 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 744 | ||
| 5474 | 2026.08.18 00:04:35.070316 [ 424318 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345945600, merge_with_ttl_allowedtrue) | ||
| 5475 | 2026.08.18 00:04:35.070340 [ 424318 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 5476 | 2026.08.18 00:04:36.012596 [ 424325 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5477 | 2026.08.18 00:04:36.012616 [ 424325 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5478 | 2026.08.18 00:04:36.242822 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 238776 | ||
| 5479 | 2026.08.18 00:04:36.243897 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5480 | 2026.08.18 00:04:36.243909 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5481 | 2026.08.18 00:04:36.244241 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_100_100_0 (state Temporary) | ||
| 5482 | 2026.08.18 00:04:36.244364 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_100_100_0 to 202608_100_100_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5483 | 2026.08.18 00:04:36.244437 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 238776 | ||
| 5484 | 2026.08.18 00:04:36.673529 [ 424552 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_31_6, 202608_32_32_0, 202608_33_33_0, 202608_34_34_0, 202608_35_35_0, 202608_36_36_0] | ||
| 5485 | 2026.08.18 00:04:36.673537 [ 424552 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_31_6, 202608_32_32_0, 202608_33_33_0, 202608_34_34_0, 202608_35_35_0, 202608_36_36_0] | ||
| 5486 | 2026.08.18 00:04:36.674283 [ 424552 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_31_6, 202608_32_32_0, 202608_33_33_0, 202608_34_34_0, 202608_35_35_0, 202608_36_36_0] | ||
| 5487 | 2026.08.18 00:04:37.000273 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 538.15 MiB, peak 564.06 MiB, free memory in arenas 96.13 MiB, will set to 535.82 MiB (RSS), difference: -2.34 MiB | ||
| 5488 | 2026.08.18 00:04:37.190572 [ 424559 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_31_6, 202608_32_32_0, 202608_33_33_0, 202608_34_34_0, 202608_35_35_0, 202608_36_36_0] | ||
| 5489 | 2026.08.18 00:04:37.190581 [ 424559 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_31_6, 202608_32_32_0, 202608_33_33_0, 202608_34_34_0, 202608_35_35_0, 202608_36_36_0] | ||
| 5490 | 2026.08.18 00:04:37.191225 [ 424559 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_31_6, 202608_32_32_0, 202608_33_33_0, 202608_34_34_0, 202608_35_35_0, 202608_36_36_0] | ||
| 5491 | 2026.08.18 00:04:37.493884 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 752 | ||
| 5492 | 2026.08.18 00:04:37.501174 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5493 | 2026.08.18 00:04:37.501188 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5494 | 2026.08.18 00:04:37.504594 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_100_100_0 (state Temporary) | ||
| 5495 | 2026.08.18 00:04:37.507108 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_100_100_0 to 202608_100_100_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5496 | 2026.08.18 00:04:37.507911 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 752 | ||
| 5497 | 2026.08.18 00:04:38.000182 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 536.53 MiB, peak 564.06 MiB, free memory in arenas 105.29 MiB, will set to 539.14 MiB (RSS), difference: 2.61 MiB | ||
| 5498 | 2026.08.18 00:04:38.721194 [ 424392 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 5499 | 2026.08.18 00:04:43.744540 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 241030 | ||
| 5500 | 2026.08.18 00:04:43.745887 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5501 | 2026.08.18 00:04:43.745903 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5502 | 2026.08.18 00:04:43.746319 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_101_101_0 (state Temporary) | ||
| 5503 | 2026.08.18 00:04:43.746476 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_101_101_0 to 202608_101_101_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5504 | 2026.08.18 00:04:43.746568 [ 424352 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_96_19 to 202608_101_101_0 | ||
| 5505 | 2026.08.18 00:04:43.746569 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 241030 | ||
| 5506 | 2026.08.18 00:04:43.746588 [ 424352 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5507 | 2026.08.18 00:04:43.746595 [ 424352 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5508 | 2026.08.18 00:04:43.746693 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_96_19 to 202608_101_101_0 into Compact with storage Full | ||
| 5509 | 2026.08.18 00:04:43.748013 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5510 | 2026.08.18 00:04:43.748032 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 29 marks from part 202608_1_96_19, total 229116 rows starting from the beginning of the part | ||
| 5511 | 2026.08.18 00:04:43.748079 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_97_97_0, total 2254 rows starting from the beginning of the part | ||
| 5512 | 2026.08.18 00:04:43.748100 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_98_98_0, total 2576 rows starting from the beginning of the part | ||
| 5513 | 2026.08.18 00:04:43.748119 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_99_99_0, total 2254 rows starting from the beginning of the part | ||
| 5514 | 2026.08.18 00:04:43.748136 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_100_100_0, total 2576 rows starting from the beginning of the part | ||
| 5515 | 2026.08.18 00:04:43.748157 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_101_101_0, total 2254 rows starting from the beginning of the part | ||
| 5516 | 2026.08.18 00:04:43.765141 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 241030 rows, containing 4 columns (4 merged, 0 gathered) in 0.018491823 sec., 13034409.857805798 rows/sec., 187.07 MiB/sec. | ||
| 5517 | 2026.08.18 00:04:43.765297 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Trace> MergedBlockOutputStream: filled checksums 202608_1_101_20 (state Temporary) | ||
| 5518 | 2026.08.18 00:04:43.765421 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_101_20 to 202608_1_101_20 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5519 | 2026.08.18 00:04:43.765443 [ 424485 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_101_20} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_96_19, 202608_101_101_0] -> 202608_1_101_20 | ||
| 5520 | 2026.08.18 00:04:43.765486 [ 424485 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 5521 | 2026.08.18 00:04:44.000261 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 539.16 MiB, peak 564.06 MiB, free memory in arenas 77.95 MiB, will set to 534.11 MiB (RSS), difference: -5.05 MiB | ||
| 5522 | 2026.08.18 00:04:45.008113 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 759 | ||
| 5523 | 2026.08.18 00:04:45.014797 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5524 | 2026.08.18 00:04:45.014811 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5525 | 2026.08.18 00:04:45.018164 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_101_101_0 (state Temporary) | ||
| 5526 | 2026.08.18 00:04:45.020572 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_101_101_0 to 202608_101_101_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5527 | 2026.08.18 00:04:45.020747 [ 424399 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_96_19 to 202608_101_101_0 | ||
| 5528 | 2026.08.18 00:04:45.020763 [ 424399 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5529 | 2026.08.18 00:04:45.020768 [ 424399 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5530 | 2026.08.18 00:04:45.020848 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_96_19 to 202608_101_101_0 into Compact with storage Full | ||
| 5531 | 2026.08.18 00:04:45.021393 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 759 | ||
| 5532 | 2026.08.18 00:04:45.024299 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5533 | 2026.08.18 00:04:45.024634 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_96_19, total 722 rows starting from the beginning of the part | ||
| 5534 | 2026.08.18 00:04:45.026407 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_97_97_0, total 7 rows starting from the beginning of the part | ||
| 5535 | 2026.08.18 00:04:45.028156 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_98_98_0, total 8 rows starting from the beginning of the part | ||
| 5536 | 2026.08.18 00:04:45.029977 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_99_99_0, total 7 rows starting from the beginning of the part | ||
| 5537 | 2026.08.18 00:04:45.031901 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_100_100_0, total 8 rows starting from the beginning of the part | ||
| 5538 | 2026.08.18 00:04:45.033698 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_101_101_0, total 7 rows starting from the beginning of the part | ||
| 5539 | 2026.08.18 00:04:45.062222 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 759 rows, containing 679 columns (679 merged, 0 gathered) in 0.041399829 sec., 18333.409058283793 rows/sec., 10.46 MiB/sec. | ||
| 5540 | 2026.08.18 00:04:45.063253 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Trace> MergedBlockOutputStream: filled checksums 202608_1_101_20 (state Temporary) | ||
| 5541 | 2026.08.18 00:04:45.066680 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_101_20 to 202608_1_101_20 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5542 | 2026.08.18 00:04:45.066721 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_101_20} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_96_19, 202608_101_101_0] -> 202608_1_101_20 | ||
| 5543 | 2026.08.18 00:04:45.067221 [ 424494 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 5544 | 2026.08.18 00:04:46.000309 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 535.57 MiB, peak 564.06 MiB, free memory in arenas 87.07 MiB, will set to 544.02 MiB (RSS), difference: 8.45 MiB | ||
| 5545 | 2026.08.18 00:04:51.012799 [ 424291 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5546 | 2026.08.18 00:04:51.012829 [ 424291 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5547 | 2026.08.18 00:04:51.246681 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 243606 | ||
| 5548 | 2026.08.18 00:04:51.247851 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5549 | 2026.08.18 00:04:51.247865 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5550 | 2026.08.18 00:04:51.248231 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_102_102_0 (state Temporary) | ||
| 5551 | 2026.08.18 00:04:51.248370 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_102_102_0 to 202608_102_102_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5552 | 2026.08.18 00:04:51.248452 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 243606 | ||
| 5553 | 2026.08.18 00:04:52.521568 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 767 | ||
| 5554 | 2026.08.18 00:04:52.528955 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5555 | 2026.08.18 00:04:52.528969 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5556 | 2026.08.18 00:04:52.532246 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_102_102_0 (state Temporary) | ||
| 5557 | 2026.08.18 00:04:52.534732 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_102_102_0 to 202608_102_102_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5558 | 2026.08.18 00:04:52.535543 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 767 | ||
| 5559 | 2026.08.18 00:04:58.748639 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 245860 | ||
| 5560 | 2026.08.18 00:04:58.749768 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5561 | 2026.08.18 00:04:58.749781 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5562 | 2026.08.18 00:04:58.750264 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_103_103_0 (state Temporary) | ||
| 5563 | 2026.08.18 00:04:58.750397 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_103_103_0 to 202608_103_103_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5564 | 2026.08.18 00:04:58.750472 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 245860 | ||
| 5565 | 2026.08.18 00:05:00.035616 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 775 | ||
| 5566 | 2026.08.18 00:05:00.042950 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5567 | 2026.08.18 00:05:00.042969 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5568 | 2026.08.18 00:05:00.046385 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_103_103_0 (state Temporary) | ||
| 5569 | 2026.08.18 00:05:00.048883 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_103_103_0 to 202608_103_103_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5570 | 2026.08.18 00:05:00.049672 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 775 | ||
| 5571 | 2026.08.18 00:05:06.013004 [ 424381 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5572 | 2026.08.18 00:05:06.013030 [ 424381 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5573 | 2026.08.18 00:05:06.250656 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 248436 | ||
| 5574 | 2026.08.18 00:05:06.251714 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5575 | 2026.08.18 00:05:06.251725 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5576 | 2026.08.18 00:05:06.252066 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_104_104_0 (state Temporary) | ||
| 5577 | 2026.08.18 00:05:06.252184 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_104_104_0 to 202608_104_104_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5578 | 2026.08.18 00:05:06.252254 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 248436 | ||
| 5579 | 2026.08.18 00:05:07.549840 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 782 | ||
| 5580 | 2026.08.18 00:05:07.558157 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5581 | 2026.08.18 00:05:07.558172 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5582 | 2026.08.18 00:05:07.561610 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_104_104_0 (state Temporary) | ||
| 5583 | 2026.08.18 00:05:07.564210 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_104_104_0 to 202608_104_104_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5584 | 2026.08.18 00:05:07.564986 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 782 | ||
| 5585 | 2026.08.18 00:05:10.112570 [ 424345 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345626112, merge_with_ttl_allowedtrue) | ||
| 5586 | 2026.08.18 00:05:10.112592 [ 424345 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 5587 | 2026.08.18 00:05:13.752435 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 250690 | ||
| 5588 | 2026.08.18 00:05:13.753525 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5589 | 2026.08.18 00:05:13.753538 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5590 | 2026.08.18 00:05:13.754002 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_105_105_0 (state Temporary) | ||
| 5591 | 2026.08.18 00:05:13.754128 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_105_105_0 to 202608_105_105_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5592 | 2026.08.18 00:05:13.754202 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 250690 | ||
| 5593 | 2026.08.18 00:05:14.379461 [ 424720 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_36_7, 202608_37_37_0, 202608_38_38_0, 202608_39_39_0, 202608_40_40_0, 202608_41_41_0] | ||
| 5594 | 2026.08.18 00:05:14.379476 [ 424720 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_36_7, 202608_37_37_0, 202608_38_38_0, 202608_39_39_0, 202608_40_40_0, 202608_41_41_0] | ||
| 5595 | 2026.08.18 00:05:14.380163 [ 424720 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_36_7, 202608_37_37_0, 202608_38_38_0, 202608_39_39_0, 202608_40_40_0, 202608_41_41_0] | ||
| 5596 | 2026.08.18 00:05:14.531693 [ 424552 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_36_7, 202608_37_37_0, 202608_38_38_0, 202608_39_39_0, 202608_40_40_0, 202608_41_41_0] | ||
| 5597 | 2026.08.18 00:05:14.531702 [ 424552 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_36_7, 202608_37_37_0, 202608_38_38_0, 202608_39_39_0, 202608_40_40_0, 202608_41_41_0] | ||
| 5598 | 2026.08.18 00:05:14.532418 [ 424552 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_36_7, 202608_37_37_0, 202608_38_38_0, 202608_39_39_0, 202608_40_40_0, 202608_41_41_0] | ||
| 5599 | 2026.08.18 00:05:15.000265 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 541.41 MiB, peak 564.06 MiB, free memory in arenas 78.70 MiB, will set to 539.55 MiB (RSS), difference: -1.86 MiB | ||
| 5600 | 2026.08.18 00:05:15.065157 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 790 | ||
| 5601 | 2026.08.18 00:05:15.072379 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5602 | 2026.08.18 00:05:15.072392 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5603 | 2026.08.18 00:05:15.075812 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_105_105_0 (state Temporary) | ||
| 5604 | 2026.08.18 00:05:15.078402 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_105_105_0 to 202608_105_105_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5605 | 2026.08.18 00:05:15.079188 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 790 | ||
| 5606 | 2026.08.18 00:05:16.000325 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 540.27 MiB, peak 564.06 MiB, free memory in arenas 87.98 MiB, will set to 542.83 MiB (RSS), difference: 2.56 MiB | ||
| 5607 | 2026.08.18 00:05:21.013200 [ 424294 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5608 | 2026.08.18 00:05:21.013224 [ 424294 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5609 | 2026.08.18 00:05:21.254334 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 253266 | ||
| 5610 | 2026.08.18 00:05:21.255412 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5611 | 2026.08.18 00:05:21.255424 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5612 | 2026.08.18 00:05:21.255755 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_106_106_0 (state Temporary) | ||
| 5613 | 2026.08.18 00:05:21.255877 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_106_106_0 to 202608_106_106_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5614 | 2026.08.18 00:05:21.255951 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 253266 | ||
| 5615 | 2026.08.18 00:05:21.255951 [ 424408 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_101_20 to 202608_106_106_0 | ||
| 5616 | 2026.08.18 00:05:21.255974 [ 424408 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5617 | 2026.08.18 00:05:21.255979 [ 424408 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5618 | 2026.08.18 00:05:21.256066 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_101_20 to 202608_106_106_0 into Compact with storage Full | ||
| 5619 | 2026.08.18 00:05:21.256122 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5620 | 2026.08.18 00:05:21.256136 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 31 marks from part 202608_1_101_20, total 241030 rows starting from the beginning of the part | ||
| 5621 | 2026.08.18 00:05:21.256177 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_102_102_0, total 2576 rows starting from the beginning of the part | ||
| 5622 | 2026.08.18 00:05:21.256196 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_103_103_0, total 2254 rows starting from the beginning of the part | ||
| 5623 | 2026.08.18 00:05:21.256212 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_104_104_0, total 2576 rows starting from the beginning of the part | ||
| 5624 | 2026.08.18 00:05:21.256228 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_105_105_0, total 2254 rows starting from the beginning of the part | ||
| 5625 | 2026.08.18 00:05:21.256254 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_106_106_0, total 2576 rows starting from the beginning of the part | ||
| 5626 | 2026.08.18 00:05:21.273338 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 253266 rows, containing 4 columns (4 merged, 0 gathered) in 0.017311422 sec., 14629994.000492854 rows/sec., 209.96 MiB/sec. | ||
| 5627 | 2026.08.18 00:05:21.273534 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Trace> MergedBlockOutputStream: filled checksums 202608_1_106_21 (state Temporary) | ||
| 5628 | 2026.08.18 00:05:21.273662 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_106_21 to 202608_1_106_21 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5629 | 2026.08.18 00:05:21.273685 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_106_21} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_101_20, 202608_106_106_0] -> 202608_1_106_21 | ||
| 5630 | 2026.08.18 00:05:21.273727 [ 424466 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 5631 | 2026.08.18 00:05:22.000256 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 542.86 MiB, peak 564.06 MiB, free memory in arenas 86.77 MiB, will set to 529.24 MiB (RSS), difference: -13.62 MiB | ||
| 5632 | 2026.08.18 00:05:22.521526 [ 424410 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73347115008, merge_with_ttl_allowedtrue) | ||
| 5633 | 2026.08.18 00:05:22.521536 [ 424410 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 5634 | 2026.08.18 00:05:22.579361 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 797 | ||
| 5635 | 2026.08.18 00:05:22.586497 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5636 | 2026.08.18 00:05:22.586510 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5637 | 2026.08.18 00:05:22.589859 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_106_106_0 (state Temporary) | ||
| 5638 | 2026.08.18 00:05:22.592360 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_106_106_0 to 202608_106_106_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5639 | 2026.08.18 00:05:22.592524 [ 424316 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_101_20 to 202608_106_106_0 | ||
| 5640 | 2026.08.18 00:05:22.592536 [ 424316 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5641 | 2026.08.18 00:05:22.592540 [ 424316 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5642 | 2026.08.18 00:05:22.592617 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_101_20 to 202608_106_106_0 into Compact with storage Full | ||
| 5643 | 2026.08.18 00:05:22.593261 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 797 | ||
| 5644 | 2026.08.18 00:05:22.596084 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5645 | 2026.08.18 00:05:22.596452 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_101_20, total 759 rows starting from the beginning of the part | ||
| 5646 | 2026.08.18 00:05:22.598312 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_102_102_0, total 8 rows starting from the beginning of the part | ||
| 5647 | 2026.08.18 00:05:22.600115 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_103_103_0, total 8 rows starting from the beginning of the part | ||
| 5648 | 2026.08.18 00:05:22.602019 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_104_104_0, total 7 rows starting from the beginning of the part | ||
| 5649 | 2026.08.18 00:05:22.603857 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_105_105_0, total 8 rows starting from the beginning of the part | ||
| 5650 | 2026.08.18 00:05:22.605712 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_106_106_0, total 7 rows starting from the beginning of the part | ||
| 5651 | 2026.08.18 00:05:22.634817 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 797 rows, containing 679 columns (679 merged, 0 gathered) in 0.04222914 sec., 18873.223560792383 rows/sec., 10.70 MiB/sec. | ||
| 5652 | 2026.08.18 00:05:22.635863 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Trace> MergedBlockOutputStream: filled checksums 202608_1_106_21 (state Temporary) | ||
| 5653 | 2026.08.18 00:05:22.639252 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_106_21 to 202608_1_106_21 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5654 | 2026.08.18 00:05:22.639292 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_106_21} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_101_20, 202608_106_106_0] -> 202608_1_106_21 | ||
| 5655 | 2026.08.18 00:05:22.639785 [ 424485 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 5656 | 2026.08.18 00:05:23.000178 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 530.70 MiB, peak 564.06 MiB, free memory in arenas 96.57 MiB, will set to 547.25 MiB (RSS), difference: 16.55 MiB | ||
| 5657 | 2026.08.18 00:05:25.680406 [ 424291 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73346543616, merge_with_ttl_allowedtrue) | ||
| 5658 | 2026.08.18 00:05:25.680421 [ 424291 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 5659 | 2026.08.18 00:05:28.756149 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 255520 | ||
| 5660 | 2026.08.18 00:05:28.757326 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5661 | 2026.08.18 00:05:28.757339 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5662 | 2026.08.18 00:05:28.757821 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_107_107_0 (state Temporary) | ||
| 5663 | 2026.08.18 00:05:28.757945 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_107_107_0 to 202608_107_107_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5664 | 2026.08.18 00:05:28.758026 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 255520 | ||
| 5665 | 2026.08.18 00:05:30.093365 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 805 | ||
| 5666 | 2026.08.18 00:05:30.100749 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5667 | 2026.08.18 00:05:30.100763 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5668 | 2026.08.18 00:05:30.104026 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_107_107_0 (state Temporary) | ||
| 5669 | 2026.08.18 00:05:30.106504 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_107_107_0 to 202608_107_107_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5670 | 2026.08.18 00:05:30.107312 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 805 | ||
| 5671 | 2026.08.18 00:05:31.000304 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 547.84 MiB, peak 564.06 MiB, free memory in arenas 92.57 MiB, will set to 546.21 MiB (RSS), difference: -1.63 MiB | ||
| 5672 | 2026.08.18 00:05:35.070534 [ 424327 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345996800, merge_with_ttl_allowedtrue) | ||
| 5673 | 2026.08.18 00:05:35.070559 [ 424327 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 5674 | 2026.08.18 00:05:36.013398 [ 424383 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5675 | 2026.08.18 00:05:36.013421 [ 424383 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5676 | 2026.08.18 00:05:36.258194 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 258096 | ||
| 5677 | 2026.08.18 00:05:36.259315 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5678 | 2026.08.18 00:05:36.259329 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5679 | 2026.08.18 00:05:36.259662 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_108_108_0 (state Temporary) | ||
| 5680 | 2026.08.18 00:05:36.259791 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_108_108_0 to 202608_108_108_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5681 | 2026.08.18 00:05:36.259867 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 258096 | ||
| 5682 | 2026.08.18 00:05:37.607479 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 812 | ||
| 5683 | 2026.08.18 00:05:37.615830 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5684 | 2026.08.18 00:05:37.615844 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5685 | 2026.08.18 00:05:37.619264 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_108_108_0 (state Temporary) | ||
| 5686 | 2026.08.18 00:05:37.621836 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_108_108_0 to 202608_108_108_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5687 | 2026.08.18 00:05:37.622634 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 812 | ||
| 5688 | 2026.08.18 00:05:38.000162 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 546.92 MiB, peak 564.06 MiB, free memory in arenas 92.81 MiB, will set to 545.88 MiB (RSS), difference: -1.04 MiB | ||
| 5689 | 2026.08.18 00:05:38.721390 [ 424313 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 5690 | 2026.08.18 00:05:43.760047 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 260350 | ||
| 5691 | 2026.08.18 00:05:43.761044 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5692 | 2026.08.18 00:05:43.761055 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5693 | 2026.08.18 00:05:43.761379 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_109_109_0 (state Temporary) | ||
| 5694 | 2026.08.18 00:05:43.761498 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_109_109_0 to 202608_109_109_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5695 | 2026.08.18 00:05:43.761572 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 260350 | ||
| 5696 | 2026.08.18 00:05:45.122804 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 820 | ||
| 5697 | 2026.08.18 00:05:45.131149 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5698 | 2026.08.18 00:05:45.131163 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5699 | 2026.08.18 00:05:45.134594 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_109_109_0 (state Temporary) | ||
| 5700 | 2026.08.18 00:05:45.137208 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_109_109_0 to 202608_109_109_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5701 | 2026.08.18 00:05:45.138002 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 820 | ||
| 5702 | 2026.08.18 00:05:51.013599 [ 424344 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5703 | 2026.08.18 00:05:51.013623 [ 424344 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5704 | 2026.08.18 00:05:51.092010 [ 424559 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_41_8, 202608_42_42_0, 202608_43_43_0, 202608_44_44_0, 202608_45_45_0, 202608_46_46_0] | ||
| 5705 | 2026.08.18 00:05:51.092023 [ 424559 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_41_8, 202608_42_42_0, 202608_43_43_0, 202608_44_44_0, 202608_45_45_0, 202608_46_46_0] | ||
| 5706 | 2026.08.18 00:05:51.092690 [ 424559 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_41_8, 202608_42_42_0, 202608_43_43_0, 202608_44_44_0, 202608_45_45_0, 202608_46_46_0] | ||
| 5707 | 2026.08.18 00:05:51.112445 [ 424555 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_41_8, 202608_42_42_0, 202608_43_43_0, 202608_44_44_0, 202608_45_45_0, 202608_46_46_0] | ||
| 5708 | 2026.08.18 00:05:51.112451 [ 424555 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_41_8, 202608_42_42_0, 202608_43_43_0, 202608_44_44_0, 202608_45_45_0, 202608_46_46_0] | ||
| 5709 | 2026.08.18 00:05:51.113142 [ 424555 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_41_8, 202608_42_42_0, 202608_43_43_0, 202608_44_44_0, 202608_45_45_0, 202608_46_46_0] | ||
| 5710 | 2026.08.18 00:05:51.261857 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 262926 | ||
| 5711 | 2026.08.18 00:05:51.262939 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5712 | 2026.08.18 00:05:51.262950 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5713 | 2026.08.18 00:05:51.263425 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_110_110_0 (state Temporary) | ||
| 5714 | 2026.08.18 00:05:51.263550 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_110_110_0 to 202608_110_110_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5715 | 2026.08.18 00:05:51.263624 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 262926 | ||
| 5716 | 2026.08.18 00:05:52.000261 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 542.64 MiB, peak 564.06 MiB, free memory in arenas 82.42 MiB, will set to 539.56 MiB (RSS), difference: -3.08 MiB | ||
| 5717 | 2026.08.18 00:05:52.638074 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 827 | ||
| 5718 | 2026.08.18 00:05:52.646891 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5719 | 2026.08.18 00:05:52.646905 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5720 | 2026.08.18 00:05:52.650408 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_110_110_0 (state Temporary) | ||
| 5721 | 2026.08.18 00:05:52.653007 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_110_110_0 to 202608_110_110_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5722 | 2026.08.18 00:05:52.653789 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 827 | ||
| 5723 | 2026.08.18 00:05:53.000175 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 540.27 MiB, peak 564.06 MiB, free memory in arenas 87.98 MiB, will set to 542.34 MiB (RSS), difference: 2.07 MiB | ||
| 5724 | 2026.08.18 00:05:58.763720 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 265180 | ||
| 5725 | 2026.08.18 00:05:58.764707 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5726 | 2026.08.18 00:05:58.764720 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5727 | 2026.08.18 00:05:58.765057 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_111_111_0 (state Temporary) | ||
| 5728 | 2026.08.18 00:05:58.765187 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_111_111_0 to 202608_111_111_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5729 | 2026.08.18 00:05:58.765258 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 265180 | ||
| 5730 | 2026.08.18 00:05:58.765272 [ 424415 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_106_21 to 202608_111_111_0 | ||
| 5731 | 2026.08.18 00:05:58.765295 [ 424415 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5732 | 2026.08.18 00:05:58.765302 [ 424415 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5733 | 2026.08.18 00:05:58.765402 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_106_21 to 202608_111_111_0 into Compact with storage Full | ||
| 5734 | 2026.08.18 00:05:58.765459 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5735 | 2026.08.18 00:05:58.765474 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 32 marks from part 202608_1_106_21, total 253266 rows starting from the beginning of the part | ||
| 5736 | 2026.08.18 00:05:58.765517 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_107_107_0, total 2254 rows starting from the beginning of the part | ||
| 5737 | 2026.08.18 00:05:58.765538 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_108_108_0, total 2576 rows starting from the beginning of the part | ||
| 5738 | 2026.08.18 00:05:58.765554 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_109_109_0, total 2254 rows starting from the beginning of the part | ||
| 5739 | 2026.08.18 00:05:58.765572 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_110_110_0, total 2576 rows starting from the beginning of the part | ||
| 5740 | 2026.08.18 00:05:58.765590 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_111_111_0, total 2254 rows starting from the beginning of the part | ||
| 5741 | 2026.08.18 00:05:58.782185 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 265180 rows, containing 4 columns (4 merged, 0 gathered) in 0.016829693 sec., 15756674.82466852 rows/sec., 226.08 MiB/sec. | ||
| 5742 | 2026.08.18 00:05:58.782349 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Trace> MergedBlockOutputStream: filled checksums 202608_1_111_22 (state Temporary) | ||
| 5743 | 2026.08.18 00:05:58.782478 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_111_22 to 202608_1_111_22 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5744 | 2026.08.18 00:05:58.782501 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_111_22} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_106_21, 202608_111_111_0] -> 202608_1_111_22 | ||
| 5745 | 2026.08.18 00:05:58.782545 [ 424494 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 5746 | 2026.08.18 00:06:00.153885 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 835 | ||
| 5747 | 2026.08.18 00:06:00.164433 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5748 | 2026.08.18 00:06:00.164458 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5749 | 2026.08.18 00:06:00.168722 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_111_111_0 (state Temporary) | ||
| 5750 | 2026.08.18 00:06:00.171652 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_111_111_0 to 202608_111_111_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5751 | 2026.08.18 00:06:00.171823 [ 424329 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_106_21 to 202608_111_111_0 | ||
| 5752 | 2026.08.18 00:06:00.171838 [ 424329 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5753 | 2026.08.18 00:06:00.171842 [ 424329 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5754 | 2026.08.18 00:06:00.171922 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_106_21 to 202608_111_111_0 into Compact with storage Full | ||
| 5755 | 2026.08.18 00:06:00.172527 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 835 | ||
| 5756 | 2026.08.18 00:06:00.176054 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5757 | 2026.08.18 00:06:00.176396 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_106_21, total 797 rows starting from the beginning of the part | ||
| 5758 | 2026.08.18 00:06:00.178189 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_107_107_0, total 8 rows starting from the beginning of the part | ||
| 5759 | 2026.08.18 00:06:00.179943 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_108_108_0, total 7 rows starting from the beginning of the part | ||
| 5760 | 2026.08.18 00:06:00.181749 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_109_109_0, total 8 rows starting from the beginning of the part | ||
| 5761 | 2026.08.18 00:06:00.183483 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_110_110_0, total 7 rows starting from the beginning of the part | ||
| 5762 | 2026.08.18 00:06:00.185211 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_111_111_0, total 8 rows starting from the beginning of the part | ||
| 5763 | 2026.08.18 00:06:00.213028 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 835 rows, containing 679 columns (679 merged, 0 gathered) in 0.041137879 sec., 20297.59482738524 rows/sec., 11.44 MiB/sec. | ||
| 5764 | 2026.08.18 00:06:00.214049 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Trace> MergedBlockOutputStream: filled checksums 202608_1_111_22 (state Temporary) | ||
| 5765 | 2026.08.18 00:06:00.217525 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_111_22 to 202608_1_111_22 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5766 | 2026.08.18 00:06:00.217564 [ 424485 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_111_22} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_106_21, 202608_111_111_0] -> 202608_1_111_22 | ||
| 5767 | 2026.08.18 00:06:00.218038 [ 424485 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 5768 | 2026.08.18 00:06:01.000284 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 543.05 MiB, peak 564.06 MiB, free memory in arenas 92.60 MiB, will set to 545.38 MiB (RSS), difference: 2.32 MiB | ||
| 5769 | 2026.08.18 00:06:06.013806 [ 424376 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5770 | 2026.08.18 00:06:06.013832 [ 424376 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5771 | 2026.08.18 00:06:06.265435 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 267756 | ||
| 5772 | 2026.08.18 00:06:06.266694 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5773 | 2026.08.18 00:06:06.266708 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5774 | 2026.08.18 00:06:06.267224 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_112_112_0 (state Temporary) | ||
| 5775 | 2026.08.18 00:06:06.267359 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_112_112_0 to 202608_112_112_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5776 | 2026.08.18 00:06:06.267445 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 267756 | ||
| 5777 | 2026.08.18 00:06:07.000700 [ 425081 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 8.24e-05 sec. | ||
| 5778 | 2026.08.18 00:06:07.672612 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 842 | ||
| 5779 | 2026.08.18 00:06:07.681095 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5780 | 2026.08.18 00:06:07.681110 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5781 | 2026.08.18 00:06:07.684611 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_112_112_0 (state Temporary) | ||
| 5782 | 2026.08.18 00:06:07.687005 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_112_112_0 to 202608_112_112_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5783 | 2026.08.18 00:06:07.687802 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 842 | ||
| 5784 | 2026.08.18 00:06:10.112783 [ 424375 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345671168, merge_with_ttl_allowedtrue) | ||
| 5785 | 2026.08.18 00:06:10.112802 [ 424375 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 5786 | 2026.08.18 00:06:13.767641 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 270010 | ||
| 5787 | 2026.08.18 00:06:13.768638 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5788 | 2026.08.18 00:06:13.768650 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5789 | 2026.08.18 00:06:13.768991 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_113_113_0 (state Temporary) | ||
| 5790 | 2026.08.18 00:06:13.769185 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_113_113_0 to 202608_113_113_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5791 | 2026.08.18 00:06:13.769261 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 270010 | ||
| 5792 | 2026.08.18 00:06:15.187976 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 850 | ||
| 5793 | 2026.08.18 00:06:15.196086 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5794 | 2026.08.18 00:06:15.196104 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5795 | 2026.08.18 00:06:15.199566 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_113_113_0 (state Temporary) | ||
| 5796 | 2026.08.18 00:06:15.202168 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_113_113_0 to 202608_113_113_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5797 | 2026.08.18 00:06:15.202959 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 850 | ||
| 5798 | 2026.08.18 00:06:21.014009 [ 424367 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5799 | 2026.08.18 00:06:21.014031 [ 424367 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5800 | 2026.08.18 00:06:21.269475 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 272586 | ||
| 5801 | 2026.08.18 00:06:21.270508 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5802 | 2026.08.18 00:06:21.270520 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5803 | 2026.08.18 00:06:21.270921 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_114_114_0 (state Temporary) | ||
| 5804 | 2026.08.18 00:06:21.271042 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_114_114_0 to 202608_114_114_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5805 | 2026.08.18 00:06:21.271107 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 272586 | ||
| 5806 | 2026.08.18 00:06:22.521737 [ 424322 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345249280, merge_with_ttl_allowedtrue) | ||
| 5807 | 2026.08.18 00:06:22.521752 [ 424322 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 5808 | 2026.08.18 00:06:22.703125 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 857 | ||
| 5809 | 2026.08.18 00:06:22.710409 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5810 | 2026.08.18 00:06:22.710422 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5811 | 2026.08.18 00:06:22.713679 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_114_114_0 (state Temporary) | ||
| 5812 | 2026.08.18 00:06:22.716195 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_114_114_0 to 202608_114_114_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5813 | 2026.08.18 00:06:22.716979 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 857 | ||
| 5814 | 2026.08.18 00:06:25.680630 [ 424331 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73344976896, merge_with_ttl_allowedtrue) | ||
| 5815 | 2026.08.18 00:06:25.680654 [ 424331 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 5816 | 2026.08.18 00:06:28.451283 [ 424555 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_46_9, 202608_47_47_0, 202608_48_48_0, 202608_49_49_0, 202608_50_50_0, 202608_51_51_0] | ||
| 5817 | 2026.08.18 00:06:28.451293 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_46_9, 202608_47_47_0, 202608_48_48_0, 202608_49_49_0, 202608_50_50_0, 202608_51_51_0] | ||
| 5818 | 2026.08.18 00:06:28.451971 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_46_9, 202608_47_47_0, 202608_48_48_0, 202608_49_49_0, 202608_50_50_0, 202608_51_51_0] | ||
| 5819 | 2026.08.18 00:06:28.771257 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 274840 | ||
| 5820 | 2026.08.18 00:06:28.772251 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5821 | 2026.08.18 00:06:28.772263 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5822 | 2026.08.18 00:06:28.772631 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_115_115_0 (state Temporary) | ||
| 5823 | 2026.08.18 00:06:28.772746 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_115_115_0 to 202608_115_115_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5824 | 2026.08.18 00:06:28.772812 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 274840 | ||
| 5825 | 2026.08.18 00:06:29.746748 [ 424559 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_46_9, 202608_47_47_0, 202608_48_48_0, 202608_49_49_0, 202608_50_50_0, 202608_51_51_0] | ||
| 5826 | 2026.08.18 00:06:29.746755 [ 424559 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_46_9, 202608_47_47_0, 202608_48_48_0, 202608_49_49_0, 202608_50_50_0, 202608_51_51_0] | ||
| 5827 | 2026.08.18 00:06:29.747510 [ 424559 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_46_9, 202608_47_47_0, 202608_48_48_0, 202608_49_49_0, 202608_50_50_0, 202608_51_51_0] | ||
| 5828 | 2026.08.18 00:06:30.000234 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 543.18 MiB, peak 564.06 MiB, free memory in arenas 55.18 MiB, will set to 522.20 MiB (RSS), difference: -20.98 MiB | ||
| 5829 | 2026.08.18 00:06:30.217152 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 865 | ||
| 5830 | 2026.08.18 00:06:30.224522 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5831 | 2026.08.18 00:06:30.224535 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5832 | 2026.08.18 00:06:30.227930 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_115_115_0 (state Temporary) | ||
| 5833 | 2026.08.18 00:06:30.230476 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_115_115_0 to 202608_115_115_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5834 | 2026.08.18 00:06:30.231271 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 865 | ||
| 5835 | 2026.08.18 00:06:35.070750 [ 424311 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345949696, merge_with_ttl_allowedtrue) | ||
| 5836 | 2026.08.18 00:06:35.070772 [ 424311 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 5837 | 2026.08.18 00:06:36.014202 [ 424308 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5838 | 2026.08.18 00:06:36.014226 [ 424308 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5839 | 2026.08.18 00:06:36.272984 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 277416 | ||
| 5840 | 2026.08.18 00:06:36.274087 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5841 | 2026.08.18 00:06:36.274103 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5842 | 2026.08.18 00:06:36.274561 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_116_116_0 (state Temporary) | ||
| 5843 | 2026.08.18 00:06:36.274679 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_116_116_0 to 202608_116_116_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5844 | 2026.08.18 00:06:36.274744 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 277416 | ||
| 5845 | 2026.08.18 00:06:36.274747 [ 424329 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_111_22 to 202608_116_116_0 | ||
| 5846 | 2026.08.18 00:06:36.274759 [ 424329 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5847 | 2026.08.18 00:06:36.274764 [ 424329 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5848 | 2026.08.18 00:06:36.274834 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_111_22 to 202608_116_116_0 into Compact with storage Full | ||
| 5849 | 2026.08.18 00:06:36.274891 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5850 | 2026.08.18 00:06:36.274905 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 34 marks from part 202608_1_111_22, total 265180 rows starting from the beginning of the part | ||
| 5851 | 2026.08.18 00:06:36.274944 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_112_112_0, total 2576 rows starting from the beginning of the part | ||
| 5852 | 2026.08.18 00:06:36.274962 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_113_113_0, total 2254 rows starting from the beginning of the part | ||
| 5853 | 2026.08.18 00:06:36.274977 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_114_114_0, total 2576 rows starting from the beginning of the part | ||
| 5854 | 2026.08.18 00:06:36.274991 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_115_115_0, total 2254 rows starting from the beginning of the part | ||
| 5855 | 2026.08.18 00:06:36.275006 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_116_116_0, total 2576 rows starting from the beginning of the part | ||
| 5856 | 2026.08.18 00:06:36.292435 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 277416 rows, containing 4 columns (4 merged, 0 gathered) in 0.017638243 sec., 15728097.180654557 rows/sec., 225.65 MiB/sec. | ||
| 5857 | 2026.08.18 00:06:36.292639 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Trace> MergedBlockOutputStream: filled checksums 202608_1_116_23 (state Temporary) | ||
| 5858 | 2026.08.18 00:06:36.292766 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_116_23 to 202608_1_116_23 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5859 | 2026.08.18 00:06:36.292788 [ 424483 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_116_23} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_111_22, 202608_116_116_0] -> 202608_1_116_23 | ||
| 5860 | 2026.08.18 00:06:36.292828 [ 424483 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 5861 | 2026.08.18 00:06:37.000307 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 522.79 MiB, peak 564.06 MiB, free memory in arenas 73.66 MiB, will set to 521.16 MiB (RSS), difference: -1.63 MiB | ||
| 5862 | 2026.08.18 00:06:37.731356 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 872 | ||
| 5863 | 2026.08.18 00:06:37.738309 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5864 | 2026.08.18 00:06:37.738322 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5865 | 2026.08.18 00:06:37.741719 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_116_116_0 (state Temporary) | ||
| 5866 | 2026.08.18 00:06:37.744096 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_116_116_0 to 202608_116_116_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5867 | 2026.08.18 00:06:37.744253 [ 424323 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_111_22 to 202608_116_116_0 | ||
| 5868 | 2026.08.18 00:06:37.744270 [ 424323 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5869 | 2026.08.18 00:06:37.744274 [ 424323 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5870 | 2026.08.18 00:06:37.744340 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_111_22 to 202608_116_116_0 into Compact with storage Full | ||
| 5871 | 2026.08.18 00:06:37.744974 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 872 | ||
| 5872 | 2026.08.18 00:06:37.747473 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5873 | 2026.08.18 00:06:37.747827 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_111_22, total 835 rows starting from the beginning of the part | ||
| 5874 | 2026.08.18 00:06:37.749688 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_112_112_0, total 7 rows starting from the beginning of the part | ||
| 5875 | 2026.08.18 00:06:37.751563 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_113_113_0, total 8 rows starting from the beginning of the part | ||
| 5876 | 2026.08.18 00:06:37.753436 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_114_114_0, total 7 rows starting from the beginning of the part | ||
| 5877 | 2026.08.18 00:06:37.755287 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_115_115_0, total 8 rows starting from the beginning of the part | ||
| 5878 | 2026.08.18 00:06:37.757123 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_116_116_0, total 7 rows starting from the beginning of the part | ||
| 5879 | 2026.08.18 00:06:37.786242 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 872 rows, containing 679 columns (679 merged, 0 gathered) in 0.0419238 sec., 20799.64125389397 rows/sec., 11.64 MiB/sec. | ||
| 5880 | 2026.08.18 00:06:37.787407 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Trace> MergedBlockOutputStream: filled checksums 202608_1_116_23 (state Temporary) | ||
| 5881 | 2026.08.18 00:06:37.790865 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_116_23 to 202608_1_116_23 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5882 | 2026.08.18 00:06:37.790907 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_116_23} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_111_22, 202608_116_116_0] -> 202608_1_116_23 | ||
| 5883 | 2026.08.18 00:06:37.791367 [ 424489 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 5884 | 2026.08.18 00:06:38.000225 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 522.62 MiB, peak 564.06 MiB, free memory in arenas 90.34 MiB, will set to 541.30 MiB (RSS), difference: 18.68 MiB | ||
| 5885 | 2026.08.18 00:06:38.721583 [ 424300 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 5886 | 2026.08.18 00:06:43.774841 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 279670 | ||
| 5887 | 2026.08.18 00:06:43.775884 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5888 | 2026.08.18 00:06:43.775898 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5889 | 2026.08.18 00:06:43.776244 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_117_117_0 (state Temporary) | ||
| 5890 | 2026.08.18 00:06:43.776373 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_117_117_0 to 202608_117_117_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5891 | 2026.08.18 00:06:43.776449 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 279670 | ||
| 5892 | 2026.08.18 00:06:45.245149 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 880 | ||
| 5893 | 2026.08.18 00:06:45.252656 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5894 | 2026.08.18 00:06:45.252669 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5895 | 2026.08.18 00:06:45.255956 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_117_117_0 (state Temporary) | ||
| 5896 | 2026.08.18 00:06:45.258405 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_117_117_0 to 202608_117_117_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5897 | 2026.08.18 00:06:45.259201 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 880 | ||
| 5898 | 2026.08.18 00:06:51.014318 [ 424388 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5899 | 2026.08.18 00:06:51.014345 [ 424388 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5900 | 2026.08.18 00:06:51.276629 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 282246 | ||
| 5901 | 2026.08.18 00:06:51.277687 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5902 | 2026.08.18 00:06:51.277698 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5903 | 2026.08.18 00:06:51.278016 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_118_118_0 (state Temporary) | ||
| 5904 | 2026.08.18 00:06:51.278134 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_118_118_0 to 202608_118_118_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5905 | 2026.08.18 00:06:51.278200 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 282246 | ||
| 5906 | 2026.08.18 00:06:52.759284 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 887 | ||
| 5907 | 2026.08.18 00:06:52.766108 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5908 | 2026.08.18 00:06:52.766126 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5909 | 2026.08.18 00:06:52.769409 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_118_118_0 (state Temporary) | ||
| 5910 | 2026.08.18 00:06:52.771804 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_118_118_0 to 202608_118_118_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5911 | 2026.08.18 00:06:52.772591 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 887 | ||
| 5912 | 2026.08.18 00:06:58.778331 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 284500 | ||
| 5913 | 2026.08.18 00:06:58.779276 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5914 | 2026.08.18 00:06:58.779287 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5915 | 2026.08.18 00:06:58.779589 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_119_119_0 (state Temporary) | ||
| 5916 | 2026.08.18 00:06:58.779700 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_119_119_0 to 202608_119_119_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5917 | 2026.08.18 00:06:58.779765 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 284500 | ||
| 5918 | 2026.08.18 00:07:00.272686 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 895 | ||
| 5919 | 2026.08.18 00:07:00.283759 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5920 | 2026.08.18 00:07:00.283778 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5921 | 2026.08.18 00:07:00.288105 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_119_119_0 (state Temporary) | ||
| 5922 | 2026.08.18 00:07:00.291003 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_119_119_0 to 202608_119_119_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5923 | 2026.08.18 00:07:00.291858 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 895 | ||
| 5924 | 2026.08.18 00:07:06.014430 [ 424405 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5925 | 2026.08.18 00:07:06.014461 [ 424405 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5926 | 2026.08.18 00:07:06.279923 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 287076 | ||
| 5927 | 2026.08.18 00:07:06.280996 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5928 | 2026.08.18 00:07:06.281007 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5929 | 2026.08.18 00:07:06.281462 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_120_120_0 (state Temporary) | ||
| 5930 | 2026.08.18 00:07:06.281589 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_120_120_0 to 202608_120_120_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5931 | 2026.08.18 00:07:06.281663 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 287076 | ||
| 5932 | 2026.08.18 00:07:06.795893 [ 424555 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_51_10, 202608_52_52_0, 202608_53_53_0, 202608_54_54_0, 202608_55_55_0, 202608_56_56_0] | ||
| 5933 | 2026.08.18 00:07:06.795901 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_51_10, 202608_52_52_0, 202608_53_53_0, 202608_54_54_0, 202608_55_55_0, 202608_56_56_0] | ||
| 5934 | 2026.08.18 00:07:06.796569 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_51_10, 202608_52_52_0, 202608_53_53_0, 202608_54_54_0, 202608_55_55_0, 202608_56_56_0] | ||
| 5935 | 2026.08.18 00:07:07.326334 [ 424720 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_51_10, 202608_52_52_0, 202608_53_53_0, 202608_54_54_0, 202608_55_55_0, 202608_56_56_0] | ||
| 5936 | 2026.08.18 00:07:07.326347 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_51_10, 202608_52_52_0, 202608_53_53_0, 202608_54_54_0, 202608_55_55_0, 202608_56_56_0] | ||
| 5937 | 2026.08.18 00:07:07.327176 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_51_10, 202608_52_52_0, 202608_53_53_0, 202608_54_54_0, 202608_55_55_0, 202608_56_56_0] | ||
| 5938 | 2026.08.18 00:07:07.792035 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 902 | ||
| 5939 | 2026.08.18 00:07:07.800295 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5940 | 2026.08.18 00:07:07.800308 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5941 | 2026.08.18 00:07:07.803805 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_120_120_0 (state Temporary) | ||
| 5942 | 2026.08.18 00:07:07.806365 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_120_120_0 to 202608_120_120_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5943 | 2026.08.18 00:07:07.807171 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 902 | ||
| 5944 | 2026.08.18 00:07:08.000361 [ 425081 ] {} <Trace> AsynchronousMetrics: Scanning /sys/block | ||
| 5945 | 2026.08.18 00:07:10.112988 [ 424389 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345628160, merge_with_ttl_allowedtrue) | ||
| 5946 | 2026.08.18 00:07:10.113006 [ 424389 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 5947 | 2026.08.18 00:07:13.781828 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 289330 | ||
| 5948 | 2026.08.18 00:07:13.782898 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5949 | 2026.08.18 00:07:13.782910 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5950 | 2026.08.18 00:07:13.783366 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_121_121_0 (state Temporary) | ||
| 5951 | 2026.08.18 00:07:13.783487 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_121_121_0 to 202608_121_121_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5952 | 2026.08.18 00:07:13.783556 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 289330 | ||
| 5953 | 2026.08.18 00:07:13.783569 [ 424409 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_116_23 to 202608_121_121_0 | ||
| 5954 | 2026.08.18 00:07:13.783593 [ 424409 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5955 | 2026.08.18 00:07:13.783600 [ 424409 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5956 | 2026.08.18 00:07:13.783678 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_116_23 to 202608_121_121_0 into Compact with storage Full | ||
| 5957 | 2026.08.18 00:07:13.783732 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5958 | 2026.08.18 00:07:13.783745 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 35 marks from part 202608_1_116_23, total 277416 rows starting from the beginning of the part | ||
| 5959 | 2026.08.18 00:07:13.783782 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_117_117_0, total 2254 rows starting from the beginning of the part | ||
| 5960 | 2026.08.18 00:07:13.783801 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_118_118_0, total 2576 rows starting from the beginning of the part | ||
| 5961 | 2026.08.18 00:07:13.783817 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_119_119_0, total 2254 rows starting from the beginning of the part | ||
| 5962 | 2026.08.18 00:07:13.783831 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_120_120_0, total 2576 rows starting from the beginning of the part | ||
| 5963 | 2026.08.18 00:07:13.783845 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_121_121_0, total 2254 rows starting from the beginning of the part | ||
| 5964 | 2026.08.18 00:07:13.801569 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 289330 rows, containing 4 columns (4 merged, 0 gathered) in 0.017926893 sec., 16139439.221286144 rows/sec., 231.51 MiB/sec. | ||
| 5965 | 2026.08.18 00:07:13.801720 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Trace> MergedBlockOutputStream: filled checksums 202608_1_121_24 (state Temporary) | ||
| 5966 | 2026.08.18 00:07:13.801842 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_121_24 to 202608_1_121_24 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5967 | 2026.08.18 00:07:13.801864 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_121_24} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_116_23, 202608_121_121_0] -> 202608_1_121_24 | ||
| 5968 | 2026.08.18 00:07:13.801903 [ 424474 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 5969 | 2026.08.18 00:07:14.000269 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 539.84 MiB, peak 564.06 MiB, free memory in arenas 80.94 MiB, will set to 541.91 MiB (RSS), difference: 2.07 MiB | ||
| 5970 | 2026.08.18 00:07:15.307343 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 910 | ||
| 5971 | 2026.08.18 00:07:15.314839 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5972 | 2026.08.18 00:07:15.314853 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5973 | 2026.08.18 00:07:15.318252 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_121_121_0 (state Temporary) | ||
| 5974 | 2026.08.18 00:07:15.320759 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_121_121_0 to 202608_121_121_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5975 | 2026.08.18 00:07:15.320931 [ 424411 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_116_23 to 202608_121_121_0 | ||
| 5976 | 2026.08.18 00:07:15.320950 [ 424411 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5977 | 2026.08.18 00:07:15.320961 [ 424411 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5978 | 2026.08.18 00:07:15.321034 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_116_23 to 202608_121_121_0 into Compact with storage Full | ||
| 5979 | 2026.08.18 00:07:15.321561 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 910 | ||
| 5980 | 2026.08.18 00:07:15.324267 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 5981 | 2026.08.18 00:07:15.324621 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_116_23, total 872 rows starting from the beginning of the part | ||
| 5982 | 2026.08.18 00:07:15.326522 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_117_117_0, total 8 rows starting from the beginning of the part | ||
| 5983 | 2026.08.18 00:07:15.328402 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_118_118_0, total 7 rows starting from the beginning of the part | ||
| 5984 | 2026.08.18 00:07:15.330312 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_119_119_0, total 8 rows starting from the beginning of the part | ||
| 5985 | 2026.08.18 00:07:15.332183 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_120_120_0, total 7 rows starting from the beginning of the part | ||
| 5986 | 2026.08.18 00:07:15.334032 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_121_121_0, total 8 rows starting from the beginning of the part | ||
| 5987 | 2026.08.18 00:07:15.363334 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 910 rows, containing 679 columns (679 merged, 0 gathered) in 0.04232673 sec., 21499.41656253625 rows/sec., 11.98 MiB/sec. | ||
| 5988 | 2026.08.18 00:07:15.364442 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Trace> MergedBlockOutputStream: filled checksums 202608_1_121_24 (state Temporary) | ||
| 5989 | 2026.08.18 00:07:15.367939 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_121_24 to 202608_1_121_24 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 5990 | 2026.08.18 00:07:15.367980 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_121_24} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_116_23, 202608_121_121_0] -> 202608_1_121_24 | ||
| 5991 | 2026.08.18 00:07:15.368462 [ 424473 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 5992 | 2026.08.18 00:07:16.000366 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 543.38 MiB, peak 564.06 MiB, free memory in arenas 104.33 MiB, will set to 562.54 MiB (RSS), difference: 19.16 MiB | ||
| 5993 | 2026.08.18 00:07:21.014634 [ 424414 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 5994 | 2026.08.18 00:07:21.014657 [ 424414 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 5995 | 2026.08.18 00:07:21.283850 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 291906 | ||
| 5996 | 2026.08.18 00:07:21.284997 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 5997 | 2026.08.18 00:07:21.285010 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 5998 | 2026.08.18 00:07:21.285456 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_122_122_0 (state Temporary) | ||
| 5999 | 2026.08.18 00:07:21.285587 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_122_122_0 to 202608_122_122_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6000 | 2026.08.18 00:07:21.285671 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 291906 | ||
| 6001 | 2026.08.18 00:07:22.521957 [ 424337 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345406976, merge_with_ttl_allowedtrue) | ||
| 6002 | 2026.08.18 00:07:22.521967 [ 424337 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 6003 | 2026.08.18 00:07:22.821733 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 917 | ||
| 6004 | 2026.08.18 00:07:22.829348 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6005 | 2026.08.18 00:07:22.829362 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6006 | 2026.08.18 00:07:22.832670 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_122_122_0 (state Temporary) | ||
| 6007 | 2026.08.18 00:07:22.835090 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_122_122_0 to 202608_122_122_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6008 | 2026.08.18 00:07:22.835891 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 917 | ||
| 6009 | 2026.08.18 00:07:25.680861 [ 424346 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73345021952, merge_with_ttl_allowedtrue) | ||
| 6010 | 2026.08.18 00:07:25.680875 [ 424346 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 6011 | 2026.08.18 00:07:28.785856 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 294160 | ||
| 6012 | 2026.08.18 00:07:28.786904 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6013 | 2026.08.18 00:07:28.786917 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6014 | 2026.08.18 00:07:28.787356 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_123_123_0 (state Temporary) | ||
| 6015 | 2026.08.18 00:07:28.787483 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_123_123_0 to 202608_123_123_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6016 | 2026.08.18 00:07:28.787560 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 294160 | ||
| 6017 | 2026.08.18 00:07:30.335972 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 925 | ||
| 6018 | 2026.08.18 00:07:30.343739 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6019 | 2026.08.18 00:07:30.343753 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6020 | 2026.08.18 00:07:30.347120 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_123_123_0 (state Temporary) | ||
| 6021 | 2026.08.18 00:07:30.349697 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_123_123_0 to 202608_123_123_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6022 | 2026.08.18 00:07:30.350495 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 925 | ||
| 6023 | 2026.08.18 00:07:31.000286 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 562.98 MiB, peak 571.01 MiB, free memory in arenas 103.02 MiB, will set to 561.32 MiB (RSS), difference: -1.66 MiB | ||
| 6024 | 2026.08.18 00:07:35.070962 [ 424331 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73344659456, merge_with_ttl_allowedtrue) | ||
| 6025 | 2026.08.18 00:07:35.070975 [ 424331 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 6026 | 2026.08.18 00:07:36.014743 [ 424402 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6027 | 2026.08.18 00:07:36.014777 [ 424402 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6028 | 2026.08.18 00:07:36.287755 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 296736 | ||
| 6029 | 2026.08.18 00:07:36.288820 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6030 | 2026.08.18 00:07:36.288832 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6031 | 2026.08.18 00:07:36.289277 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_124_124_0 (state Temporary) | ||
| 6032 | 2026.08.18 00:07:36.289399 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_124_124_0 to 202608_124_124_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6033 | 2026.08.18 00:07:36.289469 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 296736 | ||
| 6034 | 2026.08.18 00:07:37.850582 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 932 | ||
| 6035 | 2026.08.18 00:07:37.860026 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6036 | 2026.08.18 00:07:37.860041 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6037 | 2026.08.18 00:07:37.863468 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_124_124_0 (state Temporary) | ||
| 6038 | 2026.08.18 00:07:37.866151 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_124_124_0 to 202608_124_124_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6039 | 2026.08.18 00:07:37.866935 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 932 | ||
| 6040 | 2026.08.18 00:07:38.721773 [ 424305 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 6041 | 2026.08.18 00:07:43.658593 [ 424720 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_56_11, 202608_57_57_0, 202608_58_58_0, 202608_59_59_0, 202608_60_60_0, 202608_61_61_0] | ||
| 6042 | 2026.08.18 00:07:43.658604 [ 424720 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_56_11, 202608_57_57_0, 202608_58_58_0, 202608_59_59_0, 202608_60_60_0, 202608_61_61_0] | ||
| 6043 | 2026.08.18 00:07:43.659301 [ 424720 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_56_11, 202608_57_57_0, 202608_58_58_0, 202608_59_59_0, 202608_60_60_0, 202608_61_61_0] | ||
| 6044 | 2026.08.18 00:07:43.789663 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 298990 | ||
| 6045 | 2026.08.18 00:07:43.790768 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6046 | 2026.08.18 00:07:43.790784 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6047 | 2026.08.18 00:07:43.791240 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_125_125_0 (state Temporary) | ||
| 6048 | 2026.08.18 00:07:43.791359 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_125_125_0 to 202608_125_125_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6049 | 2026.08.18 00:07:43.791427 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 298990 | ||
| 6050 | 2026.08.18 00:07:44.401503 [ 424498 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_56_11, 202608_57_57_0, 202608_58_58_0, 202608_59_59_0, 202608_60_60_0, 202608_61_61_0] | ||
| 6051 | 2026.08.18 00:07:44.401514 [ 424498 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_56_11, 202608_57_57_0, 202608_58_58_0, 202608_59_59_0, 202608_60_60_0, 202608_61_61_0] | ||
| 6052 | 2026.08.18 00:07:44.402273 [ 424498 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_56_11, 202608_57_57_0, 202608_58_58_0, 202608_59_59_0, 202608_60_60_0, 202608_61_61_0] | ||
| 6053 | 2026.08.18 00:07:45.000268 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 557.55 MiB, peak 571.01 MiB, free memory in arenas 78.42 MiB, will set to 554.53 MiB (RSS), difference: -3.02 MiB | ||
| 6054 | 2026.08.18 00:07:45.367016 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 940 | ||
| 6055 | 2026.08.18 00:07:45.375196 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6056 | 2026.08.18 00:07:45.375208 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6057 | 2026.08.18 00:07:45.378686 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_125_125_0 (state Temporary) | ||
| 6058 | 2026.08.18 00:07:45.381271 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_125_125_0 to 202608_125_125_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6059 | 2026.08.18 00:07:45.382062 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 940 | ||
| 6060 | 2026.08.18 00:07:46.000258 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 555.24 MiB, peak 571.01 MiB, free memory in arenas 88.07 MiB, will set to 557.51 MiB (RSS), difference: 2.27 MiB | ||
| 6061 | 2026.08.18 00:07:51.014955 [ 424361 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6062 | 2026.08.18 00:07:51.014978 [ 424361 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6063 | 2026.08.18 00:07:51.291605 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 301566 | ||
| 6064 | 2026.08.18 00:07:51.292777 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6065 | 2026.08.18 00:07:51.292789 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6066 | 2026.08.18 00:07:51.293221 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_126_126_0 (state Temporary) | ||
| 6067 | 2026.08.18 00:07:51.293334 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_126_126_0 to 202608_126_126_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6068 | 2026.08.18 00:07:51.293401 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 301566 | ||
| 6069 | 2026.08.18 00:07:51.293417 [ 424321 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_121_24 to 202608_126_126_0 | ||
| 6070 | 2026.08.18 00:07:51.293449 [ 424321 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6071 | 2026.08.18 00:07:51.293456 [ 424321 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6072 | 2026.08.18 00:07:51.293549 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_121_24 to 202608_126_126_0 into Compact with storage Full | ||
| 6073 | 2026.08.18 00:07:51.293605 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 6074 | 2026.08.18 00:07:51.293620 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 37 marks from part 202608_1_121_24, total 289330 rows starting from the beginning of the part | ||
| 6075 | 2026.08.18 00:07:51.293660 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_122_122_0, total 2576 rows starting from the beginning of the part | ||
| 6076 | 2026.08.18 00:07:51.293680 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_123_123_0, total 2254 rows starting from the beginning of the part | ||
| 6077 | 2026.08.18 00:07:51.293700 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_124_124_0, total 2576 rows starting from the beginning of the part | ||
| 6078 | 2026.08.18 00:07:51.293716 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_125_125_0, total 2254 rows starting from the beginning of the part | ||
| 6079 | 2026.08.18 00:07:51.293741 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_126_126_0, total 2576 rows starting from the beginning of the part | ||
| 6080 | 2026.08.18 00:07:51.313246 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 301566 rows, containing 4 columns (4 merged, 0 gathered) in 0.019738555 sec., 15278018.07173828 rows/sec., 219.14 MiB/sec. | ||
| 6081 | 2026.08.18 00:07:51.313440 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Trace> MergedBlockOutputStream: filled checksums 202608_1_126_25 (state Temporary) | ||
| 6082 | 2026.08.18 00:07:51.313564 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_126_25 to 202608_1_126_25 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6083 | 2026.08.18 00:07:51.313587 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_126_25} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_121_24, 202608_126_126_0] -> 202608_1_126_25 | ||
| 6084 | 2026.08.18 00:07:51.313630 [ 424484 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 6085 | 2026.08.18 00:07:52.000292 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 557.53 MiB, peak 571.01 MiB, free memory in arenas 91.18 MiB, will set to 547.45 MiB (RSS), difference: -10.08 MiB | ||
| 6086 | 2026.08.18 00:07:52.882240 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 947 | ||
| 6087 | 2026.08.18 00:07:52.889892 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6088 | 2026.08.18 00:07:52.889907 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6089 | 2026.08.18 00:07:52.893288 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_126_126_0 (state Temporary) | ||
| 6090 | 2026.08.18 00:07:52.895862 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_126_126_0 to 202608_126_126_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6091 | 2026.08.18 00:07:52.896027 [ 424326 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_121_24 to 202608_126_126_0 | ||
| 6092 | 2026.08.18 00:07:52.896041 [ 424326 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6093 | 2026.08.18 00:07:52.896045 [ 424326 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6094 | 2026.08.18 00:07:52.896120 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_121_24 to 202608_126_126_0 into Compact with storage Full | ||
| 6095 | 2026.08.18 00:07:52.896767 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 947 | ||
| 6096 | 2026.08.18 00:07:52.899611 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 6097 | 2026.08.18 00:07:52.899970 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_121_24, total 910 rows starting from the beginning of the part | ||
| 6098 | 2026.08.18 00:07:52.901866 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_122_122_0, total 7 rows starting from the beginning of the part | ||
| 6099 | 2026.08.18 00:07:52.903723 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_123_123_0, total 8 rows starting from the beginning of the part | ||
| 6100 | 2026.08.18 00:07:52.905638 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_124_124_0, total 7 rows starting from the beginning of the part | ||
| 6101 | 2026.08.18 00:07:52.907500 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_125_125_0, total 8 rows starting from the beginning of the part | ||
| 6102 | 2026.08.18 00:07:52.909345 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_126_126_0, total 7 rows starting from the beginning of the part | ||
| 6103 | 2026.08.18 00:07:52.938593 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 947 rows, containing 679 columns (679 merged, 0 gathered) in 0.0425015 sec., 22281.566532945897 rows/sec., 12.35 MiB/sec. | ||
| 6104 | 2026.08.18 00:07:52.940125 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Trace> MergedBlockOutputStream: filled checksums 202608_1_126_25 (state Temporary) | ||
| 6105 | 2026.08.18 00:07:52.943643 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_126_25 to 202608_1_126_25 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6106 | 2026.08.18 00:07:52.943684 [ 424496 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_126_25} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_121_24, 202608_126_126_0] -> 202608_1_126_25 | ||
| 6107 | 2026.08.18 00:07:52.944184 [ 424496 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 6108 | 2026.08.18 00:07:53.000219 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 548.91 MiB, peak 571.01 MiB, free memory in arenas 113.16 MiB, will set to 567.99 MiB (RSS), difference: 19.08 MiB | ||
| 6109 | 2026.08.18 00:07:58.793584 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 303820 | ||
| 6110 | 2026.08.18 00:07:58.794634 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6111 | 2026.08.18 00:07:58.794652 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6112 | 2026.08.18 00:07:58.795003 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_127_127_0 (state Temporary) | ||
| 6113 | 2026.08.18 00:07:58.795145 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_127_127_0 to 202608_127_127_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6114 | 2026.08.18 00:07:58.795222 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 303820 | ||
| 6115 | 2026.08.18 00:08:00.396943 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 955 | ||
| 6116 | 2026.08.18 00:08:00.404838 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6117 | 2026.08.18 00:08:00.404851 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6118 | 2026.08.18 00:08:00.408197 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_127_127_0 (state Temporary) | ||
| 6119 | 2026.08.18 00:08:00.410794 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_127_127_0 to 202608_127_127_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6120 | 2026.08.18 00:08:00.411605 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 955 | ||
| 6121 | 2026.08.18 00:08:02.477084 [ 424333 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 300800ms, ratio: 0, points per minute: 0) | ||
| 6122 | 2026.08.18 00:08:03.272171 [ 424325 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 308775ms, ratio: 0, points per minute: 0) | ||
| 6123 | 2026.08.18 00:08:03.773778 [ 424377 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 306805ms, ratio: 0, points per minute: 0) | ||
| 6124 | 2026.08.18 00:08:06.015161 [ 424310 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6125 | 2026.08.18 00:08:06.015184 [ 424310 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6126 | 2026.08.18 00:08:06.295405 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 306396 | ||
| 6127 | 2026.08.18 00:08:06.296480 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6128 | 2026.08.18 00:08:06.296491 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6129 | 2026.08.18 00:08:06.296953 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_128_128_0 (state Temporary) | ||
| 6130 | 2026.08.18 00:08:06.297078 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_128_128_0 to 202608_128_128_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6131 | 2026.08.18 00:08:06.297152 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 306396 | ||
| 6132 | 2026.08.18 00:08:07.000657 [ 425081 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 7.134e-05 sec. | ||
| 6133 | 2026.08.18 00:08:07.911775 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 962 | ||
| 6134 | 2026.08.18 00:08:07.920379 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6135 | 2026.08.18 00:08:07.920393 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6136 | 2026.08.18 00:08:07.923824 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_128_128_0 (state Temporary) | ||
| 6137 | 2026.08.18 00:08:07.926420 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_128_128_0 to 202608_128_128_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6138 | 2026.08.18 00:08:07.927220 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 962 | ||
| 6139 | 2026.08.18 00:08:08.952163 [ 424421 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 305666ms, ratio: 0, points per minute: 0) | ||
| 6140 | 2026.08.18 00:08:09.964027 [ 424352 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307849ms, ratio: 0, points per minute: 0) | ||
| 6141 | 2026.08.18 00:08:10.113218 [ 424401 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73344335872, merge_with_ttl_allowedtrue) | ||
| 6142 | 2026.08.18 00:08:10.113232 [ 424401 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 6143 | 2026.08.18 00:08:13.797246 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 308650 | ||
| 6144 | 2026.08.18 00:08:13.798348 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6145 | 2026.08.18 00:08:13.798360 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6146 | 2026.08.18 00:08:13.798831 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_129_129_0 (state Temporary) | ||
| 6147 | 2026.08.18 00:08:13.798956 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_129_129_0 to 202608_129_129_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6148 | 2026.08.18 00:08:13.799032 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 308650 | ||
| 6149 | 2026.08.18 00:08:15.427393 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 970 | ||
| 6150 | 2026.08.18 00:08:15.435875 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6151 | 2026.08.18 00:08:15.435891 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6152 | 2026.08.18 00:08:15.439308 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_129_129_0 (state Temporary) | ||
| 6153 | 2026.08.18 00:08:15.441887 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_129_129_0 to 202608_129_129_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6154 | 2026.08.18 00:08:15.442706 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 970 | ||
| 6155 | 2026.08.18 00:08:21.015278 [ 424308 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6156 | 2026.08.18 00:08:21.015304 [ 424308 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6157 | 2026.08.18 00:08:21.247281 [ 424559 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_61_12, 202608_62_62_0, 202608_63_63_0, 202608_64_64_0, 202608_65_65_0, 202608_66_66_0] | ||
| 6158 | 2026.08.18 00:08:21.247290 [ 424559 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_61_12, 202608_62_62_0, 202608_63_63_0, 202608_64_64_0, 202608_65_65_0, 202608_66_66_0] | ||
| 6159 | 2026.08.18 00:08:21.247967 [ 424559 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_61_12, 202608_62_62_0, 202608_63_63_0, 202608_64_64_0, 202608_65_65_0, 202608_66_66_0] | ||
| 6160 | 2026.08.18 00:08:21.299303 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 311226 | ||
| 6161 | 2026.08.18 00:08:21.300348 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6162 | 2026.08.18 00:08:21.300359 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6163 | 2026.08.18 00:08:21.300805 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_130_130_0 (state Temporary) | ||
| 6164 | 2026.08.18 00:08:21.300928 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_130_130_0 to 202608_130_130_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6165 | 2026.08.18 00:08:21.300995 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 311226 | ||
| 6166 | 2026.08.18 00:08:22.320439 [ 424555 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_61_12, 202608_62_62_0, 202608_63_63_0, 202608_64_64_0, 202608_65_65_0, 202608_66_66_0] | ||
| 6167 | 2026.08.18 00:08:22.320447 [ 424555 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_61_12, 202608_62_62_0, 202608_63_63_0, 202608_64_64_0, 202608_65_65_0, 202608_66_66_0] | ||
| 6168 | 2026.08.18 00:08:22.321193 [ 424555 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_61_12, 202608_62_62_0, 202608_63_63_0, 202608_64_64_0, 202608_65_65_0, 202608_66_66_0] | ||
| 6169 | 2026.08.18 00:08:22.522098 [ 424409 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73344589824, merge_with_ttl_allowedtrue) | ||
| 6170 | 2026.08.18 00:08:22.522116 [ 424409 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 6171 | 2026.08.18 00:08:22.942872 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 977 | ||
| 6172 | 2026.08.18 00:08:22.950095 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6173 | 2026.08.18 00:08:22.950108 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6174 | 2026.08.18 00:08:22.953521 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_130_130_0 (state Temporary) | ||
| 6175 | 2026.08.18 00:08:22.956129 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_130_130_0 to 202608_130_130_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6176 | 2026.08.18 00:08:22.956907 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 977 | ||
| 6177 | 2026.08.18 00:08:23.000294 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 566.88 MiB, peak 578.34 MiB, free memory in arenas 104.40 MiB, will set to 561.07 MiB (RSS), difference: -5.81 MiB | ||
| 6178 | 2026.08.18 00:08:25.000285 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 561.07 MiB, peak 578.34 MiB, free memory in arenas 103.03 MiB, will set to 559.74 MiB (RSS), difference: -1.33 MiB | ||
| 6179 | 2026.08.18 00:08:25.681064 [ 424286 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73344989184, merge_with_ttl_allowedtrue) | ||
| 6180 | 2026.08.18 00:08:25.681084 [ 424286 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 6181 | 2026.08.18 00:08:28.801268 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 313480 | ||
| 6182 | 2026.08.18 00:08:28.802247 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6183 | 2026.08.18 00:08:28.802259 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6184 | 2026.08.18 00:08:28.802713 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_131_131_0 (state Temporary) | ||
| 6185 | 2026.08.18 00:08:28.802839 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_131_131_0 to 202608_131_131_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6186 | 2026.08.18 00:08:28.802909 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 313480 | ||
| 6187 | 2026.08.18 00:08:28.802911 [ 424336 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_126_25 to 202608_131_131_0 | ||
| 6188 | 2026.08.18 00:08:28.802936 [ 424336 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6189 | 2026.08.18 00:08:28.802940 [ 424336 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6190 | 2026.08.18 00:08:28.803014 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_126_25 to 202608_131_131_0 into Compact with storage Full | ||
| 6191 | 2026.08.18 00:08:28.803070 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 6192 | 2026.08.18 00:08:28.803085 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 38 marks from part 202608_1_126_25, total 301566 rows starting from the beginning of the part | ||
| 6193 | 2026.08.18 00:08:28.803126 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_127_127_0, total 2254 rows starting from the beginning of the part | ||
| 6194 | 2026.08.18 00:08:28.803154 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_128_128_0, total 2576 rows starting from the beginning of the part | ||
| 6195 | 2026.08.18 00:08:28.803171 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_129_129_0, total 2254 rows starting from the beginning of the part | ||
| 6196 | 2026.08.18 00:08:28.803187 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_130_130_0, total 2576 rows starting from the beginning of the part | ||
| 6197 | 2026.08.18 00:08:28.803207 [ 424494 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_131_131_0, total 2254 rows starting from the beginning of the part | ||
| 6198 | 2026.08.18 00:08:28.822620 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 313480 rows, containing 4 columns (4 merged, 0 gathered) in 0.019641724 sec., 15959902.50143012 rows/sec., 228.89 MiB/sec. | ||
| 6199 | 2026.08.18 00:08:28.822839 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Trace> MergedBlockOutputStream: filled checksums 202608_1_131_26 (state Temporary) | ||
| 6200 | 2026.08.18 00:08:28.822975 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_131_26 to 202608_1_131_26 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6201 | 2026.08.18 00:08:28.822997 [ 424484 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_131_26} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_126_25, 202608_131_131_0] -> 202608_1_131_26 | ||
| 6202 | 2026.08.18 00:08:28.823040 [ 424484 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.76 MiB. | ||
| 6203 | 2026.08.18 00:08:29.000211 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 559.74 MiB, peak 578.34 MiB, free memory in arenas 104.92 MiB, will set to 561.81 MiB (RSS), difference: 2.08 MiB | ||
| 6204 | 2026.08.18 00:08:30.457073 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 985 | ||
| 6205 | 2026.08.18 00:08:30.464576 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6206 | 2026.08.18 00:08:30.464589 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6207 | 2026.08.18 00:08:30.467892 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_131_131_0 (state Temporary) | ||
| 6208 | 2026.08.18 00:08:30.470413 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_131_131_0 to 202608_131_131_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6209 | 2026.08.18 00:08:30.470580 [ 424406 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_126_25 to 202608_131_131_0 | ||
| 6210 | 2026.08.18 00:08:30.470593 [ 424406 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6211 | 2026.08.18 00:08:30.470598 [ 424406 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6212 | 2026.08.18 00:08:30.470676 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_126_25 to 202608_131_131_0 into Compact with storage Full | ||
| 6213 | 2026.08.18 00:08:30.471308 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 985 | ||
| 6214 | 2026.08.18 00:08:30.474880 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 6215 | 2026.08.18 00:08:30.475227 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_126_25, total 947 rows starting from the beginning of the part | ||
| 6216 | 2026.08.18 00:08:30.477031 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_127_127_0, total 8 rows starting from the beginning of the part | ||
| 6217 | 2026.08.18 00:08:30.478778 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_128_128_0, total 7 rows starting from the beginning of the part | ||
| 6218 | 2026.08.18 00:08:30.480586 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_129_129_0, total 8 rows starting from the beginning of the part | ||
| 6219 | 2026.08.18 00:08:30.482375 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_130_130_0, total 7 rows starting from the beginning of the part | ||
| 6220 | 2026.08.18 00:08:30.484163 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_131_131_0, total 8 rows starting from the beginning of the part | ||
| 6221 | 2026.08.18 00:08:30.513592 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 985 rows, containing 679 columns (679 merged, 0 gathered) in 0.042944941 sec., 22936.345400963528 rows/sec., 12.68 MiB/sec. | ||
| 6222 | 2026.08.18 00:08:30.514817 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Trace> MergedBlockOutputStream: filled checksums 202608_1_131_26 (state Temporary) | ||
| 6223 | 2026.08.18 00:08:30.518248 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_131_26 to 202608_1_131_26 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6224 | 2026.08.18 00:08:30.518290 [ 424489 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_131_26} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_126_25, 202608_131_131_0] -> 202608_1_131_26 | ||
| 6225 | 2026.08.18 00:08:30.518738 [ 424489 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 18.63 MiB. | ||
| 6226 | 2026.08.18 00:08:31.000361 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 563.27 MiB, peak 581.15 MiB, free memory in arenas 104.50 MiB, will set to 567.90 MiB (RSS), difference: 4.63 MiB | ||
| 6227 | 2026.08.18 00:08:35.071171 [ 424388 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73344899072, merge_with_ttl_allowedtrue) | ||
| 6228 | 2026.08.18 00:08:35.071183 [ 424388 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 6229 | 2026.08.18 00:08:36.015392 [ 424363 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6230 | 2026.08.18 00:08:36.015412 [ 424363 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6231 | 2026.08.18 00:08:36.303078 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 316056 | ||
| 6232 | 2026.08.18 00:08:36.304426 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6233 | 2026.08.18 00:08:36.304439 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6234 | 2026.08.18 00:08:36.304900 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_132_132_0 (state Temporary) | ||
| 6235 | 2026.08.18 00:08:36.305024 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_132_132_0 to 202608_132_132_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6236 | 2026.08.18 00:08:36.305103 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 316056 | ||
| 6237 | 2026.08.18 00:08:37.000267 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 567.91 MiB, peak 581.15 MiB, free memory in arenas 105.10 MiB, will set to 566.25 MiB (RSS), difference: -1.66 MiB | ||
| 6238 | 2026.08.18 00:08:37.971382 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 992 | ||
| 6239 | 2026.08.18 00:08:37.979175 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6240 | 2026.08.18 00:08:37.979189 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6241 | 2026.08.18 00:08:37.982548 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_132_132_0 (state Temporary) | ||
| 6242 | 2026.08.18 00:08:37.985203 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_132_132_0 to 202608_132_132_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6243 | 2026.08.18 00:08:37.986006 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 992 | ||
| 6244 | 2026.08.18 00:08:38.721978 [ 424371 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 6245 | 2026.08.18 00:08:43.805283 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 318310 | ||
| 6246 | 2026.08.18 00:08:43.806269 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6247 | 2026.08.18 00:08:43.806285 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6248 | 2026.08.18 00:08:43.806608 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_133_133_0 (state Temporary) | ||
| 6249 | 2026.08.18 00:08:43.806730 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_133_133_0 to 202608_133_133_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6250 | 2026.08.18 00:08:43.806802 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 318310 | ||
| 6251 | 2026.08.18 00:08:45.486179 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 1000 | ||
| 6252 | 2026.08.18 00:08:45.493962 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6253 | 2026.08.18 00:08:45.493976 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6254 | 2026.08.18 00:08:45.497448 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_133_133_0 (state Temporary) | ||
| 6255 | 2026.08.18 00:08:45.500094 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_133_133_0 to 202608_133_133_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6256 | 2026.08.18 00:08:45.500906 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1000 | ||
| 6257 | 2026.08.18 00:08:51.015499 [ 424359 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6258 | 2026.08.18 00:08:51.015519 [ 424359 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6259 | 2026.08.18 00:08:51.306969 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 320886 | ||
| 6260 | 2026.08.18 00:08:51.308109 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6261 | 2026.08.18 00:08:51.308122 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6262 | 2026.08.18 00:08:51.308560 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_134_134_0 (state Temporary) | ||
| 6263 | 2026.08.18 00:08:51.308684 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_134_134_0 to 202608_134_134_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6264 | 2026.08.18 00:08:51.308754 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 320886 | ||
| 6265 | 2026.08.18 00:08:53.000991 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 1007 | ||
| 6266 | 2026.08.18 00:08:53.008015 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6267 | 2026.08.18 00:08:53.008027 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6268 | 2026.08.18 00:08:53.011361 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_134_134_0 (state Temporary) | ||
| 6269 | 2026.08.18 00:08:53.013825 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_134_134_0 to 202608_134_134_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6270 | 2026.08.18 00:08:53.014637 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1007 | ||
| 6271 | 2026.08.18 00:08:58.537080 [ 424498 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_66_13, 202608_67_67_0, 202608_68_68_0, 202608_69_69_0, 202608_70_70_0, 202608_71_71_0] | ||
| 6272 | 2026.08.18 00:08:58.537093 [ 424498 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_66_13, 202608_67_67_0, 202608_68_68_0, 202608_69_69_0, 202608_70_70_0, 202608_71_71_0] | ||
| 6273 | 2026.08.18 00:08:58.537776 [ 424498 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_66_13, 202608_67_67_0, 202608_68_68_0, 202608_69_69_0, 202608_70_70_0, 202608_71_71_0] | ||
| 6274 | 2026.08.18 00:08:58.808936 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 323140 | ||
| 6275 | 2026.08.18 00:08:58.809998 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6276 | 2026.08.18 00:08:58.810009 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6277 | 2026.08.18 00:08:58.810451 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_135_135_0 (state Temporary) | ||
| 6278 | 2026.08.18 00:08:58.810568 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_135_135_0 to 202608_135_135_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6279 | 2026.08.18 00:08:58.810637 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 323140 | ||
| 6280 | 2026.08.18 00:08:59.194057 [ 424559 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_66_13, 202608_67_67_0, 202608_68_68_0, 202608_69_69_0, 202608_70_70_0, 202608_71_71_0] | ||
| 6281 | 2026.08.18 00:08:59.194067 [ 424559 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_66_13, 202608_67_67_0, 202608_68_68_0, 202608_69_69_0, 202608_70_70_0, 202608_71_71_0] | ||
| 6282 | 2026.08.18 00:08:59.194820 [ 424559 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_66_13, 202608_67_67_0, 202608_68_68_0, 202608_69_69_0, 202608_70_70_0, 202608_71_71_0] | ||
| 6283 | 2026.08.18 00:09:00.000296 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 563.31 MiB, peak 581.15 MiB, free memory in arenas 81.17 MiB, will set to 564.70 MiB (RSS), difference: 1.39 MiB | ||
| 6284 | 2026.08.18 00:09:00.514800 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 1015 | ||
| 6285 | 2026.08.18 00:09:00.521991 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6286 | 2026.08.18 00:09:00.522006 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6287 | 2026.08.18 00:09:00.525351 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_135_135_0 (state Temporary) | ||
| 6288 | 2026.08.18 00:09:00.527815 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_135_135_0 to 202608_135_135_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6289 | 2026.08.18 00:09:00.528616 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1015 | ||
| 6290 | 2026.08.18 00:09:01.000202 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 565.41 MiB, peak 581.15 MiB, free memory in arenas 90.26 MiB, will set to 563.75 MiB (RSS), difference: -1.66 MiB | ||
| 6291 | 2026.08.18 00:09:06.015602 [ 424373 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6292 | 2026.08.18 00:09:06.015627 [ 424373 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6293 | 2026.08.18 00:09:06.310818 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 325716 | ||
| 6294 | 2026.08.18 00:09:06.311943 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6295 | 2026.08.18 00:09:06.311955 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6296 | 2026.08.18 00:09:06.312434 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_136_136_0 (state Temporary) | ||
| 6297 | 2026.08.18 00:09:06.312562 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_136_136_0 to 202608_136_136_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6298 | 2026.08.18 00:09:06.312640 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 325716 | ||
| 6299 | 2026.08.18 00:09:06.312646 [ 424328 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_131_26 to 202608_136_136_0 | ||
| 6300 | 2026.08.18 00:09:06.312675 [ 424328 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6301 | 2026.08.18 00:09:06.312682 [ 424328 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6302 | 2026.08.18 00:09:06.312774 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_131_26 to 202608_136_136_0 into Compact with storage Full | ||
| 6303 | 2026.08.18 00:09:06.312836 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 6304 | 2026.08.18 00:09:06.312851 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 40 marks from part 202608_1_131_26, total 313480 rows starting from the beginning of the part | ||
| 6305 | 2026.08.18 00:09:06.312892 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_132_132_0, total 2576 rows starting from the beginning of the part | ||
| 6306 | 2026.08.18 00:09:06.312914 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_133_133_0, total 2254 rows starting from the beginning of the part | ||
| 6307 | 2026.08.18 00:09:06.312939 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_134_134_0, total 2576 rows starting from the beginning of the part | ||
| 6308 | 2026.08.18 00:09:06.312957 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_135_135_0, total 2254 rows starting from the beginning of the part | ||
| 6309 | 2026.08.18 00:09:06.312998 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_136_136_0, total 2576 rows starting from the beginning of the part | ||
| 6310 | 2026.08.18 00:09:06.333150 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 325716 rows, containing 4 columns (4 merged, 0 gathered) in 0.020419795 sec., 15950992.651983038 rows/sec., 228.75 MiB/sec. | ||
| 6311 | 2026.08.18 00:09:06.333363 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Trace> MergedBlockOutputStream: filled checksums 202608_1_136_27 (state Temporary) | ||
| 6312 | 2026.08.18 00:09:06.333493 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_136_27 to 202608_1_136_27 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6313 | 2026.08.18 00:09:06.333516 [ 424474 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_136_27} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_131_26, 202608_136_136_0] -> 202608_1_136_27 | ||
| 6314 | 2026.08.18 00:09:06.333561 [ 424474 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.78 MiB. | ||
| 6315 | 2026.08.18 00:09:07.000286 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 563.89 MiB, peak 581.15 MiB, free memory in arenas 113.76 MiB, will set to 566.45 MiB (RSS), difference: 2.56 MiB | ||
| 6316 | 2026.08.18 00:09:08.028700 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 1023 | ||
| 6317 | 2026.08.18 00:09:08.036483 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6318 | 2026.08.18 00:09:08.036497 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6319 | 2026.08.18 00:09:08.039846 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_136_136_0 (state Temporary) | ||
| 6320 | 2026.08.18 00:09:08.042315 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_136_136_0 to 202608_136_136_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6321 | 2026.08.18 00:09:08.042474 [ 424407 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_131_26 to 202608_136_136_0 | ||
| 6322 | 2026.08.18 00:09:08.042488 [ 424407 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6323 | 2026.08.18 00:09:08.042492 [ 424407 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6324 | 2026.08.18 00:09:08.042565 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_131_26 to 202608_136_136_0 into Compact with storage Full | ||
| 6325 | 2026.08.18 00:09:08.043162 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1023 | ||
| 6326 | 2026.08.18 00:09:08.045931 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 6327 | 2026.08.18 00:09:08.046296 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_131_26, total 985 rows starting from the beginning of the part | ||
| 6328 | 2026.08.18 00:09:08.048378 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_132_132_0, total 7 rows starting from the beginning of the part | ||
| 6329 | 2026.08.18 00:09:08.050260 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_133_133_0, total 8 rows starting from the beginning of the part | ||
| 6330 | 2026.08.18 00:09:08.052177 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_134_134_0, total 7 rows starting from the beginning of the part | ||
| 6331 | 2026.08.18 00:09:08.054013 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_135_135_0, total 8 rows starting from the beginning of the part | ||
| 6332 | 2026.08.18 00:09:08.055880 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_136_136_0, total 8 rows starting from the beginning of the part | ||
| 6333 | 2026.08.18 00:09:08.086819 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 1023 rows, containing 679 columns (679 merged, 0 gathered) in 0.044278552 sec., 23103.73654495296 rows/sec., 12.70 MiB/sec. | ||
| 6334 | 2026.08.18 00:09:08.088386 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Trace> MergedBlockOutputStream: filled checksums 202608_1_136_27 (state Temporary) | ||
| 6335 | 2026.08.18 00:09:08.092021 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_136_27 to 202608_1_136_27 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6336 | 2026.08.18 00:09:08.092073 [ 424494 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_136_27} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_131_26, 202608_136_136_0] -> 202608_1_136_27 | ||
| 6337 | 2026.08.18 00:09:08.092632 [ 424494 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 20.18 MiB. | ||
| 6338 | 2026.08.18 00:09:09.000376 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 567.94 MiB, peak 587.34 MiB, free memory in arenas 141.91 MiB, will set to 592.18 MiB (RSS), difference: 24.24 MiB | ||
| 6339 | 2026.08.18 00:09:10.113437 [ 424358 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73344575488, merge_with_ttl_allowedtrue) | ||
| 6340 | 2026.08.18 00:09:10.113453 [ 424358 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 6341 | 2026.08.18 00:09:13.812816 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 327970 | ||
| 6342 | 2026.08.18 00:09:13.813910 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6343 | 2026.08.18 00:09:13.813924 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6344 | 2026.08.18 00:09:13.814315 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_137_137_0 (state Temporary) | ||
| 6345 | 2026.08.18 00:09:13.815334 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_137_137_0 to 202608_137_137_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6346 | 2026.08.18 00:09:13.815418 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 327970 | ||
| 6347 | 2026.08.18 00:09:14.000312 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 592.18 MiB, peak 600.39 MiB, free memory in arenas 130.11 MiB, will set to 584.69 MiB (RSS), difference: -7.49 MiB | ||
| 6348 | 2026.08.18 00:09:15.543247 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 1030 | ||
| 6349 | 2026.08.18 00:09:15.551274 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6350 | 2026.08.18 00:09:15.551287 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6351 | 2026.08.18 00:09:15.554675 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_137_137_0 (state Temporary) | ||
| 6352 | 2026.08.18 00:09:15.557216 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_137_137_0 to 202608_137_137_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6353 | 2026.08.18 00:09:15.558014 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1030 | ||
| 6354 | 2026.08.18 00:09:21.015719 [ 424305 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6355 | 2026.08.18 00:09:21.015746 [ 424305 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6356 | 2026.08.18 00:09:21.315511 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 330546 | ||
| 6357 | 2026.08.18 00:09:21.316588 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6358 | 2026.08.18 00:09:21.316599 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6359 | 2026.08.18 00:09:21.318690 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_138_138_0 (state Temporary) | ||
| 6360 | 2026.08.18 00:09:21.318816 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_138_138_0 to 202608_138_138_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6361 | 2026.08.18 00:09:21.318893 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 330546 | ||
| 6362 | 2026.08.18 00:09:22.000194 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 585.23 MiB, peak 600.39 MiB, free memory in arenas 113.20 MiB, will set to 575.55 MiB (RSS), difference: -9.68 MiB | ||
| 6363 | 2026.08.18 00:09:22.522301 [ 424399 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73343948800, merge_with_ttl_allowedtrue) | ||
| 6364 | 2026.08.18 00:09:22.522312 [ 424399 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 6365 | 2026.08.18 00:09:23.058178 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 1038 | ||
| 6366 | 2026.08.18 00:09:23.065639 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6367 | 2026.08.18 00:09:23.065652 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6368 | 2026.08.18 00:09:23.068987 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_138_138_0 (state Temporary) | ||
| 6369 | 2026.08.18 00:09:23.071550 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_138_138_0 to 202608_138_138_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6370 | 2026.08.18 00:09:23.072346 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1038 | ||
| 6371 | 2026.08.18 00:09:25.681293 [ 424422 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73343670272, merge_with_ttl_allowedtrue) | ||
| 6372 | 2026.08.18 00:09:25.681306 [ 424422 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 6373 | 2026.08.18 00:09:28.819066 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 332800 | ||
| 6374 | 2026.08.18 00:09:28.820856 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6375 | 2026.08.18 00:09:28.820868 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6376 | 2026.08.18 00:09:28.821305 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_139_139_0 (state Temporary) | ||
| 6377 | 2026.08.18 00:09:28.821424 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_139_139_0 to 202608_139_139_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6378 | 2026.08.18 00:09:28.821494 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 332800 | ||
| 6379 | 2026.08.18 00:09:29.000259 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 576.31 MiB, peak 600.39 MiB, free memory in arenas 113.04 MiB, will set to 565.59 MiB (RSS), difference: -10.72 MiB | ||
| 6380 | 2026.08.18 00:09:30.572505 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 1045 | ||
| 6381 | 2026.08.18 00:09:30.580066 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6382 | 2026.08.18 00:09:30.580080 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6383 | 2026.08.18 00:09:30.583508 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_139_139_0 (state Temporary) | ||
| 6384 | 2026.08.18 00:09:30.586011 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_139_139_0 to 202608_139_139_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6385 | 2026.08.18 00:09:30.586814 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1045 | ||
| 6386 | 2026.08.18 00:09:35.071369 [ 424411 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73343307776, merge_with_ttl_allowedtrue) | ||
| 6387 | 2026.08.18 00:09:35.071385 [ 424411 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 6388 | 2026.08.18 00:09:36.015922 [ 424341 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6389 | 2026.08.18 00:09:36.015942 [ 424341 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6390 | 2026.08.18 00:09:36.321689 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 335376 | ||
| 6391 | 2026.08.18 00:09:36.322754 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6392 | 2026.08.18 00:09:36.322766 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6393 | 2026.08.18 00:09:36.323104 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_140_140_0 (state Temporary) | ||
| 6394 | 2026.08.18 00:09:36.323233 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_140_140_0 to 202608_140_140_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6395 | 2026.08.18 00:09:36.323302 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 335376 | ||
| 6396 | 2026.08.18 00:09:37.272536 [ 424555 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_71_14, 202608_72_72_0, 202608_73_73_0, 202608_74_74_0, 202608_75_75_0, 202608_76_76_0] | ||
| 6397 | 2026.08.18 00:09:37.272544 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_71_14, 202608_72_72_0, 202608_73_73_0, 202608_74_74_0, 202608_75_75_0, 202608_76_76_0] | ||
| 6398 | 2026.08.18 00:09:37.273182 [ 424555 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_71_14, 202608_72_72_0, 202608_73_73_0, 202608_74_74_0, 202608_75_75_0, 202608_76_76_0] | ||
| 6399 | 2026.08.18 00:09:38.086980 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 1053 | ||
| 6400 | 2026.08.18 00:09:38.094370 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6401 | 2026.08.18 00:09:38.094384 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6402 | 2026.08.18 00:09:38.097804 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_140_140_0 (state Temporary) | ||
| 6403 | 2026.08.18 00:09:38.100418 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_140_140_0 to 202608_140_140_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6404 | 2026.08.18 00:09:38.100625 [ 424720 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_71_14, 202608_72_72_0, 202608_73_73_0, 202608_74_74_0, 202608_75_75_0, 202608_76_76_0] | ||
| 6405 | 2026.08.18 00:09:38.100635 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_71_14, 202608_72_72_0, 202608_73_73_0, 202608_74_74_0, 202608_75_75_0, 202608_76_76_0] | ||
| 6406 | 2026.08.18 00:09:38.101220 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1053 | ||
| 6407 | 2026.08.18 00:09:38.101419 [ 424720 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_71_14, 202608_72_72_0, 202608_73_73_0, 202608_74_74_0, 202608_75_75_0, 202608_76_76_0] | ||
| 6408 | 2026.08.18 00:09:38.722163 [ 424290 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||
| 6409 | 2026.08.18 00:09:39.000321 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 563.00 MiB, peak 600.39 MiB, free memory in arenas 105.27 MiB, will set to 551.02 MiB (RSS), difference: -11.98 MiB | ||
| 6410 | 2026.08.18 00:09:43.823395 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 337630 | ||
| 6411 | 2026.08.18 00:09:43.824461 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6412 | 2026.08.18 00:09:43.824474 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6413 | 2026.08.18 00:09:43.824905 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_141_141_0 (state Temporary) | ||
| 6414 | 2026.08.18 00:09:43.825020 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_141_141_0 to 202608_141_141_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6415 | 2026.08.18 00:09:43.825098 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 337630 | ||
| 6416 | 2026.08.18 00:09:43.825099 [ 424418 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_136_27 to 202608_141_141_0 | ||
| 6417 | 2026.08.18 00:09:43.825118 [ 424418 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6418 | 2026.08.18 00:09:43.825122 [ 424418 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6419 | 2026.08.18 00:09:43.825210 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_136_27 to 202608_141_141_0 into Compact with storage Full | ||
| 6420 | 2026.08.18 00:09:43.825283 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 6421 | 2026.08.18 00:09:43.825297 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 41 marks from part 202608_1_136_27, total 325716 rows starting from the beginning of the part | ||
| 6422 | 2026.08.18 00:09:43.825338 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_137_137_0, total 2254 rows starting from the beginning of the part | ||
| 6423 | 2026.08.18 00:09:43.825359 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_138_138_0, total 2576 rows starting from the beginning of the part | ||
| 6424 | 2026.08.18 00:09:43.825387 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_139_139_0, total 2254 rows starting from the beginning of the part | ||
| 6425 | 2026.08.18 00:09:43.825402 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_140_140_0, total 2576 rows starting from the beginning of the part | ||
| 6426 | 2026.08.18 00:09:43.825419 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_141_141_0, total 2254 rows starting from the beginning of the part | ||
| 6427 | 2026.08.18 00:09:43.845925 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 337630 rows, containing 4 columns (4 merged, 0 gathered) in 0.020753965 sec., 16268216.699796883 rows/sec., 233.27 MiB/sec. | ||
| 6428 | 2026.08.18 00:09:43.846081 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Trace> MergedBlockOutputStream: filled checksums 202608_1_141_28 (state Temporary) | ||
| 6429 | 2026.08.18 00:09:43.846216 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_141_28 to 202608_1_141_28 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6430 | 2026.08.18 00:09:43.846240 [ 424466 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_141_28} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_136_27, 202608_141_141_0] -> 202608_1_141_28 | ||
| 6431 | 2026.08.18 00:09:43.846284 [ 424466 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.78 MiB. | ||
| 6432 | 2026.08.18 00:09:45.601304 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 1060 | ||
| 6433 | 2026.08.18 00:09:45.608398 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6434 | 2026.08.18 00:09:45.608412 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6435 | 2026.08.18 00:09:45.611745 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_141_141_0 (state Temporary) | ||
| 6436 | 2026.08.18 00:09:45.614179 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_141_141_0 to 202608_141_141_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6437 | 2026.08.18 00:09:45.614350 [ 424358 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_136_27 to 202608_141_141_0 | ||
| 6438 | 2026.08.18 00:09:45.614364 [ 424358 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6439 | 2026.08.18 00:09:45.614368 [ 424358 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.62 GiB. | ||
| 6440 | 2026.08.18 00:09:45.614441 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_136_27 to 202608_141_141_0 into Compact with storage Full | ||
| 6441 | 2026.08.18 00:09:45.615248 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1060 | ||
| 6442 | 2026.08.18 00:09:45.618190 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 6443 | 2026.08.18 00:09:45.618511 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_136_27, total 1023 rows starting from the beginning of the part | ||
| 6444 | 2026.08.18 00:09:45.620293 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_137_137_0, total 7 rows starting from the beginning of the part | ||
| 6445 | 2026.08.18 00:09:45.622009 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_138_138_0, total 8 rows starting from the beginning of the part | ||
| 6446 | 2026.08.18 00:09:45.623773 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_139_139_0, total 7 rows starting from the beginning of the part | ||
| 6447 | 2026.08.18 00:09:45.625452 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_140_140_0, total 8 rows starting from the beginning of the part | ||
| 6448 | 2026.08.18 00:09:45.627135 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_141_141_0, total 7 rows starting from the beginning of the part | ||
| 6449 | 2026.08.18 00:09:45.658242 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 1060 rows, containing 679 columns (679 merged, 0 gathered) in 0.043827811 sec., 24185.556517983525 rows/sec., 13.24 MiB/sec. | ||
| 6450 | 2026.08.18 00:09:45.659833 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Trace> MergedBlockOutputStream: filled checksums 202608_1_141_28 (state Temporary) | ||
| 6451 | 2026.08.18 00:09:45.663540 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_141_28 to 202608_1_141_28 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6452 | 2026.08.18 00:09:45.663597 [ 424473 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_141_28} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_136_27, 202608_141_141_0] -> 202608_1_141_28 | ||
| 6453 | 2026.08.18 00:09:45.664198 [ 424473 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 26.64 MiB. | ||
| 6454 | 2026.08.18 00:09:46.000315 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 553.16 MiB, peak 600.39 MiB, free memory in arenas 126.84 MiB, will set to 569.43 MiB (RSS), difference: 16.28 MiB | ||
| 6455 | 2026.08.18 00:09:51.016118 [ 424421 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6456 | 2026.08.18 00:09:51.016140 [ 424421 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6457 | 2026.08.18 00:09:51.325193 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 340206 | ||
| 6458 | 2026.08.18 00:09:51.326420 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6459 | 2026.08.18 00:09:51.326432 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6460 | 2026.08.18 00:09:51.326882 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_142_142_0 (state Temporary) | ||
| 6461 | 2026.08.18 00:09:51.327004 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_142_142_0 to 202608_142_142_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6462 | 2026.08.18 00:09:51.327077 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 340206 | ||
| 6463 | 2026.08.18 00:09:53.115333 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 1068 | ||
| 6464 | 2026.08.18 00:09:53.123628 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6465 | 2026.08.18 00:09:53.123644 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6466 | 2026.08.18 00:09:53.126982 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_142_142_0 (state Temporary) | ||
| 6467 | 2026.08.18 00:09:53.129434 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_142_142_0 to 202608_142_142_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6468 | 2026.08.18 00:09:53.130254 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1068 | ||
| 6469 | 2026.08.18 00:09:54.000488 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 570.08 MiB, peak 600.39 MiB, free memory in arenas 124.52 MiB, will set to 567.89 MiB (RSS), difference: -2.20 MiB | ||
| 6470 | 2026.08.18 00:09:58.827174 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 342460 | ||
| 6471 | 2026.08.18 00:09:58.828168 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6472 | 2026.08.18 00:09:58.828180 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6473 | 2026.08.18 00:09:58.828503 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_143_143_0 (state Temporary) | ||
| 6474 | 2026.08.18 00:09:58.828622 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_143_143_0 to 202608_143_143_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6475 | 2026.08.18 00:09:58.828693 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 342460 | ||
| 6476 | 2026.08.18 00:10:00.630329 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 1075 | ||
| 6477 | 2026.08.18 00:10:00.637984 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6478 | 2026.08.18 00:10:00.637998 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6479 | 2026.08.18 00:10:00.641416 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_143_143_0 (state Temporary) | ||
| 6480 | 2026.08.18 00:10:00.644026 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_143_143_0 to 202608_143_143_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6481 | 2026.08.18 00:10:00.644848 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1075 | ||
| 6482 | 2026.08.18 00:10:01.000289 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 568.68 MiB, peak 600.39 MiB, free memory in arenas 124.27 MiB, will set to 567.66 MiB (RSS), difference: -1.02 MiB | ||
| 6483 | 2026.08.18 00:10:06.016314 [ 424420 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6484 | 2026.08.18 00:10:06.016341 [ 424420 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6485 | 2026.08.18 00:10:06.328975 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 345036 | ||
| 6486 | 2026.08.18 00:10:06.330082 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6487 | 2026.08.18 00:10:06.330094 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6488 | 2026.08.18 00:10:06.330561 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_144_144_0 (state Temporary) | ||
| 6489 | 2026.08.18 00:10:06.330684 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_144_144_0 to 202608_144_144_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6490 | 2026.08.18 00:10:06.330758 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 345036 | ||
| 6491 | 2026.08.18 00:10:07.000587 [ 425081 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 8.282e-05 sec. | ||
| 6492 | 2026.08.18 00:10:08.145019 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 1083 | ||
| 6493 | 2026.08.18 00:10:08.153214 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6494 | 2026.08.18 00:10:08.153229 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6495 | 2026.08.18 00:10:08.156656 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_144_144_0 (state Temporary) | ||
| 6496 | 2026.08.18 00:10:08.159255 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_144_144_0 to 202608_144_144_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6497 | 2026.08.18 00:10:08.160072 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1083 | ||
| 6498 | 2026.08.18 00:10:10.113651 [ 424341 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73342982144, merge_with_ttl_allowedtrue) | ||
| 6499 | 2026.08.18 00:10:10.113664 [ 424341 ] {} <Trace> oximeter.timeseries_schema_local (05a0062d-b532-435a-91d7-b9da99374f1d): Scheduling next merge selecting task after 60000ms | ||
| 6500 | 2026.08.18 00:10:13.600916 [ 424720 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Found 6 old parts to remove. Parts: [202608_1_76_15, 202608_77_77_0, 202608_78_78_0, 202608_79_79_0, 202608_80_80_0, 202608_81_81_0] | ||
| 6501 | 2026.08.18 00:10:13.600930 [ 424720 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from filesystem (serially): Parts: [202608_1_76_15, 202608_77_77_0, 202608_78_78_0, 202608_79_79_0, 202608_80_80_0, 202608_81_81_0] | ||
| 6502 | 2026.08.18 00:10:13.601613 [ 424720 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Removing 6 parts from memory: Parts: [202608_1_76_15, 202608_77_77_0, 202608_78_78_0, 202608_79_79_0, 202608_80_80_0, 202608_81_81_0] | ||
| 6503 | 2026.08.18 00:10:13.830939 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 347290 | ||
| 6504 | 2026.08.18 00:10:13.832040 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6505 | 2026.08.18 00:10:13.832052 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6506 | 2026.08.18 00:10:13.832513 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_145_145_0 (state Temporary) | ||
| 6507 | 2026.08.18 00:10:13.832636 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_145_145_0 to 202608_145_145_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6508 | 2026.08.18 00:10:13.832710 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 347290 | ||
| 6509 | 2026.08.18 00:10:14.906528 [ 424559 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Found 6 old parts to remove. Parts: [202608_1_76_15, 202608_77_77_0, 202608_78_78_0, 202608_79_79_0, 202608_80_80_0, 202608_81_81_0] | ||
| 6510 | 2026.08.18 00:10:14.906536 [ 424559 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from filesystem (serially): Parts: [202608_1_76_15, 202608_77_77_0, 202608_78_78_0, 202608_79_79_0, 202608_80_80_0, 202608_81_81_0] | ||
| 6511 | 2026.08.18 00:10:14.907260 [ 424559 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Removing 6 parts from memory: Parts: [202608_1_76_15, 202608_77_77_0, 202608_78_78_0, 202608_79_79_0, 202608_80_80_0, 202608_81_81_0] | ||
| 6512 | 2026.08.18 00:10:15.000308 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 564.05 MiB, peak 600.39 MiB, free memory in arenas 104.37 MiB, will set to 557.25 MiB (RSS), difference: -6.80 MiB | ||
| 6513 | 2026.08.18 00:10:15.660150 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 1090 | ||
| 6514 | 2026.08.18 00:10:15.669817 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6515 | 2026.08.18 00:10:15.669835 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6516 | 2026.08.18 00:10:15.673871 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_145_145_0 (state Temporary) | ||
| 6517 | 2026.08.18 00:10:15.676544 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_145_145_0 to 202608_145_145_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6518 | 2026.08.18 00:10:15.677364 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1090 | ||
| 6519 | 2026.08.18 00:10:21.016519 [ 424302 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6520 | 2026.08.18 00:10:21.016543 [ 424302 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6521 | 2026.08.18 00:10:21.332964 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2576 entries to flush up to offset 349866 | ||
| 6522 | 2026.08.18 00:10:21.334017 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6523 | 2026.08.18 00:10:21.334033 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6524 | 2026.08.18 00:10:21.334500 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_146_146_0 (state Temporary) | ||
| 6525 | 2026.08.18 00:10:21.334621 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_146_146_0 to 202608_146_146_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6526 | 2026.08.18 00:10:21.334690 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 349866 | ||
| 6527 | 2026.08.18 00:10:21.334693 [ 424346 ] {} <Debug> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Selected 6 parts from 202608_1_141_28 to 202608_146_146_0 | ||
| 6528 | 2026.08.18 00:10:21.334712 [ 424346 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6529 | 2026.08.18 00:10:21.334716 [ 424346 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6530 | 2026.08.18 00:10:21.334812 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_141_28 to 202608_146_146_0 into Compact with storage Full | ||
| 6531 | 2026.08.18 00:10:21.334867 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 6532 | 2026.08.18 00:10:21.334881 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 43 marks from part 202608_1_141_28, total 337630 rows starting from the beginning of the part | ||
| 6533 | 2026.08.18 00:10:21.334925 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_142_142_0, total 2576 rows starting from the beginning of the part | ||
| 6534 | 2026.08.18 00:10:21.334943 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_143_143_0, total 2254 rows starting from the beginning of the part | ||
| 6535 | 2026.08.18 00:10:21.334959 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_144_144_0, total 2576 rows starting from the beginning of the part | ||
| 6536 | 2026.08.18 00:10:21.334976 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_145_145_0, total 2254 rows starting from the beginning of the part | ||
| 6537 | 2026.08.18 00:10:21.334992 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_146_146_0, total 2576 rows starting from the beginning of the part | ||
| 6538 | 2026.08.18 00:10:21.356266 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 349866 rows, containing 4 columns (4 merged, 0 gathered) in 0.021496325 sec., 16275619.204678008 rows/sec., 233.37 MiB/sec. | ||
| 6539 | 2026.08.18 00:10:21.356459 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Trace> MergedBlockOutputStream: filled checksums 202608_1_146_29 (state Temporary) | ||
| 6540 | 2026.08.18 00:10:21.356588 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_merge_202608_1_146_29 to 202608_1_146_29 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6541 | 2026.08.18 00:10:21.356610 [ 424472 ] {a775533b-74ac-4d87-8677-e03a726d3ec8::202608_1_146_29} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8) (MergerMutator): Merged 6 parts: [202608_1_141_28, 202608_146_146_0] -> 202608_1_146_29 | ||
| 6542 | 2026.08.18 00:10:21.356652 [ 424472 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.78 MiB. | ||
| 6543 | 2026.08.18 00:10:22.000327 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 558.13 MiB, peak 600.39 MiB, free memory in arenas 118.43 MiB, will set to 559.89 MiB (RSS), difference: 1.77 MiB | ||
| 6544 | 2026.08.18 00:10:22.522527 [ 424363 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73344020480, merge_with_ttl_allowedtrue) | ||
| 6545 | 2026.08.18 00:10:22.522541 [ 424363 ] {} <Trace> oximeter.measurements_cumulativef64_local (24dea9d7-064d-49c2-9599-9587402bf78f): Scheduling next merge selecting task after 60000ms | ||
| 6546 | 2026.08.18 00:10:23.177434 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 1098 | ||
| 6547 | 2026.08.18 00:10:23.185003 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6548 | 2026.08.18 00:10:23.185016 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6549 | 2026.08.18 00:10:23.188321 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_146_146_0 (state Temporary) | ||
| 6550 | 2026.08.18 00:10:23.190835 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_146_146_0 to 202608_146_146_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6551 | 2026.08.18 00:10:23.190995 [ 424356 ] {} <Debug> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Selected 6 parts from 202608_1_141_28 to 202608_146_146_0 | ||
| 6552 | 2026.08.18 00:10:23.191008 [ 424356 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6553 | 2026.08.18 00:10:23.191013 [ 424356 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6554 | 2026.08.18 00:10:23.191085 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Debug> MergeTask::PrepareStage: Merging 6 parts: from 202608_1_141_28 to 202608_146_146_0 into Compact with storage Full | ||
| 6555 | 2026.08.18 00:10:23.191760 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1098 | ||
| 6556 | 2026.08.18 00:10:23.194599 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Debug> MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal | ||
| 6557 | 2026.08.18 00:10:23.194959 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_1_141_28, total 1060 rows starting from the beginning of the part | ||
| 6558 | 2026.08.18 00:10:23.196862 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_142_142_0, total 8 rows starting from the beginning of the part | ||
| 6559 | 2026.08.18 00:10:23.198712 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_143_143_0, total 7 rows starting from the beginning of the part | ||
| 6560 | 2026.08.18 00:10:23.200600 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_144_144_0, total 8 rows starting from the beginning of the part | ||
| 6561 | 2026.08.18 00:10:23.202422 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_145_145_0, total 7 rows starting from the beginning of the part | ||
| 6562 | 2026.08.18 00:10:23.204290 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Debug> MergeTreeSequentialSource: Reading 2 marks from part 202608_146_146_0, total 8 rows starting from the beginning of the part | ||
| 6563 | 2026.08.18 00:10:23.236247 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Debug> MergeTask::MergeProjectionsStage: Merge sorted 1098 rows, containing 679 columns (679 merged, 0 gathered) in 0.045184193 sec., 24300.533595897134 rows/sec., 13.26 MiB/sec. | ||
| 6564 | 2026.08.18 00:10:23.237773 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Trace> MergedBlockOutputStream: filled checksums 202608_1_146_29 (state Temporary) | ||
| 6565 | 2026.08.18 00:10:23.241284 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_merge_202608_1_146_29 to 202608_1_146_29 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6566 | 2026.08.18 00:10:23.241335 [ 424484 ] {ac44e1f8-9724-4d39-a230-936d29791ba7::202608_1_146_29} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7) (MergerMutator): Merged 6 parts: [202608_1_141_28, 202608_146_146_0] -> 202608_1_146_29 | ||
| 6567 | 2026.08.18 00:10:23.241894 [ 424484 ] {} <Debug> MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 26.64 MiB. | ||
| 6568 | 2026.08.18 00:10:24.000402 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 561.36 MiB, peak 600.39 MiB, free memory in arenas 153.19 MiB, will set to 587.17 MiB (RSS), difference: 25.81 MiB | ||
| 6569 | 2026.08.18 00:10:25.681493 [ 424392 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73343922176, merge_with_ttl_allowedtrue) | ||
| 6570 | 2026.08.18 00:10:25.681508 [ 424392 ] {} <Trace> oximeter.fields_uuid_local (eaa5beef-895d-41af-915b-bd6fb56613c4): Scheduling next merge selecting task after 60000ms | ||
| 6571 | 2026.08.18 00:10:28.834872 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2254 entries to flush up to offset 352120 | ||
| 6572 | 2026.08.18 00:10:28.835912 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6573 | 2026.08.18 00:10:28.835924 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6574 | 2026.08.18 00:10:28.836313 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_147_147_0 (state Temporary) | ||
| 6575 | 2026.08.18 00:10:28.836432 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_147_147_0 to 202608_147_147_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6576 | 2026.08.18 00:10:28.836501 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 352120 | ||
| 6577 | 2026.08.18 00:10:30.691936 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 1105 | ||
| 6578 | 2026.08.18 00:10:30.700413 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6579 | 2026.08.18 00:10:30.700427 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6580 | 2026.08.18 00:10:30.703860 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_147_147_0 (state Temporary) | ||
| 6581 | 2026.08.18 00:10:30.706502 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_147_147_0 to 202608_147_147_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6582 | 2026.08.18 00:10:30.707311 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1105 | ||
| 6583 | 2026.08.18 00:10:31.000541 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 587.55 MiB, peak 600.39 MiB, free memory in arenas 152.30 MiB, will set to 586.52 MiB (RSS), difference: -1.03 MiB | ||
| 6584 | 2026.08.18 00:10:34.000260 [ 425081 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 586.52 MiB, peak 600.39 MiB, free memory in arenas 136.48 MiB, will set to 585.51 MiB (RSS), difference: -1.00 MiB | ||
| 6585 | 2026.08.18 00:10:35.071489 [ 424306 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=73343346688, merge_with_ttl_allowedtrue) | ||
| 6586 | 2026.08.18 00:10:35.071515 [ 424306 ] {} <Trace> oximeter.fields_i64_local (2d79911c-8882-4309-a914-7e64c31972ae): Scheduling next merge selecting task after 60000ms | ||
| 6587 | 2026.08.18 00:10:36.016722 [ 424374 ] {} <Debug> DNSResolver: Updating DNS cache | ||
| 6588 | 2026.08.18 00:10:36.016741 [ 424374 ] {} <Debug> DNSResolver: Updated DNS cache | ||
| 6589 | 2026.08.18 00:10:36.336682 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushing system log, 2578 entries to flush up to offset 354698 | ||
| 6590 | 2026.08.18 00:10:36.337854 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6591 | 2026.08.18 00:10:36.337866 [ 425046 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6592 | 2026.08.18 00:10:36.338251 [ 425046 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_148_148_0 (state Temporary) | ||
| 6593 | 2026.08.18 00:10:36.338372 [ 425046 ] {} <Trace> system.asynchronous_metric_log (a775533b-74ac-4d87-8677-e03a726d3ec8): Renaming temporary part tmp_insert_202608_148_148_0 to 202608_148_148_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6594 | 2026.08.18 00:10:36.338452 [ 425046 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 354698 | ||
| 6595 | 2026.08.18 00:10:38.207381 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 1113 | ||
| 6596 | 2026.08.18 00:10:38.214329 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 | ||
| 6597 | 2026.08.18 00:10:38.214343 [ 425043 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 136.61 GiB. | ||
| 6598 | 2026.08.18 00:10:38.217677 [ 425043 ] {} <Trace> MergedBlockOutputStream: filled checksums 202608_148_148_0 (state Temporary) | ||
| 6599 | 2026.08.18 00:10:38.220098 [ 425043 ] {} <Trace> system.metric_log (ac44e1f8-9724-4d39-a230-936d29791ba7): Renaming temporary part tmp_insert_202608_148_148_0 to 202608_148_148_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). | ||
| 6600 | 2026.08.18 00:10:38.220909 [ 425043 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 1113 | ||
| 6601 | 2026.08.18 00:10:38.722328 [ 424415 ] {} <Trace> oximeter.version (157c979f-eec8-4d9d-8340-ef2e89475af4): Scheduling next merge selecting task after 60000ms | ||