2024.09.02 19:49:59.691582 [ 205228 ] {} Application: Will watch for the process with pid 205248 2024.09.02 19:49:59.691610 [ 205248 ] {} Application: Forked a child process to watch 2024.09.02 19:49:59.691773 [ 205248 ] {} SentryWriter: Sending crash reports is disabled 2024.09.02 19:49:59.691884 [ 205248 ] {} Pipe: Pipe capacity is 1.00 MiB 2024.09.02 19:49:59.754043 [ 205248 ] {} Application: Starting ClickHouse 23.8.7.24 (revision: 54477, git hash: 812b95e14ba8cf744bf1d70e6de607cf130a79fa, build id: 6484B75ECB16F4FF87A88E10249A45E1BDBDE2E5), PID 205248 2024.09.02 19:49:59.754103 [ 205248 ] {} Application: starting up 2024.09.02 19:49:59.754124 [ 205248 ] {} Application: OS name: Linux, version: 5.15.0-1015-aws, architecture: x86_64 2024.09.02 19:49:59.758985 [ 205248 ] {} Application: Available RAM: 30.68 GiB; physical cores: 8; logical cores: 8. 2024.09.02 19:49:59.765720 [ 205248 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2024.09.02 19:49:59.765743 [ 205248 ] {} AsynchronousMetrics: Scanning /sys/block 2024.09.02 19:49:59.765783 [ 205248 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2024.09.02 19:49:59.765794 [ 205248 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2024.09.02 19:49:59.918384 [ 205248 ] {} Application: Integrity check of the executable successfully passed (checksum: 63E397DB90569A93F13765E06F4A1FBF) 2024.09.02 19:49:59.923063 [ 205248 ] {} Application: Set max number of file descriptors to 524288 (was 1024). 2024.09.02 19:49:59.923078 [ 205248 ] {} Application: rlimit on number of threads is 125612 2024.09.02 19:49:59.923085 [ 205248 ] {} Application: Initializing DateLUT. 2024.09.02 19:49:59.923090 [ 205248 ] {} Application: Initialized DateLUT with time zone 'UTC'. 2024.09.02 19:49:59.923114 [ 205248 ] {} Context: Setting up /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/data/tmp/ to store temporary data in it 2024.09.02 19:49:59.924368 [ 205248 ] {} Application: Initializing interserver credentials. 2024.09.02 19:49:59.924883 [ 205248 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.09.02 19:49:59.927009 [ 205248 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.09.02 19:49:59.927540 [ 205248 ] {} Application: Setting max_server_memory_usage was set to 27.61 GiB (30.68 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.09.02 19:49:59.927550 [ 205248 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.34 GiB (30.68 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.09.02 19:49:59.927555 [ 205248 ] {} Application: Merges and mutations memory limit is set to 15.34 GiB 2024.09.02 19:49:59.927851 [ 205248 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2024.09.02 19:49:59.929587 [ 205248 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads 2024.09.02 19:49:59.946730 [ 205248 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2024.09.02 19:49:59.947666 [ 205248 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2024.09.02 19:49:59.950136 [ 205248 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.09.02 19:49:59.950514 [ 205248 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.09.02 19:49:59.951114 [ 205248 ] {} Application: Listening for replica communication (interserver): http://[::1]:19402 2024.09.02 19:49:59.952857 [ 205248 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.09.02 19:49:59.953373 [ 205248 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.09.02 19:49:59.954021 [ 205248 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.09.02 19:49:59.955165 [ 205248 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml 2024.09.02 19:49:59.956074 [ 205248 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2024.09.02 19:49:59.956463 [ 205248 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2024.09.02 19:49:59.956852 [ 205248 ] {} Context: Initialized background executor for fetches with num_threads=8, num_tasks=8 2024.09.02 19:49:59.958348 [ 205248 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2024.09.02 19:49:59.959746 [ 205248 ] {} DNSCacheUpdater: Update period 15 seconds 2024.09.02 19:49:59.959774 [ 205248 ] {} Application: Loading metadata from /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/data/ 2024.09.02 19:49:59.959798 [ 205825 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:49:59.960032 [ 205825 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:49:59.975906 [ 205248 ] {} DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total. 2024.09.02 19:49:59.975925 [ 205248 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 9.78e-05 sec 2024.09.02 19:49:59.975933 [ 205248 ] {} ReferentialDeps: No tables 2024.09.02 19:49:59.975937 [ 205248 ] {} LoadingDeps: No tables 2024.09.02 19:49:59.975969 [ 205248 ] {} DatabaseAtomic (system): Starting up tables. 2024.09.02 19:49:59.975988 [ 205248 ] {} SystemLog: Not creating system.query_log since corresponding section 'query_log' is missing from config 2024.09.02 19:49:59.975995 [ 205248 ] {} SystemLog: Not creating system.query_thread_log since corresponding section 'query_thread_log' is missing from config 2024.09.02 19:49:59.976000 [ 205248 ] {} SystemLog: Not creating system.part_log since corresponding section 'part_log' is missing from config 2024.09.02 19:49:59.976005 [ 205248 ] {} SystemLog: Not creating system.trace_log since corresponding section 'trace_log' is missing from config 2024.09.02 19:49:59.976010 [ 205248 ] {} SystemLog: Not creating system.crash_log since corresponding section 'crash_log' is missing from config 2024.09.02 19:49:59.976017 [ 205248 ] {} SystemLog: Not creating system.text_log since corresponding section 'text_log' is missing from config 2024.09.02 19:49:59.976022 [ 205248 ] {} SystemLog: Not creating system.metric_log since corresponding section 'metric_log' is missing from config 2024.09.02 19:49:59.976028 [ 205248 ] {} SystemLog: Not creating system.filesystem_cache_log since corresponding section 'filesystem_cache_log' is missing from config 2024.09.02 19:49:59.976042 [ 205248 ] {} SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config 2024.09.02 19:49:59.976048 [ 205248 ] {} SystemLog: Not creating system.asynchronous_metric_log since corresponding section 'asynchronous_metric_log' is missing from config 2024.09.02 19:49:59.976053 [ 205248 ] {} SystemLog: Not creating system.opentelemetry_span_log since corresponding section 'opentelemetry_span_log' is missing from config 2024.09.02 19:49:59.976059 [ 205248 ] {} SystemLog: Not creating system.query_views_log since corresponding section 'query_views_log' is missing from config 2024.09.02 19:49:59.976064 [ 205248 ] {} SystemLog: Not creating system.zookeeper_log since corresponding section 'zookeeper_log' is missing from config 2024.09.02 19:49:59.976068 [ 205248 ] {} SystemLog: Not creating system.session_log since corresponding section 'session_log' is missing from config 2024.09.02 19:49:59.976074 [ 205248 ] {} SystemLog: Not creating system.transactions_info_log since corresponding section 'transactions_info_log' is missing from config 2024.09.02 19:49:59.976079 [ 205248 ] {} SystemLog: Not creating system.processors_profile_log since corresponding section 'processors_profile_log' is missing from config 2024.09.02 19:49:59.976084 [ 205248 ] {} SystemLog: Not creating system.asynchronous_insert_log since corresponding section 'asynchronous_insert_log' is missing from config 2024.09.02 19:49:59.987497 [ 205248 ] {} DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal. 2024.09.02 19:49:59.991757 [ 205248 ] {} DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total. 2024.09.02 19:49:59.991780 [ 205248 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 7.731e-05 sec 2024.09.02 19:49:59.991789 [ 205248 ] {} ReferentialDeps: No tables 2024.09.02 19:49:59.991793 [ 205248 ] {} LoadingDeps: No tables 2024.09.02 19:49:59.991825 [ 205248 ] {} DatabaseAtomic (default): Starting up tables. 2024.09.02 19:49:59.991966 [ 205248 ] {} UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/data/user_defined/ 2024.09.02 19:49:59.992001 [ 205248 ] {} UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded 2024.09.02 19:49:59.992005 [ 205248 ] {} Application: Loaded metadata. 2024.09.02 19:49:59.992025 [ 205248 ] {} Application: Tasks stats provider: procfs 2024.09.02 19:49:59.992029 [ 205248 ] {} Application: It looks like the process has no CAP_SYS_NICE capability, the setting 'os_thread_priority' will have no effect. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_sys_nice=+ep /work/oxidecomputer/omicron/out/clickhouse/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems. 2024.09.02 19:49:59.992185 [ 205248 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.09.02 19:49:59.992718 [ 205248 ] {} AsynchronousMetrics: MemoryTracking: was 8.54 MiB, peak 13.25 MiB, free memory in arenas 21.75 MiB, will set to 384.13 MiB (RSS), difference: 375.59 MiB 2024.09.02 19:49:59.993244 [ 205248 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 2.793e-05 sec. 2024.09.02 19:49:59.995071 [ 205248 ] {} Application: Listening for http://[::1]:19302 2024.09.02 19:49:59.995102 [ 206108 ] {} DDLWorker: Starting DDLWorker thread 2024.09.02 19:49:59.995165 [ 206108 ] {} DDLWorker: Initializing DDLWorker thread 2024.09.02 19:49:59.995163 [ 206107 ] {} DDLWorker: Started DDLWorker cleanup thread 2024.09.02 19:49:59.995190 [ 205248 ] {} Application: Listening for native protocol (tcp): [::1]:19202 2024.09.02 19:49:59.995347 [ 205344 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: GET, Address: [::1]:53062, User-Agent: (none), Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:49:59.996174 [ 205248 ] {} Application: Ready for connections. 2024.09.02 19:49:59.996385 [ 206108 ] {} virtual bool DB::DDLWorker::initializeMainThread(): Code: 999. Coordination::Exception: All connection tries failed while connecting to ZooKeeper. nodes: [::1]:19001, [::1]:19003, [::1]:19002 Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19003 Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19002 Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19003 Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19002 Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19001 Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19003 Poco::Exception. Code: 1000, e.code() = 111, Connection refused (version 23.8.7.24 (official build)), [::1]:19002 . (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x00000000074d294d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String&) @ 0x00000000126eb50a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&) @ 0x0000000013841f00 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. zkutil::ZooKeeper::init(zkutil::ZooKeeperArgs) @ 0x00000000137f31d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. zkutil::ZooKeeper::ZooKeeper(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr) @ 0x00000000137f66f9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. DB::Context::getZooKeeper() const @ 0x000000001166afca in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. DB::DDLWorker::getAndSetZooKeeper() @ 0x00000000116ec1ed in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. DB::DDLWorker::initializeMainThread() @ 0x00000000116fc81b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::DDLWorker::runMainThread() @ 0x00000000116e7280 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. ? @ 0x00007fdab736fac3 in ? 13. ? @ 0x00007fdab7401850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:00.000434 [ 206104 ] {} AsynchronousMetrics: MemoryTracking: was 384.16 MiB, peak 385.17 MiB, free memory in arenas 22.92 MiB, will set to 386.88 MiB (RSS), difference: 2.72 MiB 2024.09.02 19:50:05.002254 [ 206108 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19003 with session_id 5 2024.09.02 19:50:05.002741 [ 206108 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.09.02 19:50:05.002759 [ 206108 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.09.02 19:50:05.002762 [ 206108 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.09.02 19:50:05.002767 [ 206108 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003 2024.09.02 19:50:05.009349 [ 206108 ] {} DDLWorker: Initialized DDLWorker thread 2024.09.02 19:50:05.009377 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:05.009381 [ 206108 ] {} DDLWorker: Don't have unfinished tasks after restarting 2024.09.02 19:50:05.009390 [ 206107 ] {} DDLWorker: Cleaning queue 2024.09.02 19:50:05.009565 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=1, queue_size=1, entries=query-0000000000..query-0000000000, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2024.09.02 19:50:05.009573 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000000 2024.09.02 19:50:05.009576 [ 206108 ] {} DDLWorker: Checking task query-0000000000 2024.09.02 19:50:05.009916 [ 206108 ] {} DDLWorker: Processing task query-0000000000 (CREATE DATABASE IF NOT EXISTS oximeter UUID 'ed5b6146-ccd7-48de-9ce6-fd1c4ae1b6ae') 2024.09.02 19:50:05.013401 [ 206108 ] {} DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID 'ed5b6146-ccd7-48de-9ce6-fd1c4ae1b6ae' 2024.09.02 19:50:05.013607 [ 206108 ] {c17cfa48-070a-4d88-86bc-3058eaa050d4} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 706ffb1d-8d1c-47a9-8caa-034da3c81ce9) /* ddl_entry=query-0000000000 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'ed5b6146-ccd7-48de-9ce6-fd1c4ae1b6ae' (stage: Complete) 2024.09.02 19:50:05.020251 [ 206108 ] {c17cfa48-070a-4d88-86bc-3058eaa050d4} DatabaseAtomic (oximeter): Metadata processed, database oximeter has 0 tables and 0 dictionaries in total. 2024.09.02 19:50:05.020276 [ 206108 ] {c17cfa48-070a-4d88-86bc-3058eaa050d4} TablesLoader: Parsed metadata of 0 tables in 1 databases in 9.385e-05 sec 2024.09.02 19:50:05.020283 [ 206108 ] {c17cfa48-070a-4d88-86bc-3058eaa050d4} ReferentialDeps: No tables 2024.09.02 19:50:05.020287 [ 206108 ] {c17cfa48-070a-4d88-86bc-3058eaa050d4} LoadingDeps: No tables 2024.09.02 19:50:05.020323 [ 206108 ] {c17cfa48-070a-4d88-86bc-3058eaa050d4} DatabaseAtomic (oximeter): Starting up tables. 2024.09.02 19:50:05.020441 [ 206108 ] {c17cfa48-070a-4d88-86bc-3058eaa050d4} DDLWorker: Executed query: /* ddl_entry=query-0000000000 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'ed5b6146-ccd7-48de-9ce6-fd1c4ae1b6ae' 2024.09.02 19:50:05.025890 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:05.262147 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:05.262163 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:05.262338 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=2, queue_size=2, entries=query-0000000000..query-0000000001, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000000, last_skipped_entry_name=none 2024.09.02 19:50:05.262372 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000001 2024.09.02 19:50:05.262378 [ 206108 ] {} DDLWorker: Checking task query-0000000001 2024.09.02 19:50:05.262988 [ 206108 ] {} DDLWorker: Processing task query-0000000001 (CREATE TABLE IF NOT EXISTS oximeter.version UUID '626c1ca5-d8d8-4409-a032-b2aeb18345c3' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)) 2024.09.02 19:50:05.272239 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID '626c1ca5-d8d8-4409-a032-b2aeb18345c3' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.09.02 19:50:05.272396 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 3e577ff7-94c0-48d4-9118-4e02474de8a9) /* ddl_entry=query-0000000001 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '626c1ca5-d8d8-4409-a032-b2aeb18345c3' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) 2024.09.02 19:50:05.273068 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} StoragePolicy (default): Storage policy default created, total volumes 1 2024.09.02 19:50:05.281223 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Loading data parts 2024.09.02 19:50:05.295926 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): There are no data parts 2024.09.02 19:50:05.302434 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Creating table /clickhouse/tables/1/version 2024.09.02 19:50:05.330880 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Creating shared ID for table oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3) 2024.09.02 19:50:05.330982 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Shared ID for table oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3) doesn't exist in ZooKeeper on path /clickhouse/tables/1/version/table_shared_id 2024.09.02 19:50:05.330994 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Got candidate ID 626c1ca5-d8d8-4409-a032-b2aeb18345c3, will try to create it in ZooKeeper on path /clickhouse/tables/1/version/table_shared_id 2024.09.02 19:50:05.340409 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Initializing table shared ID with 626c1ca5-d8d8-4409-a032-b2aeb18345c3 2024.09.02 19:50:05.346807 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Starting up table 2024.09.02 19:50:05.356348 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Became leader 2024.09.02 19:50:05.356371 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:05.356436 [ 205774 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.09.02 19:50:05.356463 [ 205774 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:05.362889 [ 205774 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:05.363040 [ 205774 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:05.363065 [ 205774 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue 2024.09.02 19:50:05.363503 [ 205774 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:05.365032 [ 205774 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:05.374645 [ 205774 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:05.374780 [ 205824 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 6503ms 2024.09.02 19:50:05.376476 [ 206108 ] {2475538f-991c-4e2a-9356-584d5a4c3252} DDLWorker: Executed query: /* ddl_entry=query-0000000001 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '626c1ca5-d8d8-4409-a032-b2aeb18345c3' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.09.02 19:50:05.382788 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:05.543400 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:05.543410 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:05.543620 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=3, queue_size=3, entries=query-0000000000..query-0000000002, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000001, last_skipped_entry_name=none 2024.09.02 19:50:05.543630 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000002 2024.09.02 19:50:05.543634 [ 206108 ] {} DDLWorker: Checking task query-0000000002 2024.09.02 19:50:05.544306 [ 206108 ] {} DDLWorker: Processing task query-0000000002 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '8387b2c6-e147-451e-8e5f-84f4bbeb2c47' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.09.02 19:50:05.553179 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '8387b2c6-e147-451e-8e5f-84f4bbeb2c47' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.09.02 19:50:05.553450 [ 206108 ] {7839e6bb-9fb5-4004-8226-89fd289549fd} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 27b16cce-2f69-47fe-9d24-c6d9c6a188d2) /* ddl_entry=query-0000000002 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '8387b2c6-e147-451e-8e5f-84f4bbeb2c47' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.09.02 19:50:05.558425 [ 206108 ] {7839e6bb-9fb5-4004-8226-89fd289549fd} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Loading data parts 2024.09.02 19:50:05.561116 [ 206108 ] {7839e6bb-9fb5-4004-8226-89fd289549fd} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): There are no data parts 2024.09.02 19:50:05.567407 [ 206108 ] {7839e6bb-9fb5-4004-8226-89fd289549fd} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Creating table /clickhouse/tables/1/measurements_cumulativef64_local 2024.09.02 19:50:05.668029 [ 206108 ] {7839e6bb-9fb5-4004-8226-89fd289549fd} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Creating shared ID for table oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) 2024.09.02 19:50:05.668196 [ 206108 ] {7839e6bb-9fb5-4004-8226-89fd289549fd} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Initializing table shared ID with 8387b2c6-e147-451e-8e5f-84f4bbeb2c47 2024.09.02 19:50:05.674043 [ 206108 ] {7839e6bb-9fb5-4004-8226-89fd289549fd} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Starting up table 2024.09.02 19:50:05.674968 [ 206108 ] {7839e6bb-9fb5-4004-8226-89fd289549fd} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Became leader 2024.09.02 19:50:05.676501 [ 206108 ] {7839e6bb-9fb5-4004-8226-89fd289549fd} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:05.676555 [ 205836 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.09.02 19:50:05.676577 [ 205836 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:05.683836 [ 205836 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:05.684005 [ 205836 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:05.684016 [ 205836 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue 2024.09.02 19:50:05.684152 [ 205836 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:05.684382 [ 205836 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:05.691957 [ 205836 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:05.692065 [ 205807 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 6182ms 2024.09.02 19:50:05.692164 [ 206108 ] {7839e6bb-9fb5-4004-8226-89fd289549fd} DDLWorker: Executed query: /* ddl_entry=query-0000000002 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '8387b2c6-e147-451e-8e5f-84f4bbeb2c47' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.09.02 19:50:05.699725 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:05.817405 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:05.817409 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:05.817588 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=4, queue_size=4, entries=query-0000000000..query-0000000003, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000002, last_skipped_entry_name=none 2024.09.02 19:50:05.817598 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000003 2024.09.02 19:50:05.817607 [ 206108 ] {} DDLWorker: Checking task query-0000000003 2024.09.02 19:50:05.818063 [ 206108 ] {} DDLWorker: Processing task query-0000000003 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'e015100f-bb7c-48bf-9530-8b3755907563' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:05.825264 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'e015100f-bb7c-48bf-9530-8b3755907563' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:05.825464 [ 206108 ] {be689e45-0a72-48e6-9080-e216d07b9201} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b5a7e891-5eff-4ffb-b906-1f0c9b3c10f3) /* ddl_entry=query-0000000003 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'e015100f-bb7c-48bf-9530-8b3755907563' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:05.827719 [ 206108 ] {be689e45-0a72-48e6-9080-e216d07b9201} StorageDistributed (measurements_cumulativef64): Auto-increment is 0 2024.09.02 19:50:05.834567 [ 206108 ] {be689e45-0a72-48e6-9080-e216d07b9201} DDLWorker: Executed query: /* ddl_entry=query-0000000003 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'e015100f-bb7c-48bf-9530-8b3755907563' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:05.838855 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:05.946735 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:05.946747 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:05.946917 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=5, queue_size=5, entries=query-0000000000..query-0000000004, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000003, last_skipped_entry_name=none 2024.09.02 19:50:05.946926 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000004 2024.09.02 19:50:05.946928 [ 206108 ] {} DDLWorker: Checking task query-0000000004 2024.09.02 19:50:05.947451 [ 206108 ] {} DDLWorker: Processing task query-0000000004 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '745b0c5d-7345-48e5-92db-352d47dfc7b4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.09.02 19:50:05.965817 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '745b0c5d-7345-48e5-92db-352d47dfc7b4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:05.966023 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 98878ecc-2c9d-407c-acd3-849de263b0c1) /* ddl_entry=query-0000000004 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '745b0c5d-7345-48e5-92db-352d47dfc7b4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.09.02 19:50:05.974040 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Loading data parts 2024.09.02 19:50:05.974313 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): There are no data parts 2024.09.02 19:50:05.979167 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Creating table /clickhouse/tables/1/fields_i64_local 2024.09.02 19:50:06.021639 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Creating shared ID for table oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) 2024.09.02 19:50:06.021793 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Shared ID for table oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) doesn't exist in ZooKeeper on path /clickhouse/tables/1/fields_i64_local/table_shared_id 2024.09.02 19:50:06.021807 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Got candidate ID 745b0c5d-7345-48e5-92db-352d47dfc7b4, will try to create it in ZooKeeper on path /clickhouse/tables/1/fields_i64_local/table_shared_id 2024.09.02 19:50:06.030989 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Initializing table shared ID with 745b0c5d-7345-48e5-92db-352d47dfc7b4 2024.09.02 19:50:06.035158 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Starting up table 2024.09.02 19:50:06.038735 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Became leader 2024.09.02 19:50:06.038750 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:06.038812 [ 205835 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.09.02 19:50:06.038841 [ 205835 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:06.049101 [ 205835 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:06.049269 [ 205835 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:06.049312 [ 205835 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue 2024.09.02 19:50:06.049436 [ 205835 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:06.049580 [ 205835 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:06.058362 [ 205835 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:06.058527 [ 205792 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 6598ms 2024.09.02 19:50:06.058572 [ 206108 ] {f4871fea-8d0e-46b2-834d-e6d26d7182d5} DDLWorker: Executed query: /* ddl_entry=query-0000000004 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '745b0c5d-7345-48e5-92db-352d47dfc7b4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:06.063747 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:06.228112 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:06.228119 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:06.228288 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=6, queue_size=6, entries=query-0000000000..query-0000000005, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000004, last_skipped_entry_name=none 2024.09.02 19:50:06.228298 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000005 2024.09.02 19:50:06.228303 [ 206108 ] {} DDLWorker: Checking task query-0000000005 2024.09.02 19:50:06.228749 [ 206108 ] {} DDLWorker: Processing task query-0000000005 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2f79e853-3efa-4e4a-985a-cecade380d7d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:06.236508 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2f79e853-3efa-4e4a-985a-cecade380d7d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:06.236679 [ 206108 ] {41c5455e-cbf6-489a-b01d-4de666930a62} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: bdfa0948-9eb4-491e-907a-147267427a1f) /* ddl_entry=query-0000000005 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2f79e853-3efa-4e4a-985a-cecade380d7d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:06.238338 [ 206108 ] {41c5455e-cbf6-489a-b01d-4de666930a62} StorageDistributed (fields_i64): Auto-increment is 0 2024.09.02 19:50:06.245389 [ 206108 ] {41c5455e-cbf6-489a-b01d-4de666930a62} DDLWorker: Executed query: /* ddl_entry=query-0000000005 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2f79e853-3efa-4e4a-985a-cecade380d7d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:06.250748 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:06.357867 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:06.357873 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:06.358084 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=7, queue_size=7, entries=query-0000000000..query-0000000006, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000005, last_skipped_entry_name=none 2024.09.02 19:50:06.358105 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000006 2024.09.02 19:50:06.358110 [ 206108 ] {} DDLWorker: Checking task query-0000000006 2024.09.02 19:50:06.358681 [ 206108 ] {} DDLWorker: Processing task query-0000000006 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '2a01182b-0909-4138-ac40-9871004f15b4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.09.02 19:50:06.376940 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '2a01182b-0909-4138-ac40-9871004f15b4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:06.377172 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e040de3d-1183-4908-98ad-f9f4ca8e8b6a) /* ddl_entry=query-0000000006 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '2a01182b-0909-4138-ac40-9871004f15b4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.09.02 19:50:06.384365 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Loading data parts 2024.09.02 19:50:06.384709 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): There are no data parts 2024.09.02 19:50:06.389094 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Creating table /clickhouse/tables/1/fields_uuid_local 2024.09.02 19:50:06.422567 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Creating shared ID for table oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) 2024.09.02 19:50:06.422755 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Shared ID for table oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) doesn't exist in ZooKeeper on path /clickhouse/tables/1/fields_uuid_local/table_shared_id 2024.09.02 19:50:06.422770 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Got candidate ID 2a01182b-0909-4138-ac40-9871004f15b4, will try to create it in ZooKeeper on path /clickhouse/tables/1/fields_uuid_local/table_shared_id 2024.09.02 19:50:06.430627 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Initializing table shared ID with 2a01182b-0909-4138-ac40-9871004f15b4 2024.09.02 19:50:06.435780 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Starting up table 2024.09.02 19:50:06.441825 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Became leader 2024.09.02 19:50:06.441844 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:06.441890 [ 205797 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.09.02 19:50:06.441908 [ 205797 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:06.448717 [ 205797 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:06.448866 [ 205797 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:06.448880 [ 205797 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue 2024.09.02 19:50:06.449006 [ 205797 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:06.449118 [ 205797 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:06.453934 [ 205797 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:06.454069 [ 205811 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 6066ms 2024.09.02 19:50:06.454134 [ 206108 ] {71a98e0e-0a4d-4652-a1b5-96d68d955255} DDLWorker: Executed query: /* ddl_entry=query-0000000006 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '2a01182b-0909-4138-ac40-9871004f15b4' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:06.460294 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:06.536350 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:06.536361 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:06.536548 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=8, queue_size=8, entries=query-0000000000..query-0000000007, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000006, last_skipped_entry_name=none 2024.09.02 19:50:06.536559 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000007 2024.09.02 19:50:06.536565 [ 206108 ] {} DDLWorker: Checking task query-0000000007 2024.09.02 19:50:06.537106 [ 206108 ] {} DDLWorker: Processing task query-0000000007 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '73250695-55fb-45ba-b1e3-d9f44a8136dd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:06.543378 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '73250695-55fb-45ba-b1e3-d9f44a8136dd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:06.543553 [ 206108 ] {8d199127-21ed-4a31-a812-bfc9558b6cec} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1d5ef479-9c43-46e9-b83b-514a28079bd6) /* ddl_entry=query-0000000007 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '73250695-55fb-45ba-b1e3-d9f44a8136dd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:06.544173 [ 206108 ] {8d199127-21ed-4a31-a812-bfc9558b6cec} StorageDistributed (fields_uuid): Auto-increment is 0 2024.09.02 19:50:06.549663 [ 206108 ] {8d199127-21ed-4a31-a812-bfc9558b6cec} DDLWorker: Executed query: /* ddl_entry=query-0000000007 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '73250695-55fb-45ba-b1e3-d9f44a8136dd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:06.555598 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:06.664165 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:06.664174 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:06.664366 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=9, queue_size=9, entries=query-0000000000..query-0000000008, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000007, last_skipped_entry_name=none 2024.09.02 19:50:06.664379 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000008 2024.09.02 19:50:06.664385 [ 206108 ] {} DDLWorker: Checking task query-0000000008 2024.09.02 19:50:06.665026 [ 206108 ] {} DDLWorker: Processing task query-0000000008 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)) 2024.09.02 19:50:06.670328 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.09.02 19:50:06.670588 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0a8bfd03-51bc-4c71-872f-ed5d53a016e9) /* ddl_entry=query-0000000008 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) 2024.09.02 19:50:06.675791 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Loading data parts 2024.09.02 19:50:06.676175 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): There are no data parts 2024.09.02 19:50:06.683086 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Creating table /clickhouse/tables/1/timeseries_schema_local 2024.09.02 19:50:06.754386 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Creating shared ID for table oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) 2024.09.02 19:50:06.754537 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Initializing table shared ID with a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b 2024.09.02 19:50:06.759122 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Starting up table 2024.09.02 19:50:06.769079 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): LeaderElection: leader suddenly changed or new node appeared, will retry 2024.09.02 19:50:06.769262 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Became leader 2024.09.02 19:50:06.769275 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:06.773727 [ 205829 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.09.02 19:50:06.774598 [ 205829 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:06.780052 [ 205829 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:06.780180 [ 205829 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:06.780189 [ 205829 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue 2024.09.02 19:50:06.780293 [ 205829 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:06.780394 [ 205829 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:06.797853 [ 205829 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:06.797967 [ 205813 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 6383ms 2024.09.02 19:50:06.798207 [ 206108 ] {6ed11581-1e49-45f3-9f60-beb3c5a7f1d7} DDLWorker: Executed query: /* ddl_entry=query-0000000008 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.09.02 19:50:06.805516 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:06.957147 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:06.957187 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:06.957361 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=10, queue_size=10, entries=query-0000000000..query-0000000009, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000008, last_skipped_entry_name=none 2024.09.02 19:50:06.957375 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000009 2024.09.02 19:50:06.957380 [ 206108 ] {} DDLWorker: Checking task query-0000000009 2024.09.02 19:50:06.958062 [ 206108 ] {} DDLWorker: Processing task query-0000000009 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'bef0216e-c009-47c4-ae09-b11d3dc2f931' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:06.972815 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'bef0216e-c009-47c4-ae09-b11d3dc2f931' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:06.973095 [ 206108 ] {e7630116-6e63-47ed-ac2f-fd33e634b456} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 666135db-38b1-4872-a012-38ec15eb634e) /* ddl_entry=query-0000000009 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'bef0216e-c009-47c4-ae09-b11d3dc2f931' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:06.974090 [ 206108 ] {e7630116-6e63-47ed-ac2f-fd33e634b456} StorageDistributed (timeseries_schema): Auto-increment is 0 2024.09.02 19:50:06.977753 [ 206108 ] {e7630116-6e63-47ed-ac2f-fd33e634b456} DDLWorker: Executed query: /* ddl_entry=query-0000000009 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'bef0216e-c009-47c4-ae09-b11d3dc2f931' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:06.981238 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:07.079055 [ 205344 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:53062, User-Agent: (none), Length: 93, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:07.079124 [ 205344 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:07.079138 [ 205344 ] {} HTTP-Session: 9817aee7-440d-4778-9aea-faabad6ecf20 Authenticating user 'default' from [::1]:53062 2024.09.02 19:50:07.079149 [ 205344 ] {} HTTP-Session: 9817aee7-440d-4778-9aea-faabad6ecf20 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.079153 [ 205344 ] {} HTTP-Session: 9817aee7-440d-4778-9aea-faabad6ecf20 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.079222 [ 205344 ] {} ContextAccess (default): Settings: readonly = 0, allow_ddl = true, allow_introspection_functions = false 2024.09.02 19:50:07.079233 [ 205344 ] {} ContextAccess (default): List of all grants: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* 2024.09.02 19:50:07.079237 [ 205344 ] {} ContextAccess (default): List of all grants including implicit: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* 2024.09.02 19:50:07.079264 [ 205344 ] {} HTTP-Session: 9817aee7-440d-4778-9aea-faabad6ecf20 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:07.079484 [ 205344 ] {7b4e72d4-a1b6-4992-9dc7-55ad5d910789} executeQuery: (from [::1]:53062) SELECT name FROM system.tables WHERE database = 'oximeter' AND engine = 'ReplicatedMergeTree' (stage: Complete) 2024.09.02 19:50:07.079870 [ 205344 ] {7b4e72d4-a1b6-4992-9dc7-55ad5d910789} ContextAccess (default): Access granted: SELECT(database, name, engine) ON system.tables 2024.09.02 19:50:07.080540 [ 205344 ] {7b4e72d4-a1b6-4992-9dc7-55ad5d910789} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:07.080825 [ 205344 ] {7b4e72d4-a1b6-4992-9dc7-55ad5d910789} ContextAccess (default): Access granted: SHOW TABLES ON *.* 2024.09.02 19:50:07.081936 [ 205344 ] {7b4e72d4-a1b6-4992-9dc7-55ad5d910789} executeQuery: Read 9 rows, 631.00 B in 0.002527 sec., 3561.535417491096 rows/sec., 243.85 KiB/sec. 2024.09.02 19:50:07.082202 [ 205344 ] {7b4e72d4-a1b6-4992-9dc7-55ad5d910789} DynamicQueryHandler: Done processing query 2024.09.02 19:50:07.082217 [ 205344 ] {7b4e72d4-a1b6-4992-9dc7-55ad5d910789} MemoryTracker: Peak memory usage (for query): 4.00 MiB. 2024.09.02 19:50:07.082224 [ 205344 ] {} HTTP-Session: 9817aee7-440d-4778-9aea-faabad6ecf20 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.540842 [ 205893 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.09.02 19:50:07.546652 [ 205893 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.09.02 19:50:07.546688 [ 205893 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:07.547387 [ 206038 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Fetching part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/1 2024.09.02 19:50:07.548654 [ 206038 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ftimeseries_schema_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:07.548738 [ 206038 ] {} HTTPSessionAdapter: Created HTTP(S) session with ::1:19401 (::1:19401) 2024.09.02 19:50:07.551272 [ 206038 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:07.551294 [ 206038 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.76 GiB. 2024.09.02 19:50:07.551311 [ 206038 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:07.551323 [ 206038 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.09.02 19:50:07.552544 [ 206038 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.09.02 19:50:07.553433 [ 206038 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:07.553500 [ 206038 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Committing part all_0_0_0 to zookeeper 2024.09.02 19:50:07.560516 [ 206038 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Part all_0_0_0 committed to zookeeper 2024.09.02 19:50:07.560604 [ 206038 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Fetched part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/1 2024.09.02 19:50:07.560719 [ 205904 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89525911552, merge_with_ttl_allowedtrue) 2024.09.02 19:50:07.560784 [ 205904 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 8247ms 2024.09.02 19:50:07.580257 [ 205930 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.09.02 19:50:07.584756 [ 205930 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.09.02 19:50:07.584777 [ 205930 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:07.585324 [ 206027 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1 2024.09.02 19:50:07.586973 [ 206027 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:07.587457 [ 206027 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:07.587476 [ 206027 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.75 GiB. 2024.09.02 19:50:07.587489 [ 206027 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:07.587524 [ 206027 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.09.02 19:50:07.591080 [ 206027 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.09.02 19:50:07.591106 [ 206027 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:07.591154 [ 206027 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Committing part all_0_0_0 to zookeeper 2024.09.02 19:50:07.596813 [ 206027 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Part all_0_0_0 committed to zookeeper 2024.09.02 19:50:07.596912 [ 206027 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1 2024.09.02 19:50:07.597133 [ 205907 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89525770240, merge_with_ttl_allowedtrue) 2024.09.02 19:50:07.597188 [ 205907 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 8050ms 2024.09.02 19:50:07.625876 [ 205932 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.09.02 19:50:07.630879 [ 205932 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.09.02 19:50:07.630924 [ 205932 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:07.631989 [ 206046 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1 2024.09.02 19:50:07.632212 [ 206046 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:07.633992 [ 206046 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:07.634009 [ 206046 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.75 GiB. 2024.09.02 19:50:07.634019 [ 206046 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:07.634027 [ 206046 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.09.02 19:50:07.634843 [ 206046 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.09.02 19:50:07.634861 [ 206046 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:07.634903 [ 206046 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Committing part all_0_0_0 to zookeeper 2024.09.02 19:50:07.638809 [ 206046 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Part all_0_0_0 committed to zookeeper 2024.09.02 19:50:07.638851 [ 206046 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1 2024.09.02 19:50:07.638945 [ 205902 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89525657600, merge_with_ttl_allowedtrue) 2024.09.02 19:50:07.638967 [ 205902 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 7410ms 2024.09.02 19:50:07.667150 [ 205903 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.09.02 19:50:07.676291 [ 205903 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.09.02 19:50:07.676333 [ 205903 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:07.676865 [ 206047 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Fetching part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1 2024.09.02 19:50:07.677088 [ 206047 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:07.677804 [ 206047 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:07.677838 [ 206047 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.75 GiB. 2024.09.02 19:50:07.677850 [ 206047 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:07.677865 [ 206047 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.09.02 19:50:07.678883 [ 206047 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.09.02 19:50:07.679557 [ 206047 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:07.679602 [ 206047 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Committing part all_0_0_0 to zookeeper 2024.09.02 19:50:07.690117 [ 206047 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Part all_0_0_0 committed to zookeeper 2024.09.02 19:50:07.690171 [ 206047 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Fetched part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1 2024.09.02 19:50:07.690290 [ 205925 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89525401600, merge_with_ttl_allowedtrue) 2024.09.02 19:50:07.690307 [ 205925 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 7800ms 2024.09.02 19:50:07.702781 [ 205344 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:53062, User-Agent: (none), Length: 60, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:07.702833 [ 205344 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:07.702848 [ 205344 ] {} HTTP-Session: 2e69c894-e1ca-41e6-962b-e2bd9e289142 Authenticating user 'default' from [::1]:53062 2024.09.02 19:50:07.702863 [ 205344 ] {} HTTP-Session: 2e69c894-e1ca-41e6-962b-e2bd9e289142 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.702867 [ 205344 ] {} HTTP-Session: 2e69c894-e1ca-41e6-962b-e2bd9e289142 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.702905 [ 205344 ] {} HTTP-Session: 2e69c894-e1ca-41e6-962b-e2bd9e289142 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:07.703091 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} executeQuery: (from [::1]:53062) SELECT * FROM oximeter.timeseries_schema FORMAT JSONEachRow; (stage: Complete) 2024.09.02 19:50:07.703315 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema 2024.09.02 19:50:07.703461 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema 2024.09.02 19:50:07.703624 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local 2024.09.02 19:50:07.703681 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:07.703751 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:07.703818 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (SelectExecutor): Key condition: unknown 2024.09.02 19:50:07.703841 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.09.02 19:50:07.705066 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:07.705108 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0 2024.09.02 19:50:07.706070 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} executeQuery: Read 1 rows, 126.00 B in 0.003035 sec., 329.48929159802304 rows/sec., 40.54 KiB/sec. 2024.09.02 19:50:07.707413 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} DynamicQueryHandler: Done processing query 2024.09.02 19:50:07.707428 [ 205344 ] {9ff6defe-ee77-437d-ae85-046ce0fb0770} MemoryTracker: Peak memory usage (for query): 4.00 MiB. 2024.09.02 19:50:07.707433 [ 205344 ] {} HTTP-Session: 2e69c894-e1ca-41e6-962b-e2bd9e289142 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.709375 [ 205344 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:53062, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:07.709419 [ 205344 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:07.709431 [ 205344 ] {} HTTP-Session: b9163fcb-1561-4cfa-97a0-f1711e44348a Authenticating user 'default' from [::1]:53062 2024.09.02 19:50:07.709444 [ 205344 ] {} HTTP-Session: b9163fcb-1561-4cfa-97a0-f1711e44348a Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.709449 [ 205344 ] {} HTTP-Session: b9163fcb-1561-4cfa-97a0-f1711e44348a Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.709490 [ 205344 ] {} HTTP-Session: b9163fcb-1561-4cfa-97a0-f1711e44348a Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:07.709902 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} executeQuery: (from [::1]:53062) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:07.710382 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:07.712103 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:07.712364 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:07.712780 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:07.714578 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:07.714652 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda6ddfa298) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:07.714659 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda6ddfa298) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:07.714760 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda6ddfa298) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.09.02 19:50:07.715078 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:07.716761 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:07.716824 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda6ddfac98) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:07.716831 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda6ddfac98) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:07.717208 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:07.718639 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:07.718869 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:07.718887 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:07.719014 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.09.02 19:50:07.719088 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:07.719129 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:07.720147 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda6ddfaa18) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0) 2024.09.02 19:50:07.720162 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda6ddfaa18) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)] 2024.09.02 19:50:07.720579 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:07.721018 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:07.721337 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:07.721573 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:07.721587 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:07.721723 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.09.02 19:50:07.721769 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:07.721799 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:07.721839 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda1d8ab518) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:07.721845 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda1d8ab518) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:07.721943 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda6ddfac98) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.09.02 19:50:07.722214 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:07.722412 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:07.722563 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:07.722575 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:07.722686 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.09.02 19:50:07.722735 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:07.722758 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:07.722762 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:07.722774 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.09.02 19:50:07.722794 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:07.722811 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:07.722821 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:07.722829 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.09.02 19:50:07.723085 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:07.723102 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:07.723123 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:07.723127 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:07.723132 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:07.723144 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.09.02 19:50:07.723150 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:07.723202 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:07.723211 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 8 rows starting from 0 2024.09.02 19:50:07.723282 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:07.723293 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:07.723301 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:07.723309 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.09.02 19:50:07.723314 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:07.723323 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.09.02 19:50:07.723327 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:07.723391 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:07.723399 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0 2024.09.02 19:50:07.723447 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.09.02 19:50:07.723460 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:07.723529 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:07.723542 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:07.723549 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:07.723553 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:07.723557 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:07.723566 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.09.02 19:50:07.723570 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:07.723614 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:07.723621 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0 2024.09.02 19:50:07.723652 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:07.723668 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.09.02 19:50:07.725592 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} executeQuery: Read 40 rows, 2.89 KiB in 0.015972 sec., 2504.3826696719257 rows/sec., 180.98 KiB/sec. 2024.09.02 19:50:07.725647 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda6ddfaa18) Join data is being destroyed, 12544 bytes and 8 rows in hash table 2024.09.02 19:50:07.725704 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} HashJoin: (0x7fda1d8ab518) Join data is being destroyed, 12800 bytes and 8 rows in hash table 2024.09.02 19:50:07.726129 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} DynamicQueryHandler: Done processing query 2024.09.02 19:50:07.726146 [ 205344 ] {4919a15b-d40b-4c3c-a9d1-d50aa801e512} MemoryTracker: Peak memory usage (for query): 4.00 MiB. 2024.09.02 19:50:07.726154 [ 205344 ] {} HTTP-Session: b9163fcb-1561-4cfa-97a0-f1711e44348a Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.727637 [ 205344 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:53062, User-Agent: (none), Length: 411, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:07.728308 [ 205344 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:07.728319 [ 205344 ] {} HTTP-Session: 76262c1b-fc05-4957-a9d7-a39840d80859 Authenticating user 'default' from [::1]:53062 2024.09.02 19:50:07.728334 [ 205344 ] {} HTTP-Session: 76262c1b-fc05-4957-a9d7-a39840d80859 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.728340 [ 205344 ] {} HTTP-Session: 76262c1b-fc05-4957-a9d7-a39840d80859 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.728385 [ 205344 ] {} HTTP-Session: 76262c1b-fc05-4957-a9d7-a39840d80859 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:07.728648 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} executeQuery: (from [::1]:53062) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (163777662738179873,3255198277614561830,4174330440898734823,5073661756869813506,6060338002058112069,10232564214925740701,10613593354210677318,16549134671421491687)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:07.729085 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.09.02 19:50:07.729392 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.09.02 19:50:07.731075 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:07.731094 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 10232564214925740701, 10613593354210677318, 16549134671421491687)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:07.731271 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local 2024.09.02 19:50:07.731320 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:07.731389 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:07.731555 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (SelectExecutor): Key condition: (column 1 in 8-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:07.732557 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps 2024.09.02 19:50:07.732580 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.09.02 19:50:07.732590 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (SelectExecutor): Spreading ranges among streams with order 2024.09.02 19:50:07.732674 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 10232564214925740701, 10613593354210677318, 16549134671421491687))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:07.732689 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 2024.09.02 19:50:07.733918 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} executeQuery: Read 400 rows, 25.78 KiB in 0.005405 sec., 74005.55041628121 rows/sec., 4.66 MiB/sec. 2024.09.02 19:50:07.735433 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} DynamicQueryHandler: Done processing query 2024.09.02 19:50:07.735453 [ 205344 ] {e356568f-5f57-423b-b5a1-2227c12ba13a} MemoryTracker: Peak memory usage (for query): 3.99 MiB. 2024.09.02 19:50:07.735467 [ 205344 ] {} HTTP-Session: 76262c1b-fc05-4957-a9d7-a39840d80859 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:07.997063 [ 206103 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.09.02 19:50:07.997630 [ 206103 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.09.02 19:50:07.998023 [ 206105 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.09.02 19:50:07.998103 [ 206103 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.09.02 19:50:07.998737 [ 206105 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.09.02 19:50:07.999272 [ 206105 ] {} Application: Setting max_server_memory_usage was set to 27.61 GiB (30.68 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.09.02 19:50:07.999284 [ 206105 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.34 GiB (30.68 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.09.02 19:50:07.999289 [ 206105 ] {} Application: Merges and mutations memory limit is set to 15.34 GiB 2024.09.02 19:50:07.999543 [ 206105 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor 2024.09.02 19:50:07.999556 [ 206105 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor 2024.09.02 19:50:07.999562 [ 206105 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor 2024.09.02 19:50:07.999566 [ 206105 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor 2024.09.02 19:50:07.999643 [ 206105 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.09.02 19:50:07.999658 [ 206105 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.09.02 19:50:07.999847 [ 206105 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.09.02 19:50:08.000318 [ 206105 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.09.02 19:50:08.000436 [ 206104 ] {} AsynchronousMetrics: MemoryTracking: was 389.98 MiB, peak 399.94 MiB, free memory in arenas 35.61 MiB, will set to 397.70 MiB (RSS), difference: 7.72 MiB 2024.09.02 19:50:08.090091 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.090122 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.090295 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=11, queue_size=11, entries=query-0000000000..query-0000000010, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000009, last_skipped_entry_name=none 2024.09.02 19:50:08.090305 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000010 2024.09.02 19:50:08.090309 [ 206108 ] {} DDLWorker: Checking task query-0000000010 2024.09.02 19:50:08.090905 [ 206108 ] {} DDLWorker: Processing task query-0000000010 (CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3') 2024.09.02 19:50:08.099694 [ 206108 ] {} DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3' 2024.09.02 19:50:08.099788 [ 206108 ] {905ec61d-9a6b-4e04-9e78-cbe1c2f07e5c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0e334290-cf3b-49db-a6d4-df4fa3a79ce2) /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3' (stage: Complete) 2024.09.02 19:50:08.099836 [ 206108 ] {905ec61d-9a6b-4e04-9e78-cbe1c2f07e5c} DDLWorker: Executed query: /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3' 2024.09.02 19:50:08.106197 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.223372 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.223383 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.223623 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=12, queue_size=12, entries=query-0000000000..query-0000000011, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000010, last_skipped_entry_name=none 2024.09.02 19:50:08.223642 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000011 2024.09.02 19:50:08.223648 [ 206108 ] {} DDLWorker: Checking task query-0000000011 2024.09.02 19:50:08.224159 [ 206108 ] {} DDLWorker: Processing task query-0000000011 (CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)) 2024.09.02 19:50:08.233411 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.09.02 19:50:08.233611 [ 206108 ] {9058f2ef-5d4d-4d18-83b3-21ca0968115d} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 434b2747-fa1d-42bc-94c8-45f3f74f317b) /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) 2024.09.02 19:50:08.233779 [ 206108 ] {9058f2ef-5d4d-4d18-83b3-21ca0968115d} DDLWorker: Executed query: /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.09.02 19:50:08.251907 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.403165 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.403171 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.403478 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=13, queue_size=13, entries=query-0000000000..query-0000000012, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000011, last_skipped_entry_name=none 2024.09.02 19:50:08.404056 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000012 2024.09.02 19:50:08.404066 [ 206108 ] {} DDLWorker: Checking task query-0000000012 2024.09.02 19:50:08.404680 [ 206108 ] {} DDLWorker: Processing task query-0000000012 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.09.02 19:50:08.410246 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.09.02 19:50:08.410457 [ 206108 ] {e7bea238-2b95-4b4d-81d1-674685d3ef6b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8ace4dfe-7928-4de3-a7d9-e18bb1f26969) /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.09.02 19:50:08.410624 [ 206108 ] {e7bea238-2b95-4b4d-81d1-674685d3ef6b} DDLWorker: Executed query: /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.09.02 19:50:08.413523 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.499536 [ 205345 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:56864, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:08.499631 [ 205345 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:08.500743 [ 205345 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (Replicated PartsService): Sending part all_0_0_0 2024.09.02 19:50:08.501184 [ 205345 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:08.531370 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.531511 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.531577 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=14, queue_size=14, entries=query-0000000000..query-0000000013, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000012, last_skipped_entry_name=none 2024.09.02 19:50:08.531596 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000013 2024.09.02 19:50:08.531600 [ 206108 ] {} DDLWorker: Checking task query-0000000013 2024.09.02 19:50:08.532236 [ 206108 ] {} DDLWorker: Processing task query-0000000013 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:08.540323 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:08.540520 [ 206108 ] {2333ae96-c10b-4ade-b75b-f60ac2c02b9c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 37189558-ff42-474d-ab2d-4505cd71d619) /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:08.540699 [ 206108 ] {2333ae96-c10b-4ade-b75b-f60ac2c02b9c} DDLWorker: Executed query: /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:08.547314 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.657582 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.657590 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.657816 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=15, queue_size=15, entries=query-0000000000..query-0000000014, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000013, last_skipped_entry_name=none 2024.09.02 19:50:08.657825 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000014 2024.09.02 19:50:08.657831 [ 206108 ] {} DDLWorker: Checking task query-0000000014 2024.09.02 19:50:08.658406 [ 206108 ] {} DDLWorker: Processing task query-0000000014 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.09.02 19:50:08.665979 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:08.666203 [ 206108 ] {067ee222-8391-45ba-a55e-6e24645f9a6e} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 52e0bd6c-57f7-404b-ac8a-c1c145cb962a) /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.09.02 19:50:08.666500 [ 206108 ] {067ee222-8391-45ba-a55e-6e24645f9a6e} DDLWorker: Executed query: /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:08.675073 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.842490 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.842551 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.842804 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=16, queue_size=16, entries=query-0000000000..query-0000000015, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000014, last_skipped_entry_name=none 2024.09.02 19:50:08.844553 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000015 2024.09.02 19:50:08.844566 [ 206108 ] {} DDLWorker: Checking task query-0000000015 2024.09.02 19:50:08.845267 [ 206108 ] {} DDLWorker: Processing task query-0000000015 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:08.857862 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:08.858135 [ 206108 ] {93267dea-56bd-4fe4-bbb3-9d08f366f345} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c2d8387b-0b77-4c12-a4d5-0e5372331992) /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:08.858417 [ 206108 ] {93267dea-56bd-4fe4-bbb3-9d08f366f345} DDLWorker: Executed query: /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:08.865289 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.988010 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.988020 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.988296 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=17, queue_size=17, entries=query-0000000000..query-0000000016, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000015, last_skipped_entry_name=none 2024.09.02 19:50:08.988311 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000016 2024.09.02 19:50:08.988317 [ 206108 ] {} DDLWorker: Checking task query-0000000016 2024.09.02 19:50:08.989060 [ 206108 ] {} DDLWorker: Processing task query-0000000016 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.09.02 19:50:08.996684 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:08.996927 [ 206108 ] {65b7b459-2160-4a05-9809-8ad8fa4472a3} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 29ec56c2-ebf7-4c6a-972e-826e0b263337) /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.09.02 19:50:08.997213 [ 206108 ] {65b7b459-2160-4a05-9809-8ad8fa4472a3} DDLWorker: Executed query: /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:09.005016 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:09.144842 [ 205345 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:56864, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:09.144891 [ 205345 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:09.144904 [ 205345 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (Replicated PartsService): Sending part all_0_0_0 2024.09.02 19:50:09.146840 [ 205345 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:09.181079 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:09.181084 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:09.181233 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=18, queue_size=18, entries=query-0000000000..query-0000000017, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000016, last_skipped_entry_name=none 2024.09.02 19:50:09.181241 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000017 2024.09.02 19:50:09.181244 [ 206108 ] {} DDLWorker: Checking task query-0000000017 2024.09.02 19:50:09.181600 [ 206108 ] {} DDLWorker: Processing task query-0000000017 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:09.197210 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:09.197414 [ 206108 ] {c8eeb61d-adc7-468f-acc8-c66eda6b8db4} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b26d03ab-2e2b-49cd-9b59-6df10b4b32a7) /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:09.197664 [ 206108 ] {c8eeb61d-adc7-468f-acc8-c66eda6b8db4} DDLWorker: Executed query: /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:09.204395 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:09.308230 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:09.308427 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:09.308437 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=19, queue_size=19, entries=query-0000000000..query-0000000018, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000017, last_skipped_entry_name=none 2024.09.02 19:50:09.308473 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000018 2024.09.02 19:50:09.308503 [ 206108 ] {} DDLWorker: Checking task query-0000000018 2024.09.02 19:50:09.309211 [ 206108 ] {} DDLWorker: Processing task query-0000000018 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)) 2024.09.02 19:50:09.333751 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.09.02 19:50:09.334017 [ 206108 ] {0d3092ea-0cfd-43c6-889d-1cc31f1c6b99} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 454fe081-af0d-4e06-9b21-59389f961b7a) /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) 2024.09.02 19:50:09.334427 [ 206108 ] {0d3092ea-0cfd-43c6-889d-1cc31f1c6b99} DDLWorker: Executed query: /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.09.02 19:50:09.346749 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:09.462482 [ 205345 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:56864, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:09.462528 [ 205345 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ftimeseries_schema_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:09.462539 [ 205345 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (Replicated PartsService): Sending part all_0_0_0 2024.09.02 19:50:09.462947 [ 205345 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:09.499135 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:09.499141 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:09.499372 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000018, last_skipped_entry_name=none 2024.09.02 19:50:09.500349 [ 206108 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000019 2024.09.02 19:50:09.500360 [ 206108 ] {} DDLWorker: Checking task query-0000000019 2024.09.02 19:50:09.501167 [ 206108 ] {} DDLWorker: Processing task query-0000000019 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:09.507976 [ 206108 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:09.508179 [ 206108 ] {0026f87c-5101-48e8-826b-e4b6de0b942c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 85056d0b-f852-4bad-8f4f-7ed622143aae) /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:09.508478 [ 206108 ] {0026f87c-5101-48e8-826b-e4b6de0b942c} DDLWorker: Executed query: /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:09.511505 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:10.109109 [ 205938 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.09.02 19:50:10.114457 [ 205938 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.09.02 19:50:10.114474 [ 205938 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:10.114988 [ 206038 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Fetching part all_1_1_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 2024.09.02 19:50:10.115120 [ 206038 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.09.02 19:50:10.115193 [ 206038 ] {} HTTPSessionAdapter: Created HTTP(S) session with ::1:19403 (::1:19403) 2024.09.02 19:50:10.116185 [ 206038 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:10.116207 [ 206038 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.66 GiB. 2024.09.02 19:50:10.116214 [ 206038 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:10.116223 [ 206038 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (Fetcher): Downloading part all_1_1_0 onto disk default. 2024.09.02 19:50:10.118563 [ 206038 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (Fetcher): Download of part all_1_1_0 onto disk default finished. 2024.09.02 19:50:10.118582 [ 206038 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:10.118619 [ 206038 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Committing part all_1_1_0 to zookeeper 2024.09.02 19:50:10.125902 [ 206038 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Part all_1_1_0 committed to zookeeper 2024.09.02 19:50:10.125950 [ 206038 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Fetched part all_1_1_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 2024.09.02 19:50:10.126038 [ 205947 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89475584000, merge_with_ttl_allowedtrue) 2024.09.02 19:50:10.126062 [ 205947 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 9993ms 2024.09.02 19:50:10.146183 [ 205961 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.09.02 19:50:10.151440 [ 205961 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.09.02 19:50:10.151474 [ 205961 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:10.152142 [ 206027 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Fetching part all_1_1_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3 2024.09.02 19:50:10.153017 [ 206027 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.09.02 19:50:10.157484 [ 206027 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:10.157517 [ 206027 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.66 GiB. 2024.09.02 19:50:10.157526 [ 206027 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:10.157540 [ 206027 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (Fetcher): Downloading part all_1_1_0 onto disk default. 2024.09.02 19:50:10.158513 [ 206027 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (Fetcher): Download of part all_1_1_0 onto disk default finished. 2024.09.02 19:50:10.159677 [ 206027 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:10.159735 [ 206027 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Committing part all_1_1_0 to zookeeper 2024.09.02 19:50:10.173813 [ 206027 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Part all_1_1_0 committed to zookeeper 2024.09.02 19:50:10.173874 [ 206027 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Fetched part all_1_1_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3 2024.09.02 19:50:10.174010 [ 205973 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89475301376, merge_with_ttl_allowedtrue) 2024.09.02 19:50:10.174037 [ 205973 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 9299ms 2024.09.02 19:50:10.187903 [ 205962 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.09.02 19:50:10.195435 [ 205962 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.09.02 19:50:10.195469 [ 205962 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:10.195925 [ 206046 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Fetching part all_1_1_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/3 2024.09.02 19:50:10.196097 [ 206046 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.09.02 19:50:10.197744 [ 206046 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:10.197768 [ 206046 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.66 GiB. 2024.09.02 19:50:10.197775 [ 206046 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:10.197787 [ 206046 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (Fetcher): Downloading part all_1_1_0 onto disk default. 2024.09.02 19:50:10.200239 [ 206046 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (Fetcher): Download of part all_1_1_0 onto disk default finished. 2024.09.02 19:50:10.200268 [ 206046 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:10.201431 [ 206046 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Committing part all_1_1_0 to zookeeper 2024.09.02 19:50:10.211536 [ 206046 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Part all_1_1_0 committed to zookeeper 2024.09.02 19:50:10.211587 [ 206046 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Fetched part all_1_1_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/3 2024.09.02 19:50:10.211676 [ 205974 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89475094528, merge_with_ttl_allowedtrue) 2024.09.02 19:50:10.211698 [ 205974 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 10037ms 2024.09.02 19:50:10.242764 [ 205344 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:53062, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.244090 [ 205344 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:10.244105 [ 205344 ] {} HTTP-Session: c4d31023-7085-4be2-b59b-de6fc0848f97 Authenticating user 'default' from [::1]:53062 2024.09.02 19:50:10.244117 [ 205344 ] {} HTTP-Session: c4d31023-7085-4be2-b59b-de6fc0848f97 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.244121 [ 205344 ] {} HTTP-Session: c4d31023-7085-4be2-b59b-de6fc0848f97 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.244162 [ 205344 ] {} HTTP-Session: c4d31023-7085-4be2-b59b-de6fc0848f97 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:10.244480 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} executeQuery: (from [::1]:53062) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:10.244987 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.246025 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.246278 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.246611 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.247693 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.248480 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda6ddfac98) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:10.248490 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda6ddfac98) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:10.248578 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda6ddfac98) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.09.02 19:50:10.248827 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.249300 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.251236 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda1d8ab018) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:10.251243 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda1d8ab018) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:10.251838 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.252038 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.252215 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:10.253724 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:10.253850 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.09.02 19:50:10.253887 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.253911 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:10.253945 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda9554ef18) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0) 2024.09.02 19:50:10.253951 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda9554ef18) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)] 2024.09.02 19:50:10.254232 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.255555 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.255714 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.255866 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:10.255879 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:10.255985 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.09.02 19:50:10.256855 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.256899 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:10.256936 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda9554f698) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:10.256942 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda9554f698) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:10.257014 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda1d8ab018) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.09.02 19:50:10.257218 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.257404 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.257551 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:10.257563 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:10.257687 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.09.02 19:50:10.258564 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.258592 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:10.258596 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.258607 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.09.02 19:50:10.258622 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.258646 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.258660 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.258668 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.258902 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:10.258994 [ 207074 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:10.258999 [ 207087 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.09.02 19:50:10.259026 [ 207074 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.259034 [ 207074 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:10.259029 [ 207087 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.259050 [ 207087 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:10.259050 [ 207074 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.259063 [ 207087 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.259132 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.09.02 19:50:10.259141 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:10.259217 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.09.02 19:50:10.259237 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (SelectExecutor): Reading approx. 16 rows with 2 streams 2024.09.02 19:50:10.259268 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.259298 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.259374 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:10.259431 [ 207085 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:10.259456 [ 207075 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.09.02 19:50:10.260500 [ 207085 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.260514 [ 207085 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.09.02 19:50:10.260520 [ 207085 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.260519 [ 207075 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.260529 [ 207075 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.09.02 19:50:10.260534 [ 207075 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.260590 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.09.02 19:50:10.260600 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:10.260665 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.09.02 19:50:10.260671 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Reading approx. 32 rows with 2 streams 2024.09.02 19:50:10.260704 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.260754 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.260802 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.09.02 19:50:10.260814 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.260876 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:10.260956 [ 207074 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:10.260966 [ 207074 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.260970 [ 207074 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:10.260977 [ 207074 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.260993 [ 207086 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.09.02 19:50:10.261032 [ 207086 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.261044 [ 207086 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:10.261060 [ 207086 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.261126 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.09.02 19:50:10.261138 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:10.261213 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.09.02 19:50:10.261225 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (SelectExecutor): Reading approx. 32 rows with 2 streams 2024.09.02 19:50:10.261306 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.261371 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.261433 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.261449 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.263023 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} executeQuery: Read 80 rows, 5.78 KiB in 0.018737 sec., 4269.6269413459995 rows/sec., 308.55 KiB/sec. 2024.09.02 19:50:10.263101 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda9554ef18) Join data is being destroyed, 12800 bytes and 16 rows in hash table 2024.09.02 19:50:10.263156 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} HashJoin: (0x7fda9554f698) Join data is being destroyed, 13312 bytes and 16 rows in hash table 2024.09.02 19:50:10.263438 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} DynamicQueryHandler: Done processing query 2024.09.02 19:50:10.263449 [ 205344 ] {a0c68ef5-2833-48d8-a089-fe1373cff62d} MemoryTracker: Peak memory usage (for query): 5.25 MiB. 2024.09.02 19:50:10.263458 [ 205344 ] {} HTTP-Session: c4d31023-7085-4be2-b59b-de6fc0848f97 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.264642 [ 205344 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:53062, User-Agent: (none), Length: 577, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.265987 [ 205344 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:10.266000 [ 205344 ] {} HTTP-Session: c7c312b0-c286-4f3d-b362-b9e9d9c1de7b Authenticating user 'default' from [::1]:53062 2024.09.02 19:50:10.266009 [ 205344 ] {} HTTP-Session: c7c312b0-c286-4f3d-b362-b9e9d9c1de7b Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.266013 [ 205344 ] {} HTTP-Session: c7c312b0-c286-4f3d-b362-b9e9d9c1de7b Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.266042 [ 205344 ] {} HTTP-Session: c7c312b0-c286-4f3d-b362-b9e9d9c1de7b Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:10.266221 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} executeQuery: (from [::1]:53062) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (163777662738179873,3255198277614561830,4174330440898734823,5073661756869813506,6060338002058112069,6258172585252991913,7444263327486421469,10232564214925740701,10613593354210677318,10652587399320292971,10860360997898340759,12041534140654173142,14895190478290584883,14922767736603850140,15077062082775085482,16549134671421491687)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:10.266564 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.09.02 19:50:10.268567 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.09.02 19:50:10.268822 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:10.268844 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 6258172585252991913, 7444263327486421469, 10232564214925740701, 10613593354210677318, 10652587399320292971, 10860360997898340759, 12041534140654173142, 14895190478290584883, 14922767736603850140, 15077062082775085482, 16549134671421491687)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:10.269056 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local 2024.09.02 19:50:10.270233 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.270295 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:10.270438 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (SelectExecutor): Key condition: (column 1 in 16-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:10.270533 [ 207085 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (SelectExecutor): Used generic exclusion search over index for part all_1_1_0 with 1 steps 2024.09.02 19:50:10.270564 [ 207087 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps 2024.09.02 19:50:10.270630 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.09.02 19:50:10.270638 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (SelectExecutor): Spreading ranges among streams with order 2024.09.02 19:50:10.270710 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 6258172585252991913, 7444263327486421469, 10232564214925740701, 10613593354210677318, 10652587399320292971, 10860360997898340759, 12041534140654173142, 14895190478290584883, 14922767736603850140, 15077062082775085482, 16549134671421491687))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.270720 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_1_1_0, approx. 400 rows starting from 0 2024.09.02 19:50:10.270769 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 6258172585252991913, 7444263327486421469, 10232564214925740701, 10613593354210677318, 10652587399320292971, 10860360997898340759, 12041534140654173142, 14895190478290584883, 14922767736603850140, 15077062082775085482, 16549134671421491687))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.270776 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 2024.09.02 19:50:10.273508 [ 207443 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} MergingSortedTransform: Merge sorted 1 blocks, 800 rows in 0.004000063 sec., 199996.85004961173 rows/sec., 8.06 MiB/sec 2024.09.02 19:50:10.274267 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} executeQuery: Read 800 rows, 51.56 KiB in 0.008126 sec., 98449.42160964805 rows/sec., 6.20 MiB/sec. 2024.09.02 19:50:10.275427 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} DynamicQueryHandler: Done processing query 2024.09.02 19:50:10.275444 [ 205344 ] {ede023dc-6e0f-475a-ad4e-d8a1fb2c985c} MemoryTracker: Peak memory usage (for query): 4.17 MiB. 2024.09.02 19:50:10.275451 [ 205344 ] {} HTTP-Session: c7c312b0-c286-4f3d-b362-b9e9d9c1de7b Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.711674 [ 207713 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:56870, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.711667 [ 205346 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:56868, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.711796 [ 205346 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F2&part=all_1_1_0&client_protocol_version=8&compress=false 2024.09.02 19:50:10.711816 [ 205346 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (Replicated PartsService): Sending part all_1_1_0 2024.09.02 19:50:10.712330 [ 205346 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:10.714528 [ 207713 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F2&part=all_1_1_0&client_protocol_version=8&compress=false 2024.09.02 19:50:10.714546 [ 207713 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (Replicated PartsService): Sending part all_1_1_0 2024.09.02 19:50:10.715020 [ 207713 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:11.001644 [ 206104 ] {} AsynchronousMetrics: MemoryTracking: was 398.01 MiB, peak 404.28 MiB, free memory in arenas 31.78 MiB, will set to 392.31 MiB (RSS), difference: -5.70 MiB 2024.09.02 19:50:11.879453 [ 205795 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 8514ms 2024.09.02 19:50:12.000671 [ 206103 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.09.02 19:50:12.002488 [ 206104 ] {} AsynchronousMetrics: MemoryTracking: was 402.28 MiB, peak 404.28 MiB, free memory in arenas 31.65 MiB, will set to 399.20 MiB (RSS), difference: -3.08 MiB 2024.09.02 19:50:12.003346 [ 206105 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.09.02 19:50:12.004198 [ 206103 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.09.02 19:50:12.004734 [ 206103 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.09.02 19:50:12.005929 [ 206105 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.09.02 19:50:12.006399 [ 206105 ] {} Application: Setting max_server_memory_usage was set to 27.61 GiB (30.68 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.09.02 19:50:12.006406 [ 206105 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.34 GiB (30.68 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.09.02 19:50:12.006409 [ 206105 ] {} Application: Merges and mutations memory limit is set to 15.34 GiB 2024.09.02 19:50:12.006580 [ 206105 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor 2024.09.02 19:50:12.006587 [ 206105 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor 2024.09.02 19:50:12.006590 [ 206105 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor 2024.09.02 19:50:12.006599 [ 206105 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor 2024.09.02 19:50:12.006619 [ 206105 ] {} ZooKeeperClient: Finalizing session 5. finalization_started: false, queue_finished: false, reason: 'Config changed' 2024.09.02 19:50:12.006718 [ 206105 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:12.006751 [ 206105 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:12.006775 [ 206105 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:12.006795 [ 206105 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:12.006814 [ 206105 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:12.006803 [ 205774 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:12.006849 [ 205774 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/2/is_active since session has been expired 2024.09.02 19:50:12.006857 [ 205774 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Waiting for threads to finish 2024.09.02 19:50:12.006833 [ 205824 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:12.006805 [ 205800 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:12.006896 [ 205800 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/is_active since session has been expired 2024.09.02 19:50:12.006898 [ 205824 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/2/is_active since session has been expired 2024.09.02 19:50:12.006906 [ 205824 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Waiting for threads to finish 2024.09.02 19:50:12.006895 [ 205809 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:12.006957 [ 205809 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/2/is_active since session has been expired 2024.09.02 19:50:12.006961 [ 205809 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Waiting for threads to finish 2024.09.02 19:50:12.006907 [ 205800 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Waiting for threads to finish 2024.09.02 19:50:12.007162 [ 205774 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Threads finished 2024.09.02 19:50:12.007304 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:12.007309 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:12.006809 [ 205803 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:12.007353 [ 205803 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/2/is_active since session has been expired 2024.09.02 19:50:12.007361 [ 205803 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Waiting for threads to finish 2024.09.02 19:50:12.007644 [ 206108 ] {} DDLWorker: Lost ZooKeeper connection, will try to connect again: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x00000000138481b1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f728e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f6d96 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f7a7b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x00000000137f75ff in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::DDLWorker::scheduleTasks(bool) @ 0x00000000116ee6b7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::DDLWorker::runMainThread() @ 0x00000000116e75be in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. ? @ 0x00007fdab736fac3 in ? 14. ? @ 0x00007fdab7401850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:12.007773 [ 205824 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Threads finished 2024.09.02 19:50:12.009797 [ 205836 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x00000000074d2e8d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. void std::__function::__policy_invoker::__call_impl, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000001289d6ae in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. ? @ 0x00007fdab736fac3 in ? 7. ? @ 0x00007fdab7401850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:12.009976 [ 205778 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x00000000138481b1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f728e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f6d96 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f7a7b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f7971 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x0000000012ee47c8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. void std::__function::__policy_invoker::__call_impl, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool)::$_2, void ()>>(std::__function::__policy_storage const*) @ 0x000000001289dec0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. ? @ 0x00007fdab736fac3 in ? 15. ? @ 0x00007fdab7401850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:12.010128 [ 205800 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Threads finished 2024.09.02 19:50:12.012036 [ 205790 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::get(String const&, std::function, std::shared_ptr>) @ 0x0000000013847605 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. zkutil::ZooKeeper::getImpl(String const&, String&, Coordination::Stat*, std::function) @ 0x00000000137fa0bb in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function, Coordination::Error*) @ 0x00000000137fa7df in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*) @ 0x00000000137fa6c8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::get(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x00000000137fa518 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::ReplicatedMergeTreeQueue::pullLogsToQueue(std::shared_ptr, std::function, DB::ReplicatedMergeTreeQueue::PullLogsReason) @ 0x0000000012eddcf5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. void std::__function::__policy_invoker::__call_impl, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000001289d59f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. ? @ 0x00007fdab736fac3 in ? 15. ? @ 0x00007fdab7401850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:12.012105 [ 205807 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x00000000138481b1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f728e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f6d96 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f7a7b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f7971 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x0000000012ee47c8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. void std::__function::__policy_invoker::__call_impl, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool)::$_2, void ()>>(std::__function::__policy_storage const*) @ 0x000000001289dec0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. ? @ 0x00007fdab736fac3 in ? 15. ? @ 0x00007fdab7401850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:12.012143 [ 205773 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::get(String const&, std::function, std::shared_ptr>) @ 0x0000000013847605 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. zkutil::ZooKeeper::getImpl(String const&, String&, Coordination::Stat*, std::function) @ 0x00000000137fa0bb in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::tryGetWatch(String const&, String&, Coordination::Stat*, std::function, Coordination::Error*) @ 0x00000000137fa7df in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::tryGet(String const&, String&, Coordination::Stat*, std::shared_ptr const&, Coordination::Error*) @ 0x00000000137fa6c8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::get(String const&, Coordination::Stat*, std::shared_ptr const&) @ 0x00000000137fa518 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::ReplicatedMergeTreeQueue::pullLogsToQueue(std::shared_ptr, std::function, DB::ReplicatedMergeTreeQueue::PullLogsReason) @ 0x0000000012eddcf5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. void std::__function::__policy_invoker::__call_impl, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool)::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x000000001289d59f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. ? @ 0x00007fdab736fac3 in ? 15. ? @ 0x00007fdab7401850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:12.012176 [ 205767 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x00000000138481b1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f728e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f6d96 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f7a7b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::getChildrenWatch(String const&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f7971 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr>) @ 0x0000000012ee47c8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. void std::__function::__policy_invoker::__call_impl, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::RenamingRestrictions, bool)::$_2, void ()>>(std::__function::__policy_storage const*) @ 0x000000001289dec0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::BackgroundSchedulePool::threadFunction() @ 0x00000000110c859f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000110c95d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. ? @ 0x00007fdab736fac3 in ? 15. ? @ 0x00007fdab7401850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:12.012275 [ 205809 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Threads finished 2024.09.02 19:50:12.012310 [ 205803 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Threads finished 2024.09.02 19:50:12.018463 [ 206105 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19001 with session_id 9 2024.09.02 19:50:12.018639 [ 206105 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.09.02 19:50:12.018645 [ 206105 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.09.02 19:50:12.018647 [ 206105 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.09.02 19:50:12.018652 [ 206105 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19003 2024.09.02 19:50:12.018683 [ 205774 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:12.018707 [ 205824 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:12.018720 [ 205800 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:12.018735 [ 205809 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:12.018745 [ 206105 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.09.02 19:50:12.018744 [ 205803 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:12.018764 [ 206105 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.09.02 19:50:12.018887 [ 206105 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.09.02 19:50:12.020428 [ 206105 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.09.02 19:50:12.043194 [ 205824 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:12.043219 [ 205800 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:12.043199 [ 205774 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:12.043333 [ 205809 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:12.043340 [ 205803 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:12.043356 [ 205824 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:12.043368 [ 205824 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue 2024.09.02 19:50:12.043435 [ 205800 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:12.043446 [ 205800 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue 2024.09.02 19:50:12.043459 [ 205774 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:12.043464 [ 205809 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:12.043478 [ 205809 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue 2024.09.02 19:50:12.043467 [ 205774 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue 2024.09.02 19:50:12.043549 [ 205803 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:12.043558 [ 205803 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue 2024.09.02 19:50:12.043570 [ 205824 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:12.043632 [ 205800 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:12.043641 [ 205809 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:12.043644 [ 205774 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:12.043700 [ 205803 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:12.043708 [ 205824 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:12.043796 [ 205800 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:12.043806 [ 205809 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:12.043815 [ 205774 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:12.043829 [ 205803 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:12.044739 [ 205824 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:12.044788 [ 205835 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768192000, merge_with_ttl_allowedtrue) 2024.09.02 19:50:12.044823 [ 205835 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 10873ms 2024.09.02 19:50:12.044835 [ 205800 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:12.044883 [ 205792 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768192000, merge_with_ttl_allowedtrue) 2024.09.02 19:50:12.044906 [ 205792 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 12085ms 2024.09.02 19:50:12.045062 [ 205774 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:12.045076 [ 205803 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:12.045096 [ 205774 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768189952, merge_with_ttl_allowedtrue) 2024.09.02 19:50:12.045113 [ 205774 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 13176ms 2024.09.02 19:50:12.045191 [ 205812 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 10563ms 2024.09.02 19:50:12.045290 [ 205809 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:12.045338 [ 205785 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768189952, merge_with_ttl_allowedtrue) 2024.09.02 19:50:12.045380 [ 205785 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 11481ms 2024.09.02 19:50:12.045792 [ 205824 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/timeseries_schema_local/blocks 2024.09.02 19:50:12.045814 [ 205786 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks 2024.09.02 19:50:12.045894 [ 205897 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks 2024.09.02 19:50:12.045896 [ 205803 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks 2024.09.02 19:50:12.046095 [ 205774 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 6664ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:12.046318 [ 205824 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 5237ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:12.046368 [ 205786 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 6347ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:12.046440 [ 205897 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 5586ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:12.046447 [ 205803 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 5982ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:12.295726 [ 205801 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000002 - log-0000000002 2024.09.02 19:50:12.312544 [ 205801 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_2_2_0] 2024.09.02 19:50:12.312565 [ 205801 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:12.319911 [ 206047 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Fetching part all_2_2_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 2024.09.02 19:50:12.320098 [ 206047 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_2_2_0&client_protocol_version=8&compress=false 2024.09.02 19:50:12.321573 [ 206047 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:12.321598 [ 206047 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 167.20 GiB. 2024.09.02 19:50:12.321606 [ 206047 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:12.321618 [ 206047 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (Fetcher): Downloading part all_2_2_0 onto disk default. 2024.09.02 19:50:12.323687 [ 206047 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (Fetcher): Download of part all_2_2_0 onto disk default finished. 2024.09.02 19:50:12.323707 [ 206047 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Renaming temporary part tmp-fetch_all_2_2_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:12.323752 [ 206047 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Committing part all_2_2_0 to zookeeper 2024.09.02 19:50:12.338328 [ 206047 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Part all_2_2_0 committed to zookeeper 2024.09.02 19:50:12.338412 [ 206047 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Fetched part all_2_2_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 2024.09.02 19:50:12.338536 [ 205834 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89767362560, merge_with_ttl_allowedtrue) 2024.09.02 19:50:12.338570 [ 205834 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 16155ms 2024.09.02 19:50:13.001328 [ 206104 ] {} AsynchronousMetrics: MemoryTracking: was 394.07 MiB, peak 404.28 MiB, free memory in arenas 32.95 MiB, will set to 402.82 MiB (RSS), difference: 8.75 MiB 2024.09.02 19:50:13.007727 [ 206108 ] {} DDLWorker: Initializing DDLWorker thread 2024.09.02 19:50:13.013215 [ 206108 ] {} DDLWorker: Initialized DDLWorker thread 2024.09.02 19:50:13.013231 [ 206108 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:13.013236 [ 206108 ] {} DDLWorker: Have 1 unfinished tasks, will check them 2024.09.02 19:50:13.013240 [ 206107 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:13.013369 [ 206108 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000019, last_skipped_entry_name=none 2024.09.02 19:50:13.013377 [ 206108 ] {} DDLWorker: No tasks to schedule 2024.09.02 19:50:13.013380 [ 206108 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:14.960169 [ 205918 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:50:14.960213 [ 205918 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:50:22.608375 [ 205830 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 13713ms 2024.09.02 19:50:22.918018 [ 205796 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89900279808, merge_with_ttl_allowedtrue) 2024.09.02 19:50:22.918064 [ 205796 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 14313ms 2024.09.02 19:50:23.526556 [ 205807 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89899421696, merge_with_ttl_allowedtrue) 2024.09.02 19:50:23.526591 [ 205807 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 14285ms 2024.09.02 19:50:24.130047 [ 205767 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89898393600, merge_with_ttl_allowedtrue) 2024.09.02 19:50:24.130082 [ 205767 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 15541ms 2024.09.02 19:50:28.493720 [ 205813 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89892003840, merge_with_ttl_allowedtrue) 2024.09.02 19:50:28.493752 [ 205813 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 21166ms 2024.09.02 19:50:29.960321 [ 205788 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:50:29.960355 [ 205788 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:50:32.000486 [ 206104 ] {} AsynchronousMetrics: MemoryTracking: was 402.98 MiB, peak 404.28 MiB, free memory in arenas 29.23 MiB, will set to 398.14 MiB (RSS), difference: -4.84 MiB 2024.09.02 19:50:36.321543 [ 205911 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 17635ms 2024.09.02 19:50:37.231230 [ 205926 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89878593536, merge_with_ttl_allowedtrue) 2024.09.02 19:50:37.231259 [ 205926 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 17314ms 2024.09.02 19:50:37.811752 [ 205924 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89877657600, merge_with_ttl_allowedtrue) 2024.09.02 19:50:37.811782 [ 205924 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 17855ms 2024.09.02 19:50:39.671290 [ 205933 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89875040256, merge_with_ttl_allowedtrue) 2024.09.02 19:50:39.671342 [ 205933 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 19487ms 2024.09.02 19:50:44.960469 [ 205936 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:50:44.960506 [ 205936 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:50:45.000541 [ 206104 ] {} AsynchronousMetrics: MemoryTracking: was 398.15 MiB, peak 404.28 MiB, free memory in arenas 21.63 MiB, will set to 391.18 MiB (RSS), difference: -6.98 MiB 2024.09.02 19:50:49.659918 [ 205974 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89859786752, merge_with_ttl_allowedtrue) 2024.09.02 19:50:49.659952 [ 205974 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 25552ms 2024.09.02 19:50:53.956717 [ 205987 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 21252ms 2024.09.02 19:50:54.545427 [ 205825 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89851779072, merge_with_ttl_allowedtrue) 2024.09.02 19:50:54.545463 [ 205825 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 21642ms 2024.09.02 19:50:55.666924 [ 205795 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89850261504, merge_with_ttl_allowedtrue) 2024.09.02 19:50:55.666959 [ 205795 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 22185ms 2024.09.02 19:50:59.158559 [ 205821 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89845319680, merge_with_ttl_allowedtrue) 2024.09.02 19:50:59.158620 [ 205821 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 25571ms 2024.09.02 19:50:59.960617 [ 205827 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:50:59.960656 [ 205827 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:51:14.960746 [ 205897 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:51:14.960783 [ 205897 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:51:15.208896 [ 205829 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 27604ms 2024.09.02 19:51:15.212127 [ 205801 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89919514624, merge_with_ttl_allowedtrue) 2024.09.02 19:51:15.212194 [ 205801 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 31533ms 2024.09.02 19:51:16.187622 [ 205898 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89917990912, merge_with_ttl_allowedtrue) 2024.09.02 19:51:16.187651 [ 205898 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 28065ms 2024.09.02 19:51:17.852101 [ 205911 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89915412480, merge_with_ttl_allowedtrue) 2024.09.02 19:51:17.852134 [ 205911 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 26976ms 2024.09.02 19:51:24.729750 [ 205903 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89924442112, merge_with_ttl_allowedtrue) 2024.09.02 19:51:24.729789 [ 205903 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 33300ms 2024.09.02 19:51:29.960895 [ 205939 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:51:29.960954 [ 205939 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:51:42.813056 [ 205974 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 34621ms 2024.09.02 19:51:44.252848 [ 205990 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89925423104, merge_with_ttl_allowedtrue) 2024.09.02 19:51:44.252898 [ 205990 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 36449ms 2024.09.02 19:51:44.828304 [ 205985 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89925158912, merge_with_ttl_allowedtrue) 2024.09.02 19:51:44.828338 [ 205985 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 34357ms 2024.09.02 19:51:44.961063 [ 205965 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:51:44.961107 [ 205965 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:51:46.745372 [ 205950 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89922332672, merge_with_ttl_allowedtrue) 2024.09.02 19:51:46.745416 [ 205950 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 37938ms 2024.09.02 19:51:58.029949 [ 205857 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89904605184, merge_with_ttl_allowedtrue) 2024.09.02 19:51:58.029980 [ 205857 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 42616ms 2024.09.02 19:51:59.961224 [ 205770 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:51:59.962810 [ 205770 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:52:00.001677 [ 206104 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 9.612e-05 sec. 2024.09.02 19:52:14.962928 [ 205791 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:52:14.963017 [ 205791 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:52:17.434209 [ 205897 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 41899ms 2024.09.02 19:52:19.185516 [ 205801 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89872947200, merge_with_ttl_allowedtrue) 2024.09.02 19:52:19.185561 [ 205801 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 42682ms 2024.09.02 19:52:20.702217 [ 205931 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89871040512, merge_with_ttl_allowedtrue) 2024.09.02 19:52:20.702323 [ 205931 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 47448ms 2024.09.02 19:52:24.683600 [ 205910 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89864007680, merge_with_ttl_allowedtrue) 2024.09.02 19:52:24.683624 [ 205910 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 47417ms 2024.09.02 19:52:29.963115 [ 205932 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:52:29.963155 [ 205932 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:52:40.646130 [ 205939 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89839280128, merge_with_ttl_allowedtrue) 2024.09.02 19:52:40.646158 [ 205939 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 53168ms 2024.09.02 19:52:44.963265 [ 205945 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:52:44.963311 [ 205945 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:52:59.333358 [ 205965 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 54400ms 2024.09.02 19:52:59.963434 [ 205989 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:52:59.963479 [ 205989 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:53:01.867758 [ 205970 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89808254976, merge_with_ttl_allowedtrue) 2024.09.02 19:53:01.867801 [ 205970 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 52907ms 2024.09.02 19:53:08.150488 [ 205830 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89797703680, merge_with_ttl_allowedtrue) 2024.09.02 19:53:08.150521 [ 205830 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 19:53:12.100798 [ 205770 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89792092160, merge_with_ttl_allowedtrue) 2024.09.02 19:53:12.100833 [ 205770 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:53:14.963574 [ 205808 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:53:14.965202 [ 205808 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:53:26.000502 [ 206104 ] {} AsynchronousMetrics: MemoryTracking: was 391.05 MiB, peak 404.28 MiB, free memory in arenas 11.07 MiB, will set to 386.05 MiB (RSS), difference: -5.00 MiB 2024.09.02 19:53:29.965315 [ 205788 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:53:29.965350 [ 205788 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:53:33.814293 [ 205774 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89758298112, merge_with_ttl_allowedtrue) 2024.09.02 19:53:33.814310 [ 205774 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 60000ms 2024.09.02 19:53:44.965480 [ 205899 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:53:44.965528 [ 205899 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:53:53.735142 [ 205932 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 60000ms 2024.09.02 19:53:54.774943 [ 205902 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89726275584, merge_with_ttl_allowedtrue) 2024.09.02 19:53:54.774964 [ 205902 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:53:59.965642 [ 205905 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:53:59.965699 [ 205905 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:54:00.001694 [ 206104 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.0001041 sec. 2024.09.02 19:54:08.150701 [ 205941 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89705895936, merge_with_ttl_allowedtrue) 2024.09.02 19:54:08.150738 [ 205941 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 19:54:12.100965 [ 205973 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89700003840, merge_with_ttl_allowedtrue) 2024.09.02 19:54:12.100981 [ 205973 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:54:14.965817 [ 205956 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:54:14.965856 [ 205956 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:54:29.965948 [ 205795 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:54:29.965985 [ 205795 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:54:33.814500 [ 205790 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89665290240, merge_with_ttl_allowedtrue) 2024.09.02 19:54:33.814537 [ 205790 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 60000ms 2024.09.02 19:54:44.966205 [ 205817 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:54:44.966348 [ 205817 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:54:53.735307 [ 205882 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 60000ms 2024.09.02 19:54:54.775127 [ 205928 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89632401408, merge_with_ttl_allowedtrue) 2024.09.02 19:54:54.775156 [ 205928 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:54:59.966440 [ 205811 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:54:59.966474 [ 205811 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:55:00.000616 [ 206104 ] {} AsynchronousMetrics: Scanning /sys/block 2024.09.02 19:55:08.150863 [ 205803 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89611859968, merge_with_ttl_allowedtrue) 2024.09.02 19:55:08.150900 [ 205803 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 19:55:12.101138 [ 205910 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89604296704, merge_with_ttl_allowedtrue) 2024.09.02 19:55:12.101155 [ 205910 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:55:13.088073 [ 205870 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks 2024.09.02 19:55:13.088391 [ 205870 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301037ms, ratio: 0, points per minute: 0) 2024.09.02 19:55:14.915110 [ 205907 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 302864ms, ratio: 0, points per minute: 0) 2024.09.02 19:55:14.966564 [ 205926 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:55:14.966605 [ 205926 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:55:19.815779 [ 205903 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307764ms, ratio: 0, points per minute: 0) 2024.09.02 19:55:20.118120 [ 205925 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 308067ms, ratio: 0, points per minute: 0) 2024.09.02 19:55:20.958995 [ 205924 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 308908ms, ratio: 0, points per minute: 0) 2024.09.02 19:55:29.966732 [ 205949 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:55:29.966785 [ 205949 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:55:33.814680 [ 205941 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89571338240, merge_with_ttl_allowedtrue) 2024.09.02 19:55:33.814700 [ 205941 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 60000ms 2024.09.02 19:55:44.966891 [ 205975 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:55:44.966927 [ 205975 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:55:53.735455 [ 205987 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 60000ms 2024.09.02 19:55:54.775337 [ 205986 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89532907520, merge_with_ttl_allowedtrue) 2024.09.02 19:55:54.775369 [ 205986 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:55:59.967054 [ 205763 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:55:59.967101 [ 205763 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:56:00.001742 [ 206104 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00014028 sec. 2024.09.02 19:56:08.151020 [ 205827 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89513074688, merge_with_ttl_allowedtrue) 2024.09.02 19:56:08.151064 [ 205827 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 19:56:12.101351 [ 205833 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89506039808, merge_with_ttl_allowedtrue) 2024.09.02 19:56:12.101406 [ 205833 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:56:14.967225 [ 205815 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:56:14.967267 [ 205815 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:56:29.967361 [ 205791 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:56:29.967395 [ 205791 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:56:33.814835 [ 205803 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89471455232, merge_with_ttl_allowedtrue) 2024.09.02 19:56:33.814856 [ 205803 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 60000ms 2024.09.02 19:56:44.967527 [ 205906 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:56:44.967598 [ 205906 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:56:53.735614 [ 205924 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 60000ms 2024.09.02 19:56:54.775574 [ 205915 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081730560, merge_with_ttl_allowedtrue) 2024.09.02 19:56:54.775632 [ 205915 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:56:59.967743 [ 205869 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:56:59.967805 [ 205869 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:57:08.151271 [ 205934 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081673216, merge_with_ttl_allowedtrue) 2024.09.02 19:57:08.151324 [ 205934 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 19:57:12.101572 [ 205962 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081650688, merge_with_ttl_allowedtrue) 2024.09.02 19:57:12.101634 [ 205962 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:57:14.967916 [ 205974 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:57:14.967977 [ 205974 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:57:29.968087 [ 205763 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:57:29.968147 [ 205763 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:57:33.815040 [ 205778 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081554432, merge_with_ttl_allowedtrue) 2024.09.02 19:57:33.815081 [ 205778 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 60000ms 2024.09.02 19:57:44.968259 [ 205792 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:57:44.968323 [ 205792 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:57:53.735798 [ 205797 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 60000ms 2024.09.02 19:57:54.775798 [ 205809 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081464320, merge_with_ttl_allowedtrue) 2024.09.02 19:57:54.775873 [ 205809 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:57:59.968434 [ 205785 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:57:59.968499 [ 205785 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:58:00.001087 [ 206104 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00012086 sec. 2024.09.02 19:58:08.151472 [ 205829 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081409024, merge_with_ttl_allowedtrue) 2024.09.02 19:58:08.151544 [ 205829 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 19:58:12.101795 [ 205911 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081386496, merge_with_ttl_allowedtrue) 2024.09.02 19:58:12.101821 [ 205911 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:58:14.968617 [ 205893 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:58:14.968694 [ 205893 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:58:29.968808 [ 205905 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:58:29.968862 [ 205905 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:58:33.815239 [ 205939 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081286144, merge_with_ttl_allowedtrue) 2024.09.02 19:58:33.815279 [ 205939 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 60000ms 2024.09.02 19:58:44.968974 [ 205936 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:58:44.969029 [ 205936 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:58:53.736029 [ 205963 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 60000ms 2024.09.02 19:58:54.776024 [ 205985 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081196032, merge_with_ttl_allowedtrue) 2024.09.02 19:58:54.776062 [ 205985 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:58:59.969163 [ 205964 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:58:59.969229 [ 205964 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:59:08.151705 [ 205836 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081140736, merge_with_ttl_allowedtrue) 2024.09.02 19:59:08.151774 [ 205836 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 19:59:12.101978 [ 205821 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081120256, merge_with_ttl_allowedtrue) 2024.09.02 19:59:12.102021 [ 205821 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:59:14.969351 [ 205770 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:59:14.969422 [ 205770 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:59:29.969559 [ 205882 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:59:29.969616 [ 205882 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:59:33.815477 [ 205788 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081019904, merge_with_ttl_allowedtrue) 2024.09.02 19:59:33.815527 [ 205788 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 60000ms 2024.09.02 19:59:44.969757 [ 205834 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:59:44.969859 [ 205834 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:59:53.736221 [ 205893 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 60000ms 2024.09.02 19:59:54.776257 [ 205910 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080925696, merge_with_ttl_allowedtrue) 2024.09.02 19:59:54.776316 [ 205910 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 60000ms 2024.09.02 19:59:59.969999 [ 205856 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:59:59.970070 [ 205856 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:00:00.001172 [ 206104 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00012858 sec. 2024.09.02 20:00:01.000812 [ 206104 ] {} AsynchronousMetrics: Scanning /sys/block 2024.09.02 20:00:08.151980 [ 205858 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080868352, merge_with_ttl_allowedtrue) 2024.09.02 20:00:08.152033 [ 205858 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 20:00:12.102225 [ 205944 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080847872, merge_with_ttl_allowedtrue) 2024.09.02 20:00:12.102275 [ 205944 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 20:00:14.970175 [ 205934 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:00:14.970237 [ 205934 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:00:15.993936 [ 205941 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301074ms, ratio: 0, points per minute: 0) 2024.09.02 20:00:19.055186 [ 205971 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 305962ms, ratio: 0, points per minute: 0) 2024.09.02 20:00:21.222563 [ 205948 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301402ms, ratio: 0, points per minute: 0) 2024.09.02 20:00:21.653817 [ 205935 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 300690ms, ratio: 0, points per minute: 0) 2024.09.02 20:00:26.966912 [ 205973 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 306844ms, ratio: 0, points per minute: 0) 2024.09.02 20:00:29.970384 [ 205950 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:00:29.970477 [ 205950 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:00:33.815686 [ 205825 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080749568, merge_with_ttl_allowedtrue) 2024.09.02 20:00:33.815730 [ 205825 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 60000ms 2024.09.02 20:00:44.970617 [ 205800 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:00:44.970740 [ 205800 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:00:53.736410 [ 205773 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 60000ms 2024.09.02 20:00:54.776526 [ 205812 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080655360, merge_with_ttl_allowedtrue) 2024.09.02 20:00:54.776567 [ 205812 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 60000ms 2024.09.02 20:00:59.970861 [ 205833 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:00:59.970918 [ 205833 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:01:08.152180 [ 205835 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080600064, merge_with_ttl_allowedtrue) 2024.09.02 20:01:08.152209 [ 205835 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 20:01:12.102424 [ 205824 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080575488, merge_with_ttl_allowedtrue) 2024.09.02 20:01:12.102470 [ 205824 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 20:01:14.971041 [ 205829 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:01:14.971110 [ 205829 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:01:29.971220 [ 205870 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:01:29.971276 [ 205870 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:01:33.815889 [ 205924 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080479232, merge_with_ttl_allowedtrue) 2024.09.02 20:01:33.815931 [ 205924 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 60000ms 2024.09.02 20:01:44.971413 [ 205916 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:01:44.971479 [ 205916 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:01:53.736581 [ 205947 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 60000ms 2024.09.02 20:01:54.776723 [ 205961 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080389120, merge_with_ttl_allowedtrue) 2024.09.02 20:01:54.776795 [ 205961 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 60000ms 2024.09.02 20:01:59.971587 [ 205962 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:01:59.971649 [ 205962 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:02:00.001146 [ 206104 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00012493 sec. 2024.09.02 20:02:08.152412 [ 205989 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080333824, merge_with_ttl_allowedtrue) 2024.09.02 20:02:08.152447 [ 205989 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 20:02:12.102693 [ 205960 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080311296, merge_with_ttl_allowedtrue) 2024.09.02 20:02:12.102743 [ 205960 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 20:02:14.971790 [ 205805 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:02:14.971856 [ 205805 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:02:29.971972 [ 205770 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:02:29.972037 [ 205770 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:02:33.816158 [ 205771 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080210944, merge_with_ttl_allowedtrue) 2024.09.02 20:02:33.816219 [ 205771 ] {} oximeter.measurements_cumulativef64_local (8387b2c6-e147-451e-8e5f-84f4bbeb2c47): Scheduling next merge selecting task after 60000ms 2024.09.02 20:02:44.972166 [ 205810 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:02:44.972227 [ 205810 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:02:53.736758 [ 205829 ] {} oximeter.version (626c1ca5-d8d8-4409-a032-b2aeb18345c3): Scheduling next merge selecting task after 60000ms 2024.09.02 20:02:54.776955 [ 205803 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080116736, merge_with_ttl_allowedtrue) 2024.09.02 20:02:54.776992 [ 205803 ] {} oximeter.fields_uuid_local (2a01182b-0909-4138-ac40-9871004f15b4): Scheduling next merge selecting task after 60000ms 2024.09.02 20:02:59.972362 [ 205897 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:02:59.972444 [ 205897 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:03:08.152609 [ 205926 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080061440, merge_with_ttl_allowedtrue) 2024.09.02 20:03:08.152638 [ 205926 ] {} oximeter.timeseries_schema_local (a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b): Scheduling next merge selecting task after 60000ms 2024.09.02 20:03:12.102920 [ 205915 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080043008, merge_with_ttl_allowedtrue) 2024.09.02 20:03:12.102952 [ 205915 ] {} oximeter.fields_i64_local (745b0c5d-7345-48e5-92db-352d47dfc7b4): Scheduling next merge selecting task after 60000ms 2024.09.02 20:03:14.972596 [ 205890 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:03:14.972662 [ 205890 ] {} DNSResolver: Updated DNS cache