2024.10.22 13:39:13.501854 [ 221508 ] {} SentryWriter: Sending crash reports is disabled 2024.10.22 13:39:13.501900 [ 221508 ] {} Pipe: Pipe capacity is 1.00 MiB 2024.10.22 13:39:13.554201 [ 221508 ] {} Application: Starting ClickHouse 23.8.7.24 (revision: 54477, git hash: 812b95e14ba8cf744bf1d70e6de607cf130a79fa, build id: 6484B75ECB16F4FF87A88E10249A45E1BDBDE2E5), PID 221508 2024.10.22 13:39:13.554297 [ 221508 ] {} Application: starting up 2024.10.22 13:39:13.554311 [ 221508 ] {} Application: OS name: Linux, version: 5.15.0-1015-aws, architecture: x86_64 2024.10.22 13:39:13.557415 [ 221508 ] {} Application: Available RAM: 30.68 GiB; physical cores: 8; logical cores: 8. 2024.10.22 13:39:13.558051 [ 221508 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2024.10.22 13:39:13.559179 [ 221508 ] {} AsynchronousMetrics: Scanning /sys/block 2024.10.22 13:39:13.559213 [ 221508 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2024.10.22 13:39:13.559230 [ 221508 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2024.10.22 13:39:13.695970 [ 221508 ] {} Application: Integrity check of the executable successfully passed (checksum: 63E397DB90569A93F13765E06F4A1FBF) 2024.10.22 13:39:13.696008 [ 221508 ] {} Application: It looks like the process has no CAP_IPC_LOCK capability, binary mlock will be disabled. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_ipc_lock=+ep /work/oxidecomputer/omicron/out/clickhouse/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems. 2024.10.22 13:39:13.699747 [ 221508 ] {} Application: Set max number of file descriptors to 524288 (was 1024). 2024.10.22 13:39:13.699763 [ 221508 ] {} Application: rlimit on number of threads is 125612 2024.10.22 13:39:13.699771 [ 221508 ] {} Application: Initializing DateLUT. 2024.10.22 13:39:13.699776 [ 221508 ] {} Application: Initialized DateLUT with time zone 'UTC'. 2024.10.22 13:39:13.699808 [ 221508 ] {} Context: Setting up /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/tmp/ to store temporary data in it 2024.10.22 13:39:13.701303 [ 221508 ] {} Application: Initializing interserver credentials. 2024.10.22 13:39:13.701452 [ 221508 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2024.10.22 13:39:13.701894 [ 221508 ] {} ConfigReloader: Loading config '/work/oxidecomputer/omicron/oximeter/db/src/configs/replica_config.xml' 2024.10.22 13:39:13.705703 [ 221508 ] {} ConfigReloader: Loaded config '/work/oxidecomputer/omicron/oximeter/db/src/configs/replica_config.xml', performing update on configuration 2024.10.22 13:39:13.706740 [ 221508 ] {} Application: Setting max_server_memory_usage was set to 27.61 GiB (30.68 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.10.22 13:39:13.706919 [ 221508 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.34 GiB (30.68 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.10.22 13:39:13.706924 [ 221508 ] {} Application: Merges and mutations memory limit is set to 15.34 GiB 2024.10.22 13:39:13.707159 [ 221508 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2024.10.22 13:39:13.707751 [ 221508 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads 2024.10.22 13:39:13.724615 [ 221508 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2024.10.22 13:39:13.725203 [ 221508 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2024.10.22 13:39:13.725913 [ 221508 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.10.22 13:39:13.727045 [ 221508 ] {} ConfigReloader: Loaded config '/work/oxidecomputer/omicron/oximeter/db/src/configs/replica_config.xml', performed update on configuration 2024.10.22 13:39:13.728303 [ 221508 ] {} Application: Listening for replica communication (interserver): http://[::]:9010 2024.10.22 13:39:13.731155 [ 221508 ] {} ConfigReloader: Loading config '/work/oxidecomputer/omicron/oximeter/db/src/configs/replica_config.xml' 2024.10.22 13:39:13.734825 [ 221508 ] {} ConfigReloader: Loaded config '/work/oxidecomputer/omicron/oximeter/db/src/configs/replica_config.xml', performing update on configuration 2024.10.22 13:39:13.737848 [ 221508 ] {} ConfigReloader: Loaded config '/work/oxidecomputer/omicron/oximeter/db/src/configs/replica_config.xml', performed update on configuration 2024.10.22 13:39:13.738601 [ 221508 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /work/oxidecomputer/omicron/oximeter/db/src/configs/replica_config.xml 2024.10.22 13:39:13.739224 [ 221508 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2024.10.22 13:39:13.740932 [ 221508 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2024.10.22 13:39:13.741245 [ 221508 ] {} Context: Initialized background executor for fetches with num_threads=8, num_tasks=8 2024.10.22 13:39:13.741601 [ 221508 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2024.10.22 13:39:13.743458 [ 221508 ] {} DNSCacheUpdater: Update period 15 seconds 2024.10.22 13:39:13.743488 [ 221508 ] {} Application: Loading metadata from /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/ 2024.10.22 13:39:13.743542 [ 221532 ] {} DNSResolver: Updating DNS cache 2024.10.22 13:39:13.743682 [ 221532 ] {} DNSResolver: Updated DNS cache 2024.10.22 13:39:13.759214 [ 221508 ] {} DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total. 2024.10.22 13:39:13.759230 [ 221508 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 6.602e-05 sec 2024.10.22 13:39:13.759235 [ 221508 ] {} ReferentialDeps: No tables 2024.10.22 13:39:13.759240 [ 221508 ] {} LoadingDeps: No tables 2024.10.22 13:39:13.759256 [ 221508 ] {} DatabaseAtomic (system): Starting up tables. 2024.10.22 13:39:13.759272 [ 221508 ] {} SystemLog: Creating system.query_log from query_log 2024.10.22 13:39:13.760220 [ 221508 ] {} SystemLog: Creating system.query_thread_log from query_thread_log 2024.10.22 13:39:13.760579 [ 221508 ] {} SystemLog: Creating system.part_log from part_log 2024.10.22 13:39:13.760880 [ 221508 ] {} SystemLog: Creating system.trace_log from trace_log 2024.10.22 13:39:13.761048 [ 221508 ] {} SystemLog: Creating system.crash_log from crash_log 2024.10.22 13:39:13.761126 [ 221508 ] {} SystemLog: Not creating system.text_log since corresponding section 'text_log' is missing from config 2024.10.22 13:39:13.761134 [ 221508 ] {} SystemLog: Creating system.metric_log from metric_log 2024.10.22 13:39:13.762370 [ 221508 ] {} SystemLog: Not creating system.filesystem_cache_log since corresponding section 'filesystem_cache_log' is missing from config 2024.10.22 13:39:13.764193 [ 221508 ] {} SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config 2024.10.22 13:39:13.764210 [ 221508 ] {} SystemLog: Creating system.asynchronous_metric_log from asynchronous_metric_log 2024.10.22 13:39:13.764387 [ 221508 ] {} SystemLog: Not creating system.opentelemetry_span_log since corresponding section 'opentelemetry_span_log' is missing from config 2024.10.22 13:39:13.764406 [ 221508 ] {} SystemLog: Creating system.query_views_log from query_views_log 2024.10.22 13:39:13.764604 [ 221508 ] {} SystemLog: Not creating system.zookeeper_log since corresponding section 'zookeeper_log' is missing from config 2024.10.22 13:39:13.764615 [ 221508 ] {} SystemLog: Not creating system.session_log since corresponding section 'session_log' is missing from config 2024.10.22 13:39:13.764622 [ 221508 ] {} SystemLog: Not creating system.transactions_info_log since corresponding section 'transactions_info_log' is missing from config 2024.10.22 13:39:13.764629 [ 221508 ] {} SystemLog: Creating system.processors_profile_log from processors_profile_log 2024.10.22 13:39:13.764820 [ 221508 ] {} SystemLog: Not creating system.asynchronous_insert_log since corresponding section 'asynchronous_insert_log' is missing from config 2024.10.22 13:39:13.776457 [ 221508 ] {} DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal. 2024.10.22 13:39:13.780919 [ 221508 ] {} DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total. 2024.10.22 13:39:13.780931 [ 221508 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 3.471e-05 sec 2024.10.22 13:39:13.780936 [ 221508 ] {} ReferentialDeps: No tables 2024.10.22 13:39:13.780939 [ 221508 ] {} LoadingDeps: No tables 2024.10.22 13:39:13.780952 [ 221508 ] {} DatabaseAtomic (default): Starting up tables. 2024.10.22 13:39:13.781021 [ 221508 ] {} UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/user_defined/ 2024.10.22 13:39:13.781043 [ 221508 ] {} UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded 2024.10.22 13:39:13.781048 [ 221508 ] {} Application: Loaded metadata. 2024.10.22 13:39:13.781067 [ 221508 ] {} Pipe: Pipe capacity is 1.00 MiB 2024.10.22 13:39:13.781137 [ 221508 ] {} Application: Tasks stats provider: procfs 2024.10.22 13:39:13.781150 [ 221508 ] {} Application: It looks like the process has no CAP_SYS_NICE capability, the setting 'os_thread_priority' will have no effect. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_sys_nice=+ep /work/oxidecomputer/omicron/out/clickhouse/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems. 2024.10.22 13:39:13.781310 [ 221508 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.10.22 13:39:13.781636 [ 221508 ] {} AsynchronousMetrics: MemoryTracking: was 35.27 MiB, peak 35.27 MiB, free memory in arenas 17.74 MiB, will set to 388.13 MiB (RSS), difference: 352.85 MiB 2024.10.22 13:39:13.781986 [ 221508 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 1.146e-05 sec. 2024.10.22 13:39:13.782583 [ 221508 ] {} Application: Listening for http://[::]:8124 2024.10.22 13:39:13.782614 [ 221779 ] {} DDLWorker: Starting DDLWorker thread 2024.10.22 13:39:13.782643 [ 221779 ] {} DDLWorker: Initializing DDLWorker thread 2024.10.22 13:39:13.782614 [ 221778 ] {} DDLWorker: Started DDLWorker cleanup thread 2024.10.22 13:39:13.782664 [ 221508 ] {} Application: Listening for native protocol (tcp): [::]:9002 2024.10.22 13:39:13.788275 [ 221779 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:9183 with session_id 2 2024.10.22 13:39:13.788623 [ 221779 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.10.22 13:39:13.788638 [ 221779 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.10.22 13:39:13.788641 [ 221779 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.10.22 13:39:13.788646 [ 221779 ] {} ZooKeeper: Initialized, hosts: [::1]:9181,[::1]:9182,[::1]:9183 2024.10.22 13:39:13.788667 [ 221508 ] {} Application: Ready for connections. 2024.10.22 13:39:13.794129 [ 221779 ] {} DDLWorker: Initialized DDLWorker thread 2024.10.22 13:39:13.794148 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:13.794154 [ 221779 ] {} DDLWorker: Don't have unfinished tasks after restarting 2024.10.22 13:39:13.794159 [ 221778 ] {} DDLWorker: Cleaning queue 2024.10.22 13:39:13.794349 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=0, queue_size=0, entries=none..none, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2024.10.22 13:39:13.794362 [ 221779 ] {} DDLWorker: No tasks to schedule 2024.10.22 13:39:13.794366 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:14.064285 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:14.064490 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:14.071167 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=1, queue_size=1, entries=query-0000000000..query-0000000000, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2024.10.22 13:39:14.071206 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000000 2024.10.22 13:39:14.071211 [ 221779 ] {} DDLWorker: Checking task query-0000000000 2024.10.22 13:39:14.076731 [ 221779 ] {} DDLWorker: Processing task query-0000000000 (DROP DATABASE IF EXISTS oximeter SYNC) 2024.10.22 13:39:14.085661 [ 221779 ] {} DDLWorker: Executing query: DROP DATABASE IF EXISTS oximeter SYNC 2024.10.22 13:39:14.085857 [ 221779 ] {158e351b-1bc7-4b8e-8d3a-d490835b9524} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 7389f4d8-8833-4781-b585-fd1dd0317dbe) /* ddl_entry=query-0000000000 */ DROP DATABASE IF EXISTS oximeter SYNC (stage: Complete) 2024.10.22 13:39:14.085971 [ 221779 ] {158e351b-1bc7-4b8e-8d3a-d490835b9524} DDLWorker: Executed query: /* ddl_entry=query-0000000000 */ DROP DATABASE IF EXISTS oximeter SYNC 2024.10.22 13:39:14.090660 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:14.199271 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:14.199709 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=2, queue_size=2, entries=query-0000000000..query-0000000001, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000000, last_skipped_entry_name=none 2024.10.22 13:39:14.199725 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000001 2024.10.22 13:39:14.199732 [ 221779 ] {} DDLWorker: Checking task query-0000000001 2024.10.22 13:39:14.199836 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:14.204357 [ 221779 ] {} DDLWorker: Processing task query-0000000001 (CREATE DATABASE IF NOT EXISTS oximeter UUID 'fdaaca37-06da-448f-9acf-cd3196d28697') 2024.10.22 13:39:14.207807 [ 221779 ] {} DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID 'fdaaca37-06da-448f-9acf-cd3196d28697' 2024.10.22 13:39:14.207899 [ 221779 ] {6dd9d361-617b-412a-ab6b-62c7ba2b0b7c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 899328d1-f970-4704-bcef-19c6582af178) /* ddl_entry=query-0000000001 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'fdaaca37-06da-448f-9acf-cd3196d28697' (stage: Complete) 2024.10.22 13:39:14.213286 [ 221779 ] {6dd9d361-617b-412a-ab6b-62c7ba2b0b7c} DatabaseAtomic (oximeter): Metadata processed, database oximeter has 0 tables and 0 dictionaries in total. 2024.10.22 13:39:14.213306 [ 221779 ] {6dd9d361-617b-412a-ab6b-62c7ba2b0b7c} TablesLoader: Parsed metadata of 0 tables in 1 databases in 7.046e-05 sec 2024.10.22 13:39:14.213312 [ 221779 ] {6dd9d361-617b-412a-ab6b-62c7ba2b0b7c} ReferentialDeps: No tables 2024.10.22 13:39:14.213315 [ 221779 ] {6dd9d361-617b-412a-ab6b-62c7ba2b0b7c} LoadingDeps: No tables 2024.10.22 13:39:14.213355 [ 221779 ] {6dd9d361-617b-412a-ab6b-62c7ba2b0b7c} DatabaseAtomic (oximeter): Starting up tables. 2024.10.22 13:39:14.213405 [ 221779 ] {6dd9d361-617b-412a-ab6b-62c7ba2b0b7c} DDLWorker: Executed query: /* ddl_entry=query-0000000001 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'fdaaca37-06da-448f-9acf-cd3196d28697' 2024.10.22 13:39:14.220340 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:14.327034 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:14.327041 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:14.327203 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=3, queue_size=3, entries=query-0000000000..query-0000000002, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000001, last_skipped_entry_name=none 2024.10.22 13:39:14.327217 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000002 2024.10.22 13:39:14.327223 [ 221779 ] {} DDLWorker: Checking task query-0000000002 2024.10.22 13:39:14.327657 [ 221779 ] {} DDLWorker: Processing task query-0000000002 (CREATE TABLE IF NOT EXISTS oximeter.version UUID '6db82f34-d193-4788-8506-ec59aad0987f' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)) 2024.10.22 13:39:14.334702 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID '6db82f34-d193-4788-8506-ec59aad0987f' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.10.22 13:39:14.334884 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: dfc49e20-df0a-407c-8877-0e422e189014) /* ddl_entry=query-0000000002 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '6db82f34-d193-4788-8506-ec59aad0987f' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) 2024.10.22 13:39:14.336252 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} StoragePolicy (default): Storage policy default created, total volumes 1 2024.10.22 13:39:14.338930 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Loading data parts 2024.10.22 13:39:14.340433 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): There are no data parts 2024.10.22 13:39:14.360871 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Creating table /clickhouse/tables/01/version 2024.10.22 13:39:14.394311 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Creating shared ID for table oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) 2024.10.22 13:39:14.394534 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Shared ID for table oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) doesn't exist in ZooKeeper on path /clickhouse/tables/01/version/table_shared_id 2024.10.22 13:39:14.394546 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Got candidate ID 6db82f34-d193-4788-8506-ec59aad0987f, will try to create it in ZooKeeper on path /clickhouse/tables/01/version/table_shared_id 2024.10.22 13:39:14.406682 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Initializing table shared ID with 6db82f34-d193-4788-8506-ec59aad0987f 2024.10.22 13:39:14.410009 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Starting up table 2024.10.22 13:39:14.420185 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Became leader 2024.10.22 13:39:14.420205 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:14.420263 [ 221555 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:14.420290 [ 221555 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:14.426492 [ 221555 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:14.426625 [ 221555 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:14.426642 [ 221555 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/version/replicas/02/queue 2024.10.22 13:39:14.426781 [ 221555 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:14.426955 [ 221555 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:14.439704 [ 221555 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:14.439784 [ 221555 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 6175ms 2024.10.22 13:39:14.440059 [ 221779 ] {1bf0d6b5-d751-4e80-9d3a-fce036958c01} DDLWorker: Executed query: /* ddl_entry=query-0000000002 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '6db82f34-d193-4788-8506-ec59aad0987f' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.10.22 13:39:14.443899 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:14.608235 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:14.608243 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:14.611862 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=4, queue_size=4, entries=query-0000000000..query-0000000003, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000002, last_skipped_entry_name=none 2024.10.22 13:39:14.611878 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000003 2024.10.22 13:39:14.611885 [ 221779 ] {} DDLWorker: Checking task query-0000000003 2024.10.22 13:39:14.612380 [ 221779 ] {} DDLWorker: Processing task query-0000000003 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '58ed2b76-989e-4930-a32f-e53927b44b2c' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:14.620702 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '58ed2b76-989e-4930-a32f-e53927b44b2c' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:14.620881 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 772bb96f-c0f1-4905-852f-8762e44779e1) /* ddl_entry=query-0000000003 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '58ed2b76-989e-4930-a32f-e53927b44b2c' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:14.624922 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Loading data parts 2024.10.22 13:39:14.625139 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): There are no data parts 2024.10.22 13:39:14.632148 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Creating table /clickhouse/tables/01/measurements_cumulativef64_local 2024.10.22 13:39:14.676421 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Creating shared ID for table oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c) 2024.10.22 13:39:14.680253 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Shared ID for table oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_cumulativef64_local/table_shared_id 2024.10.22 13:39:14.680276 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Got candidate ID 58ed2b76-989e-4930-a32f-e53927b44b2c, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_cumulativef64_local/table_shared_id 2024.10.22 13:39:14.689739 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Initializing table shared ID with 58ed2b76-989e-4930-a32f-e53927b44b2c 2024.10.22 13:39:14.697520 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Starting up table 2024.10.22 13:39:14.698910 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Became leader 2024.10.22 13:39:14.699777 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:14.699820 [ 221597 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:14.699840 [ 221597 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:14.709261 [ 221597 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:14.709450 [ 221597 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:14.709469 [ 221597 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_cumulativef64_local/replicas/02/queue 2024.10.22 13:39:14.709685 [ 221597 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:14.709856 [ 221597 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:14.715866 [ 221597 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:14.716045 [ 221599 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 6368ms 2024.10.22 13:39:14.716060 [ 221779 ] {8e6740b5-44db-4e1e-8365-3a1f38c61baf} DDLWorker: Executed query: /* ddl_entry=query-0000000003 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '58ed2b76-989e-4930-a32f-e53927b44b2c' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:14.722275 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:14.786818 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:14.786822 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:14.791341 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=5, queue_size=5, entries=query-0000000000..query-0000000004, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000003, last_skipped_entry_name=none 2024.10.22 13:39:14.791360 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000004 2024.10.22 13:39:14.791370 [ 221779 ] {} DDLWorker: Checking task query-0000000004 2024.10.22 13:39:14.791864 [ 221779 ] {} DDLWorker: Processing task query-0000000004 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'c702e44a-b824-4c1c-b2b2-e985e24c6ae1' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:14.796100 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'c702e44a-b824-4c1c-b2b2-e985e24c6ae1' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:14.796794 [ 221779 ] {4566a2b9-1ea3-42d2-9728-35e34d21678a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 307e7208-129a-4e90-835f-89618f3865ee) /* ddl_entry=query-0000000004 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'c702e44a-b824-4c1c-b2b2-e985e24c6ae1' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:14.797176 [ 221779 ] {4566a2b9-1ea3-42d2-9728-35e34d21678a} StorageDistributed (measurements_cumulativef64): Auto-increment is 0 2024.10.22 13:39:14.803863 [ 221779 ] {4566a2b9-1ea3-42d2-9728-35e34d21678a} DDLWorker: Executed query: /* ddl_entry=query-0000000004 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'c702e44a-b824-4c1c-b2b2-e985e24c6ae1' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:14.807449 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:14.909230 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:14.909266 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:14.909438 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=6, queue_size=6, entries=query-0000000000..query-0000000005, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000004, last_skipped_entry_name=none 2024.10.22 13:39:14.909456 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000005 2024.10.22 13:39:14.909464 [ 221779 ] {} DDLWorker: Checking task query-0000000005 2024.10.22 13:39:14.913187 [ 221779 ] {} DDLWorker: Processing task query-0000000005 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '85193f68-c224-4070-9c99-4d92fbc502b6' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:14.920170 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '85193f68-c224-4070-9c99-4d92fbc502b6' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:14.920333 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6ea5d35a-18d9-4c66-8f10-efcb32e1e4a9) /* ddl_entry=query-0000000005 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '85193f68-c224-4070-9c99-4d92fbc502b6' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:14.928131 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Loading data parts 2024.10.22 13:39:14.929725 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): There are no data parts 2024.10.22 13:39:14.938025 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Creating table /clickhouse/tables/01/fields_i64_local 2024.10.22 13:39:14.971326 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Creating shared ID for table oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6) 2024.10.22 13:39:14.980520 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Shared ID for table oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6) doesn't exist in ZooKeeper on path /clickhouse/tables/01/fields_i64_local/table_shared_id 2024.10.22 13:39:14.980536 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Got candidate ID 85193f68-c224-4070-9c99-4d92fbc502b6, will try to create it in ZooKeeper on path /clickhouse/tables/01/fields_i64_local/table_shared_id 2024.10.22 13:39:14.990152 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Initializing table shared ID with 85193f68-c224-4070-9c99-4d92fbc502b6 2024.10.22 13:39:14.995852 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Starting up table 2024.10.22 13:39:15.008889 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Became leader 2024.10.22 13:39:15.008905 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:15.008959 [ 221536 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:15.008988 [ 221536 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:15.014450 [ 221536 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:15.014555 [ 221536 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:15.014564 [ 221536 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_i64_local/replicas/02/queue 2024.10.22 13:39:15.014661 [ 221536 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:15.014825 [ 221536 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:15.028090 [ 221536 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:15.028231 [ 221604 ] {} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Scheduling next merge selecting task after 6253ms 2024.10.22 13:39:15.028292 [ 221779 ] {64682b94-f089-4866-9f70-9f2984ffb458} DDLWorker: Executed query: /* ddl_entry=query-0000000005 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID '85193f68-c224-4070-9c99-4d92fbc502b6' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:15.033121 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:15.188856 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:15.188861 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:15.195781 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=7, queue_size=7, entries=query-0000000000..query-0000000006, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000005, last_skipped_entry_name=none 2024.10.22 13:39:15.195797 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000006 2024.10.22 13:39:15.195807 [ 221779 ] {} DDLWorker: Checking task query-0000000006 2024.10.22 13:39:15.196264 [ 221779 ] {} DDLWorker: Processing task query-0000000006 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID 'ed545c5e-95bb-4342-99df-b2d85e898300' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:15.201355 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID 'ed545c5e-95bb-4342-99df-b2d85e898300' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:15.201494 [ 221779 ] {363a2c24-414b-4063-a634-cbeca563cc18} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 7593859f-621b-4120-8e04-4257f3c305f4) /* ddl_entry=query-0000000006 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID 'ed545c5e-95bb-4342-99df-b2d85e898300' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:15.201971 [ 221779 ] {363a2c24-414b-4063-a634-cbeca563cc18} StorageDistributed (fields_i64): Auto-increment is 0 2024.10.22 13:39:15.208039 [ 221779 ] {363a2c24-414b-4063-a634-cbeca563cc18} DDLWorker: Executed query: /* ddl_entry=query-0000000006 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID 'ed545c5e-95bb-4342-99df-b2d85e898300' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:15.212020 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:15.310963 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:15.310967 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:15.319130 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=8, queue_size=8, entries=query-0000000000..query-0000000007, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000006, last_skipped_entry_name=none 2024.10.22 13:39:15.319157 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000007 2024.10.22 13:39:15.319163 [ 221779 ] {} DDLWorker: Checking task query-0000000007 2024.10.22 13:39:15.320068 [ 221779 ] {} DDLWorker: Processing task query-0000000007 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '198e3567-b79b-4c9c-aa9b-4ef312cc40f0' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:15.329151 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '198e3567-b79b-4c9c-aa9b-4ef312cc40f0' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:15.329345 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1bc2b70f-7d98-42f7-ba2f-d8cc1bfe1f53) /* ddl_entry=query-0000000007 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '198e3567-b79b-4c9c-aa9b-4ef312cc40f0' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:15.333742 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Loading data parts 2024.10.22 13:39:15.333941 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): There are no data parts 2024.10.22 13:39:15.341197 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Creating table /clickhouse/tables/01/fields_uuid_local 2024.10.22 13:39:15.353838 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): It looks like the table /clickhouse/tables/01/fields_uuid_local was created by another server at the same moment, will retry 2024.10.22 13:39:15.362410 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): This table /clickhouse/tables/01/fields_uuid_local is already created, will add new replica 2024.10.22 13:39:15.374873 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Creating replica /clickhouse/tables/01/fields_uuid_local/replicas/02 2024.10.22 13:39:15.404463 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Creating shared ID for table oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0) 2024.10.22 13:39:15.404595 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Initializing table shared ID with 198e3567-b79b-4c9c-aa9b-4ef312cc40f0 2024.10.22 13:39:15.408250 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Starting up table 2024.10.22 13:39:15.413607 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Became leader 2024.10.22 13:39:15.415211 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:15.415267 [ 221542 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:15.415292 [ 221542 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:15.423299 [ 221542 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:15.423326 [ 221542 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Will mimic 01 2024.10.22 13:39:15.436139 [ 221542 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:15.436155 [ 221542 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:15.436232 [ 221542 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Parts in ZooKeeper after mimic: 2024.10.22 13:39:15.436238 [ 221542 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Enqueued fetches after mimic: 2024.10.22 13:39:15.440310 [ 221542 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:15.440428 [ 221542 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:15.440436 [ 221542 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_uuid_local/replicas/02/queue 2024.10.22 13:39:15.440518 [ 221542 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:15.440597 [ 221542 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:15.441150 [ 221542 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:15.441248 [ 221565 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Scheduling next merge selecting task after 6517ms 2024.10.22 13:39:15.441322 [ 221779 ] {8f55c5fc-6b57-40cf-a4e7-110b52535b10} DDLWorker: Executed query: /* ddl_entry=query-0000000007 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '198e3567-b79b-4c9c-aa9b-4ef312cc40f0' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:15.446530 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:15.587915 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:15.587921 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:15.591990 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=9, queue_size=9, entries=query-0000000000..query-0000000008, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000007, last_skipped_entry_name=none 2024.10.22 13:39:15.592009 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000008 2024.10.22 13:39:15.592016 [ 221779 ] {} DDLWorker: Checking task query-0000000008 2024.10.22 13:39:15.592524 [ 221779 ] {} DDLWorker: Processing task query-0000000008 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '0f966ace-7729-4c75-9474-500dba22948d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:15.597206 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '0f966ace-7729-4c75-9474-500dba22948d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:15.597397 [ 221779 ] {56f54162-b671-4a9e-86b1-cbd2f31871f0} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4ed74b55-651f-4f49-87da-98c349d01a84) /* ddl_entry=query-0000000008 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '0f966ace-7729-4c75-9474-500dba22948d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:15.597970 [ 221779 ] {56f54162-b671-4a9e-86b1-cbd2f31871f0} StorageDistributed (fields_uuid): Auto-increment is 0 2024.10.22 13:39:15.604477 [ 221779 ] {56f54162-b671-4a9e-86b1-cbd2f31871f0} DDLWorker: Executed query: /* ddl_entry=query-0000000008 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '0f966ace-7729-4c75-9474-500dba22948d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:15.607986 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:15.703243 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:15.703250 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:15.706761 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=10, queue_size=10, entries=query-0000000000..query-0000000009, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000008, last_skipped_entry_name=none 2024.10.22 13:39:15.706779 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000009 2024.10.22 13:39:15.706786 [ 221779 ] {} DDLWorker: Checking task query-0000000009 2024.10.22 13:39:15.707429 [ 221779 ] {} DDLWorker: Processing task query-0000000009 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '23b30514-b5ec-4753-a91b-7ac43a61e1b5' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)) 2024.10.22 13:39:15.710826 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '23b30514-b5ec-4753-a91b-7ac43a61e1b5' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.10.22 13:39:15.711066 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f6c6dc71-ffd8-4ad4-a58d-3af0dfae884f) /* ddl_entry=query-0000000009 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '23b30514-b5ec-4753-a91b-7ac43a61e1b5' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) 2024.10.22 13:39:15.716155 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Loading data parts 2024.10.22 13:39:15.716374 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): There are no data parts 2024.10.22 13:39:15.726395 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Creating table /clickhouse/tables/01/timeseries_schema_local 2024.10.22 13:39:15.756318 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Creating shared ID for table oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5) 2024.10.22 13:39:15.756449 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Shared ID for table oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5) doesn't exist in ZooKeeper on path /clickhouse/tables/01/timeseries_schema_local/table_shared_id 2024.10.22 13:39:15.756461 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Got candidate ID 23b30514-b5ec-4753-a91b-7ac43a61e1b5, will try to create it in ZooKeeper on path /clickhouse/tables/01/timeseries_schema_local/table_shared_id 2024.10.22 13:39:15.762939 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Initializing table shared ID with 23b30514-b5ec-4753-a91b-7ac43a61e1b5 2024.10.22 13:39:15.768950 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Starting up table 2024.10.22 13:39:15.777110 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Became leader 2024.10.22 13:39:15.777125 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:15.777178 [ 221569 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:15.777211 [ 221569 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:15.790421 [ 221569 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:15.790646 [ 221569 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:15.792057 [ 221569 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/timeseries_schema_local/replicas/02/queue 2024.10.22 13:39:15.795832 [ 221569 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:15.795984 [ 221569 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:15.808817 [ 221569 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:15.808947 [ 221635 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 6433ms 2024.10.22 13:39:15.809090 [ 221779 ] {dbbf7c3b-d482-49e1-907d-3ec2ad4086cc} DDLWorker: Executed query: /* ddl_entry=query-0000000009 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '23b30514-b5ec-4753-a91b-7ac43a61e1b5' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.10.22 13:39:15.813324 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:15.980121 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:15.980134 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:15.980370 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=11, queue_size=11, entries=query-0000000000..query-0000000010, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000009, last_skipped_entry_name=none 2024.10.22 13:39:15.980385 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000010 2024.10.22 13:39:15.980392 [ 221779 ] {} DDLWorker: Checking task query-0000000010 2024.10.22 13:39:15.987436 [ 221779 ] {} DDLWorker: Processing task query-0000000010 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '828aae55-a2e4-43cb-b61e-5706e3320749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:15.991123 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '828aae55-a2e4-43cb-b61e-5706e3320749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:15.991302 [ 221779 ] {39e27b35-140a-4b03-a3a6-c0dcdf71b12a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 2a0267f1-e8ca-43ab-b463-281501705bf0) /* ddl_entry=query-0000000010 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '828aae55-a2e4-43cb-b61e-5706e3320749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:15.991782 [ 221779 ] {39e27b35-140a-4b03-a3a6-c0dcdf71b12a} StorageDistributed (timeseries_schema): Auto-increment is 0 2024.10.22 13:39:15.997622 [ 221779 ] {39e27b35-140a-4b03-a3a6-c0dcdf71b12a} DDLWorker: Executed query: /* ddl_entry=query-0000000010 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '828aae55-a2e4-43cb-b61e-5706e3320749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:16.003248 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:16.099875 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:16.099885 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:16.100094 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=12, queue_size=12, entries=query-0000000000..query-0000000011, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000010, last_skipped_entry_name=none 2024.10.22 13:39:16.100109 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000011 2024.10.22 13:39:16.100116 [ 221779 ] {} DDLWorker: Checking task query-0000000011 2024.10.22 13:39:16.106561 [ 221779 ] {} DDLWorker: Processing task query-0000000011 (CREATE DATABASE IF NOT EXISTS oximeter UUID 'fbb1d0c4-11ce-4bf0-86a5-2bf0bedb8c09') 2024.10.22 13:39:16.112920 [ 221779 ] {} DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID 'fbb1d0c4-11ce-4bf0-86a5-2bf0bedb8c09' 2024.10.22 13:39:16.113037 [ 221779 ] {f736331e-d1bf-4859-8008-e2c301316481} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 76a4ed83-c33a-49cd-ad2e-0ffed6ec9130) /* ddl_entry=query-0000000011 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'fbb1d0c4-11ce-4bf0-86a5-2bf0bedb8c09' (stage: Complete) 2024.10.22 13:39:16.113126 [ 221779 ] {f736331e-d1bf-4859-8008-e2c301316481} DDLWorker: Executed query: /* ddl_entry=query-0000000011 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'fbb1d0c4-11ce-4bf0-86a5-2bf0bedb8c09' 2024.10.22 13:39:16.123545 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:16.231872 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:16.231913 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:16.232174 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=13, queue_size=13, entries=query-0000000000..query-0000000012, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000011, last_skipped_entry_name=none 2024.10.22 13:39:16.232192 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000012 2024.10.22 13:39:16.232198 [ 221779 ] {} DDLWorker: Checking task query-0000000012 2024.10.22 13:39:16.238115 [ 221779 ] {} DDLWorker: Processing task query-0000000012 (CREATE TABLE IF NOT EXISTS oximeter.measurements_bool_local UUID '729717df-7208-4355-9607-b469f035e73e' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_bool_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:16.241612 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_bool_local UUID '729717df-7208-4355-9607-b469f035e73e' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_bool_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:16.241803 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 84ee59cf-9c28-4a9a-b882-45aec23d77d9) /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_bool_local UUID '729717df-7208-4355-9607-b469f035e73e' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_bool_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:16.247480 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Loading data parts 2024.10.22 13:39:16.247729 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): There are no data parts 2024.10.22 13:39:16.256322 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Creating table /clickhouse/tables/01/measurements_bool_local 2024.10.22 13:39:16.295159 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Creating shared ID for table oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e) 2024.10.22 13:39:16.295301 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Shared ID for table oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_bool_local/table_shared_id 2024.10.22 13:39:16.295317 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Got candidate ID 729717df-7208-4355-9607-b469f035e73e, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_bool_local/table_shared_id 2024.10.22 13:39:16.301047 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Initializing table shared ID with 729717df-7208-4355-9607-b469f035e73e 2024.10.22 13:39:16.311986 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Starting up table 2024.10.22 13:39:16.324585 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Became leader 2024.10.22 13:39:16.324600 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} oximeter.measurements_bool_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:16.324663 [ 221641 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:16.324690 [ 221641 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:16.333830 [ 221641 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:16.333946 [ 221641 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:16.333955 [ 221641 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_bool_local/replicas/02/queue 2024.10.22 13:39:16.334064 [ 221641 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:16.334165 [ 221641 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:16.347076 [ 221641 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:16.347076 [ 221643 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 6362ms 2024.10.22 13:39:16.347236 [ 221779 ] {903ed7ad-ec72-46b9-b7bb-1cd70fa59794} DDLWorker: Executed query: /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_bool_local UUID '729717df-7208-4355-9607-b469f035e73e' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_bool_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:16.351879 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:16.415066 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:16.415074 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:16.418858 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=14, queue_size=14, entries=query-0000000000..query-0000000013, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000012, last_skipped_entry_name=none 2024.10.22 13:39:16.418873 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000013 2024.10.22 13:39:16.418878 [ 221779 ] {} DDLWorker: Checking task query-0000000013 2024.10.22 13:39:16.419258 [ 221779 ] {} DDLWorker: Processing task query-0000000013 (CREATE TABLE IF NOT EXISTS oximeter.measurements_bool UUID 'df9b6c53-7437-41ea-bbef-47608050616c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_bool_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:16.427060 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_bool UUID 'df9b6c53-7437-41ea-bbef-47608050616c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_bool_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:16.427188 [ 221779 ] {017611fa-64ad-4594-bc77-e8b83fc7878b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 15b83209-209e-4c27-bca1-7d4715c548aa) /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_bool UUID 'df9b6c53-7437-41ea-bbef-47608050616c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_bool_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:16.427614 [ 221779 ] {017611fa-64ad-4594-bc77-e8b83fc7878b} StorageDistributed (measurements_bool): Auto-increment is 0 2024.10.22 13:39:16.432622 [ 221779 ] {017611fa-64ad-4594-bc77-e8b83fc7878b} DDLWorker: Executed query: /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_bool UUID 'df9b6c53-7437-41ea-bbef-47608050616c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_bool_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:16.437660 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:16.537965 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:16.537963 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:16.542039 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=15, queue_size=15, entries=query-0000000000..query-0000000014, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000013, last_skipped_entry_name=none 2024.10.22 13:39:16.542059 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000014 2024.10.22 13:39:16.542065 [ 221779 ] {} DDLWorker: Checking task query-0000000014 2024.10.22 13:39:16.542553 [ 221779 ] {} DDLWorker: Processing task query-0000000014 (CREATE TABLE IF NOT EXISTS oximeter.measurements_i8_local UUID 'a51c5796-2389-45fc-9ca8-1855ed13f246' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:16.550439 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_i8_local UUID 'a51c5796-2389-45fc-9ca8-1855ed13f246' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:16.550639 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f75ece0e-93ec-4968-8776-3c46b265e731) /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i8_local UUID 'a51c5796-2389-45fc-9ca8-1855ed13f246' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:16.555868 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Loading data parts 2024.10.22 13:39:16.556118 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): There are no data parts 2024.10.22 13:39:16.561112 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Creating table /clickhouse/tables/01/measurements_i8_local 2024.10.22 13:39:16.595245 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Creating shared ID for table oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246) 2024.10.22 13:39:16.600781 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Shared ID for table oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_i8_local/table_shared_id 2024.10.22 13:39:16.602332 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Got candidate ID a51c5796-2389-45fc-9ca8-1855ed13f246, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_i8_local/table_shared_id 2024.10.22 13:39:16.608293 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Initializing table shared ID with a51c5796-2389-45fc-9ca8-1855ed13f246 2024.10.22 13:39:16.612378 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Starting up table 2024.10.22 13:39:16.621885 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Became leader 2024.10.22 13:39:16.621905 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} oximeter.measurements_i8_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:16.621951 [ 221567 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:16.621974 [ 221567 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:16.643988 [ 221567 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:16.646970 [ 221567 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:16.646985 [ 221567 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_i8_local/replicas/02/queue 2024.10.22 13:39:16.651015 [ 221567 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:16.651143 [ 221567 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:16.655305 [ 221567 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:16.655386 [ 221623 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 6164ms 2024.10.22 13:39:16.655536 [ 221779 ] {a943caf7-1263-4bb7-aef2-fff14bb86564} DDLWorker: Executed query: /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i8_local UUID 'a51c5796-2389-45fc-9ca8-1855ed13f246' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:16.659247 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:16.813172 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:16.813178 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:16.817654 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=16, queue_size=16, entries=query-0000000000..query-0000000015, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000014, last_skipped_entry_name=none 2024.10.22 13:39:16.817672 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000015 2024.10.22 13:39:16.817681 [ 221779 ] {} DDLWorker: Checking task query-0000000015 2024.10.22 13:39:16.818232 [ 221779 ] {} DDLWorker: Processing task query-0000000015 (CREATE TABLE IF NOT EXISTS oximeter.measurements_i8 UUID '6db05a22-c67d-45f8-8477-cc9f1f05378a' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i8_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:16.822911 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_i8 UUID '6db05a22-c67d-45f8-8477-cc9f1f05378a' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:16.823055 [ 221779 ] {43fe4f1b-e7c8-45fe-8957-25d5239f794d} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e62533ea-3717-408c-a175-c2bc5e2fe2de) /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i8 UUID '6db05a22-c67d-45f8-8477-cc9f1f05378a' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i8_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:16.823687 [ 221779 ] {43fe4f1b-e7c8-45fe-8957-25d5239f794d} StorageDistributed (measurements_i8): Auto-increment is 0 2024.10.22 13:39:16.829066 [ 221779 ] {43fe4f1b-e7c8-45fe-8957-25d5239f794d} DDLWorker: Executed query: /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i8 UUID '6db05a22-c67d-45f8-8477-cc9f1f05378a' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:16.833254 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:16.929602 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:16.929608 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:16.934076 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=17, queue_size=17, entries=query-0000000000..query-0000000016, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000015, last_skipped_entry_name=none 2024.10.22 13:39:16.934088 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000016 2024.10.22 13:39:16.934094 [ 221779 ] {} DDLWorker: Checking task query-0000000016 2024.10.22 13:39:16.934559 [ 221779 ] {} DDLWorker: Processing task query-0000000016 (CREATE TABLE IF NOT EXISTS oximeter.measurements_u8_local UUID '63d6ec9c-a137-4c48-9835-fddedbb6d7b3' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:16.942942 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_u8_local UUID '63d6ec9c-a137-4c48-9835-fddedbb6d7b3' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:16.943103 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 86501637-8db8-485f-8ca0-541284b38cf8) /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u8_local UUID '63d6ec9c-a137-4c48-9835-fddedbb6d7b3' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:16.948916 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Loading data parts 2024.10.22 13:39:16.949159 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): There are no data parts 2024.10.22 13:39:16.960794 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Creating table /clickhouse/tables/01/measurements_u8_local 2024.10.22 13:39:16.966022 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): It looks like the table /clickhouse/tables/01/measurements_u8_local was created by another server at the same moment, will retry 2024.10.22 13:39:16.966154 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): This table /clickhouse/tables/01/measurements_u8_local is already created, will add new replica 2024.10.22 13:39:16.980613 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Creating replica /clickhouse/tables/01/measurements_u8_local/replicas/02 2024.10.22 13:39:17.019082 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Creating shared ID for table oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3) 2024.10.22 13:39:17.023754 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Initializing table shared ID with 63d6ec9c-a137-4c48-9835-fddedbb6d7b3 2024.10.22 13:39:17.027599 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Starting up table 2024.10.22 13:39:17.028020 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Became leader 2024.10.22 13:39:17.028034 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} oximeter.measurements_u8_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:17.028077 [ 221573 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:17.028099 [ 221573 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:17.032434 [ 221573 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:17.032448 [ 221573 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Will mimic 01 2024.10.22 13:39:17.040165 [ 221573 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Log pointer of source replica 01 changed while we loading queue nodes. Will retry. 2024.10.22 13:39:17.049581 [ 221573 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:17.049597 [ 221573 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:17.049680 [ 221573 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Parts in ZooKeeper after mimic: 2024.10.22 13:39:17.049688 [ 221573 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Enqueued fetches after mimic: 2024.10.22 13:39:17.053929 [ 221573 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:17.054073 [ 221573 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:17.054083 [ 221573 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_u8_local/replicas/02/queue 2024.10.22 13:39:17.054165 [ 221573 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:17.054299 [ 221573 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:17.054980 [ 221573 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:17.055039 [ 221606 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 6083ms 2024.10.22 13:39:17.055142 [ 221779 ] {ab94710b-76e7-4f5e-adef-7b786b80178e} DDLWorker: Executed query: /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u8_local UUID '63d6ec9c-a137-4c48-9835-fddedbb6d7b3' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:17.058275 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:17.208296 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:17.208345 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:17.208480 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=18, queue_size=18, entries=query-0000000000..query-0000000017, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000016, last_skipped_entry_name=none 2024.10.22 13:39:17.208491 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000017 2024.10.22 13:39:17.208496 [ 221779 ] {} DDLWorker: Checking task query-0000000017 2024.10.22 13:39:17.213755 [ 221779 ] {} DDLWorker: Processing task query-0000000017 (CREATE TABLE IF NOT EXISTS oximeter.measurements_u8 UUID '9797d394-1275-499a-a536-7288d9b91026' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u8_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:17.217015 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_u8 UUID '9797d394-1275-499a-a536-7288d9b91026' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:17.217170 [ 221779 ] {4a91f16a-4d48-40ec-bce5-a14cb4da3df9} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 025fc589-35bf-405c-90c6-8dacabb2aa4e) /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u8 UUID '9797d394-1275-499a-a536-7288d9b91026' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u8_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:17.217638 [ 221779 ] {4a91f16a-4d48-40ec-bce5-a14cb4da3df9} StorageDistributed (measurements_u8): Auto-increment is 0 2024.10.22 13:39:17.222605 [ 221779 ] {4a91f16a-4d48-40ec-bce5-a14cb4da3df9} DDLWorker: Executed query: /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u8 UUID '9797d394-1275-499a-a536-7288d9b91026' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:17.229512 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:17.327993 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:17.327999 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:17.332784 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=19, queue_size=19, entries=query-0000000000..query-0000000018, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000017, last_skipped_entry_name=none 2024.10.22 13:39:17.332796 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000018 2024.10.22 13:39:17.332800 [ 221779 ] {} DDLWorker: Checking task query-0000000018 2024.10.22 13:39:17.333286 [ 221779 ] {} DDLWorker: Processing task query-0000000018 (CREATE TABLE IF NOT EXISTS oximeter.measurements_i16_local UUID '49e50a30-00f0-4040-a59b-a6f152b2be2d' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int16)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:17.342062 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_i16_local UUID '49e50a30-00f0-4040-a59b-a6f152b2be2d' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int16)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:17.342245 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 9b3459be-5fbd-42e2-83d1-0c0d56342ade) /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i16_local UUID '49e50a30-00f0-4040-a59b-a6f152b2be2d' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int16)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:17.348551 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Loading data parts 2024.10.22 13:39:17.349782 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): There are no data parts 2024.10.22 13:39:17.359136 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): This table /clickhouse/tables/01/measurements_i16_local is already created, will add new replica 2024.10.22 13:39:17.368925 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Creating replica /clickhouse/tables/01/measurements_i16_local/replicas/02 2024.10.22 13:39:17.437991 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Creating shared ID for table oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d) 2024.10.22 13:39:17.438132 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Initializing table shared ID with 49e50a30-00f0-4040-a59b-a6f152b2be2d 2024.10.22 13:39:17.442412 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Starting up table 2024.10.22 13:39:17.444564 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Became leader 2024.10.22 13:39:17.445926 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} oximeter.measurements_i16_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:17.445986 [ 221656 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:17.446018 [ 221656 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:17.458127 [ 221656 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Replica 01 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:17.458151 [ 221656 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Will mimic 01 2024.10.22 13:39:17.463626 [ 221656 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:17.463640 [ 221656 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:17.463717 [ 221656 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Parts in ZooKeeper after mimic: 2024.10.22 13:39:17.463723 [ 221656 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Enqueued fetches after mimic: 2024.10.22 13:39:17.468116 [ 221656 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:17.468244 [ 221656 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:17.468254 [ 221656 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_i16_local/replicas/02/queue 2024.10.22 13:39:17.468339 [ 221656 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:17.468424 [ 221656 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:17.469003 [ 221656 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:17.469093 [ 221618 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 6578ms 2024.10.22 13:39:17.469213 [ 221779 ] {f4c615cf-0bce-41a5-935f-6b5e61f584de} DDLWorker: Executed query: /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i16_local UUID '49e50a30-00f0-4040-a59b-a6f152b2be2d' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int16)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:17.472870 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:17.603967 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:17.603964 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:17.604185 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000018, last_skipped_entry_name=none 2024.10.22 13:39:17.604200 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000019 2024.10.22 13:39:17.604207 [ 221779 ] {} DDLWorker: Checking task query-0000000019 2024.10.22 13:39:17.609551 [ 221779 ] {} DDLWorker: Processing task query-0000000019 (CREATE TABLE IF NOT EXISTS oximeter.measurements_i16 UUID 'e3c02936-4eeb-4c30-a916-349f41e4e1e9' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int16)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i16_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:17.614048 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_i16 UUID 'e3c02936-4eeb-4c30-a916-349f41e4e1e9' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int16)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:17.614203 [ 221779 ] {5683606d-755d-4b2e-8afc-178889d61a1b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: cbadcd04-5577-4c55-9f86-35f27a055d2d) /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i16 UUID 'e3c02936-4eeb-4c30-a916-349f41e4e1e9' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int16)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i16_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:17.614922 [ 221779 ] {5683606d-755d-4b2e-8afc-178889d61a1b} StorageDistributed (measurements_i16): Auto-increment is 0 2024.10.22 13:39:17.620402 [ 221779 ] {5683606d-755d-4b2e-8afc-178889d61a1b} DDLWorker: Executed query: /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i16 UUID 'e3c02936-4eeb-4c30-a916-349f41e4e1e9' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int16)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:17.624720 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:17.732288 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:17.732292 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:17.739322 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=21, queue_size=21, entries=query-0000000000..query-0000000020, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000019, last_skipped_entry_name=none 2024.10.22 13:39:17.739341 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000020 2024.10.22 13:39:17.739349 [ 221779 ] {} DDLWorker: Checking task query-0000000020 2024.10.22 13:39:17.740472 [ 221779 ] {} DDLWorker: Processing task query-0000000020 (CREATE TABLE IF NOT EXISTS oximeter.measurements_u16_local UUID 'dfaebfff-88a2-4890-bf2c-fe68c86b5fac' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt16)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:17.746363 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_u16_local UUID 'dfaebfff-88a2-4890-bf2c-fe68c86b5fac' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt16)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:17.746519 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1f72a2df-e8d2-45ca-97fb-cfeb51152035) /* ddl_entry=query-0000000020 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u16_local UUID 'dfaebfff-88a2-4890-bf2c-fe68c86b5fac' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt16)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:17.753971 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Loading data parts 2024.10.22 13:39:17.754228 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): There are no data parts 2024.10.22 13:39:17.764677 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Creating table /clickhouse/tables/01/measurements_u16_local 2024.10.22 13:39:17.804169 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Creating shared ID for table oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac) 2024.10.22 13:39:17.809303 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Shared ID for table oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_u16_local/table_shared_id 2024.10.22 13:39:17.809336 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Got candidate ID dfaebfff-88a2-4890-bf2c-fe68c86b5fac, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_u16_local/table_shared_id 2024.10.22 13:39:17.813290 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Initializing table shared ID with dfaebfff-88a2-4890-bf2c-fe68c86b5fac 2024.10.22 13:39:17.819180 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Starting up table 2024.10.22 13:39:17.827751 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Became leader 2024.10.22 13:39:17.827766 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} oximeter.measurements_u16_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:17.827824 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:17.827847 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:17.838799 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:17.838908 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:17.838922 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_u16_local/replicas/02/queue 2024.10.22 13:39:17.839049 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:17.839155 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:17.852224 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:17.852291 [ 221640 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 6539ms 2024.10.22 13:39:17.852457 [ 221779 ] {1e621b93-62c9-4203-8ac3-f77ce5cbe05c} DDLWorker: Executed query: /* ddl_entry=query-0000000020 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u16_local UUID 'dfaebfff-88a2-4890-bf2c-fe68c86b5fac' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt16)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:17.857404 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:18.016925 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:18.016929 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:18.021346 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=22, queue_size=22, entries=query-0000000000..query-0000000021, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000020, last_skipped_entry_name=none 2024.10.22 13:39:18.021363 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000021 2024.10.22 13:39:18.021370 [ 221779 ] {} DDLWorker: Checking task query-0000000021 2024.10.22 13:39:18.021886 [ 221779 ] {} DDLWorker: Processing task query-0000000021 (CREATE TABLE IF NOT EXISTS oximeter.measurements_u16 UUID '48763e72-7aa6-4e46-9228-24c25f80eaca' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt16)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u16_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:18.031093 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_u16 UUID '48763e72-7aa6-4e46-9228-24c25f80eaca' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt16)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:18.031248 [ 221779 ] {acb2402f-3508-46f6-8c6d-0b928c73bc5c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b0506900-1113-4812-84c8-334070d5351c) /* ddl_entry=query-0000000021 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u16 UUID '48763e72-7aa6-4e46-9228-24c25f80eaca' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt16)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u16_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:18.032023 [ 221779 ] {acb2402f-3508-46f6-8c6d-0b928c73bc5c} StorageDistributed (measurements_u16): Auto-increment is 0 2024.10.22 13:39:18.035559 [ 221779 ] {acb2402f-3508-46f6-8c6d-0b928c73bc5c} DDLWorker: Executed query: /* ddl_entry=query-0000000021 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u16 UUID '48763e72-7aa6-4e46-9228-24c25f80eaca' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt16)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:18.042474 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:18.133100 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:18.133105 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:18.137282 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=23, queue_size=23, entries=query-0000000000..query-0000000022, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000021, last_skipped_entry_name=none 2024.10.22 13:39:18.137296 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000022 2024.10.22 13:39:18.137301 [ 221779 ] {} DDLWorker: Checking task query-0000000022 2024.10.22 13:39:18.137746 [ 221779 ] {} DDLWorker: Processing task query-0000000022 (CREATE TABLE IF NOT EXISTS oximeter.measurements_i32_local UUID '0e4545a4-72fe-474b-98d7-468f7bab75ce' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:18.141459 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_i32_local UUID '0e4545a4-72fe-474b-98d7-468f7bab75ce' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:18.141631 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 30b75304-3eee-40ec-bc39-155c913acfde) /* ddl_entry=query-0000000022 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i32_local UUID '0e4545a4-72fe-474b-98d7-468f7bab75ce' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:18.147218 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Loading data parts 2024.10.22 13:39:18.147458 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): There are no data parts 2024.10.22 13:39:18.156981 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Creating table /clickhouse/tables/01/measurements_i32_local 2024.10.22 13:39:18.186289 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Creating shared ID for table oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce) 2024.10.22 13:39:18.186406 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Shared ID for table oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_i32_local/table_shared_id 2024.10.22 13:39:18.186416 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Got candidate ID 0e4545a4-72fe-474b-98d7-468f7bab75ce, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_i32_local/table_shared_id 2024.10.22 13:39:18.190660 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Initializing table shared ID with 0e4545a4-72fe-474b-98d7-468f7bab75ce 2024.10.22 13:39:18.198437 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Starting up table 2024.10.22 13:39:18.217335 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Became leader 2024.10.22 13:39:18.217355 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} oximeter.measurements_i32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:18.217377 [ 221555 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:18.217394 [ 221555 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:18.226053 [ 221555 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:18.226201 [ 221555 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:18.226214 [ 221555 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_i32_local/replicas/02/queue 2024.10.22 13:39:18.226314 [ 221555 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:18.226401 [ 221555 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:18.231238 [ 221555 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:18.231366 [ 221600 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 6323ms 2024.10.22 13:39:18.231534 [ 221779 ] {249b36c4-94a7-4ebc-bb5b-f74384cb18d4} DDLWorker: Executed query: /* ddl_entry=query-0000000022 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i32_local UUID '0e4545a4-72fe-474b-98d7-468f7bab75ce' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:18.239078 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:18.311266 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:18.311276 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:18.314389 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=24, queue_size=24, entries=query-0000000000..query-0000000023, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000022, last_skipped_entry_name=none 2024.10.22 13:39:18.314404 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000023 2024.10.22 13:39:18.314411 [ 221779 ] {} DDLWorker: Checking task query-0000000023 2024.10.22 13:39:18.314901 [ 221779 ] {} DDLWorker: Processing task query-0000000023 (CREATE TABLE IF NOT EXISTS oximeter.measurements_i32 UUID '2ed4feb6-ce4d-423b-831e-20018cb593b9' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:18.324059 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_i32 UUID '2ed4feb6-ce4d-423b-831e-20018cb593b9' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:18.324252 [ 221779 ] {854b1740-b20b-43bd-ae01-307ebe501c56} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5879a255-97db-4988-9e1f-2ee4fcad1330) /* ddl_entry=query-0000000023 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i32 UUID '2ed4feb6-ce4d-423b-831e-20018cb593b9' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:18.324733 [ 221779 ] {854b1740-b20b-43bd-ae01-307ebe501c56} StorageDistributed (measurements_i32): Auto-increment is 0 2024.10.22 13:39:18.329892 [ 221779 ] {854b1740-b20b-43bd-ae01-307ebe501c56} DDLWorker: Executed query: /* ddl_entry=query-0000000023 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i32 UUID '2ed4feb6-ce4d-423b-831e-20018cb593b9' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:18.338060 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:18.427117 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:18.427163 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:18.427360 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=25, queue_size=25, entries=query-0000000000..query-0000000024, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000023, last_skipped_entry_name=none 2024.10.22 13:39:18.427379 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000024 2024.10.22 13:39:18.427386 [ 221779 ] {} DDLWorker: Checking task query-0000000024 2024.10.22 13:39:18.433251 [ 221779 ] {} DDLWorker: Processing task query-0000000024 (CREATE TABLE IF NOT EXISTS oximeter.measurements_u32_local UUID '05d56c2f-af43-49b9-a141-477040bf93ca' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:18.441231 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_u32_local UUID '05d56c2f-af43-49b9-a141-477040bf93ca' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:18.441486 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 10b373b0-c919-42a5-9919-596e98d8daa0) /* ddl_entry=query-0000000024 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u32_local UUID '05d56c2f-af43-49b9-a141-477040bf93ca' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:18.446666 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Loading data parts 2024.10.22 13:39:18.446922 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): There are no data parts 2024.10.22 13:39:18.456646 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Creating table /clickhouse/tables/01/measurements_u32_local 2024.10.22 13:39:18.463694 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): It looks like the table /clickhouse/tables/01/measurements_u32_local was created by another server at the same moment, will retry 2024.10.22 13:39:18.466801 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): This table /clickhouse/tables/01/measurements_u32_local is already created, will add new replica 2024.10.22 13:39:18.484554 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Creating replica /clickhouse/tables/01/measurements_u32_local/replicas/02 2024.10.22 13:39:18.608923 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Creating shared ID for table oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca) 2024.10.22 13:39:18.609039 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Initializing table shared ID with 05d56c2f-af43-49b9-a141-477040bf93ca 2024.10.22 13:39:18.613599 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Starting up table 2024.10.22 13:39:18.614448 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Became leader 2024.10.22 13:39:18.614465 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} oximeter.measurements_u32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:18.614497 [ 221563 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:18.614523 [ 221563 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:18.622503 [ 221563 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Replica 01 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:18.622532 [ 221563 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Will mimic 01 2024.10.22 13:39:18.629763 [ 221563 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:18.629781 [ 221563 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:18.629892 [ 221563 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Parts in ZooKeeper after mimic: 2024.10.22 13:39:18.629901 [ 221563 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Enqueued fetches after mimic: 2024.10.22 13:39:18.636108 [ 221563 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:18.636271 [ 221563 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:18.636285 [ 221563 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_u32_local/replicas/02/queue 2024.10.22 13:39:18.636892 [ 221563 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:18.637142 [ 221563 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:18.639226 [ 221563 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:18.639378 [ 221536 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 6315ms 2024.10.22 13:39:18.640334 [ 221779 ] {7eccb2ab-b35f-47aa-a9c8-20474a9c205a} DDLWorker: Executed query: /* ddl_entry=query-0000000024 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u32_local UUID '05d56c2f-af43-49b9-a141-477040bf93ca' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:18.645653 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:18.728531 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:18.728533 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:18.732656 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=26, queue_size=26, entries=query-0000000000..query-0000000025, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000024, last_skipped_entry_name=none 2024.10.22 13:39:18.732685 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000025 2024.10.22 13:39:18.732694 [ 221779 ] {} DDLWorker: Checking task query-0000000025 2024.10.22 13:39:18.733703 [ 221779 ] {} DDLWorker: Processing task query-0000000025 (CREATE TABLE IF NOT EXISTS oximeter.measurements_u32 UUID 'a522c805-d503-4763-99ca-b6d445cd2a0f' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:18.745636 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_u32 UUID 'a522c805-d503-4763-99ca-b6d445cd2a0f' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:18.745810 [ 221779 ] {9bf3142f-e427-46a5-9f0a-3d0e4eccf132} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 9defe257-1429-418d-9f02-e81b8a44ed2a) /* ddl_entry=query-0000000025 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u32 UUID 'a522c805-d503-4763-99ca-b6d445cd2a0f' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:18.746257 [ 221779 ] {9bf3142f-e427-46a5-9f0a-3d0e4eccf132} StorageDistributed (measurements_u32): Auto-increment is 0 2024.10.22 13:39:18.750977 [ 221779 ] {9bf3142f-e427-46a5-9f0a-3d0e4eccf132} DDLWorker: Executed query: /* ddl_entry=query-0000000025 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u32 UUID 'a522c805-d503-4763-99ca-b6d445cd2a0f' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:18.755910 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:18.848873 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:18.848875 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:18.849483 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=27, queue_size=27, entries=query-0000000000..query-0000000026, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000025, last_skipped_entry_name=none 2024.10.22 13:39:18.850587 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000026 2024.10.22 13:39:18.850597 [ 221779 ] {} DDLWorker: Checking task query-0000000026 2024.10.22 13:39:18.854655 [ 221779 ] {} DDLWorker: Processing task query-0000000026 (CREATE TABLE IF NOT EXISTS oximeter.measurements_i64_local UUID 'ebec6def-2fab-4484-9e31-952627d2620b' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:18.858798 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_i64_local UUID 'ebec6def-2fab-4484-9e31-952627d2620b' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:18.858975 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 36e9a8a0-33d9-4c36-9896-68c7921e8bc7) /* ddl_entry=query-0000000026 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i64_local UUID 'ebec6def-2fab-4484-9e31-952627d2620b' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:18.864674 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Loading data parts 2024.10.22 13:39:18.866504 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): There are no data parts 2024.10.22 13:39:18.870340 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Creating table /clickhouse/tables/01/measurements_i64_local 2024.10.22 13:39:18.900130 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Creating shared ID for table oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b) 2024.10.22 13:39:18.900257 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Shared ID for table oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_i64_local/table_shared_id 2024.10.22 13:39:18.900274 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Got candidate ID ebec6def-2fab-4484-9e31-952627d2620b, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_i64_local/table_shared_id 2024.10.22 13:39:18.903666 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Initializing table shared ID with ebec6def-2fab-4484-9e31-952627d2620b 2024.10.22 13:39:18.908870 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Starting up table 2024.10.22 13:39:18.925201 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Became leader 2024.10.22 13:39:18.925226 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} oximeter.measurements_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:18.925274 [ 221543 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:18.925297 [ 221543 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:18.930706 [ 221543 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:18.930851 [ 221543 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:18.930866 [ 221543 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_i64_local/replicas/02/queue 2024.10.22 13:39:18.930994 [ 221543 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:18.936258 [ 221543 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:18.946033 [ 221543 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:18.946126 [ 221548 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 6122ms 2024.10.22 13:39:18.946251 [ 221779 ] {7c8670b4-179d-4230-9062-891c34380fd2} DDLWorker: Executed query: /* ddl_entry=query-0000000026 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i64_local UUID 'ebec6def-2fab-4484-9e31-952627d2620b' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_i64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:18.951908 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:19.025150 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:19.025154 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:19.029207 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=28, queue_size=28, entries=query-0000000000..query-0000000027, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000026, last_skipped_entry_name=none 2024.10.22 13:39:19.029220 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000027 2024.10.22 13:39:19.029225 [ 221779 ] {} DDLWorker: Checking task query-0000000027 2024.10.22 13:39:19.029699 [ 221779 ] {} DDLWorker: Processing task query-0000000027 (CREATE TABLE IF NOT EXISTS oximeter.measurements_i64 UUID 'b066675a-ecac-441f-a7a0-bb7d220a1971' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:19.037852 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_i64 UUID 'b066675a-ecac-441f-a7a0-bb7d220a1971' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:19.038036 [ 221779 ] {b86afd65-797f-4671-a62d-ab20f65464aa} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ac3881f4-87be-423b-81ac-41d4d630100e) /* ddl_entry=query-0000000027 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i64 UUID 'b066675a-ecac-441f-a7a0-bb7d220a1971' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:19.039867 [ 221779 ] {b86afd65-797f-4671-a62d-ab20f65464aa} StorageDistributed (measurements_i64): Auto-increment is 0 2024.10.22 13:39:19.045033 [ 221779 ] {b86afd65-797f-4671-a62d-ab20f65464aa} DDLWorker: Executed query: /* ddl_entry=query-0000000027 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_i64 UUID 'b066675a-ecac-441f-a7a0-bb7d220a1971' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:19.058640 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:19.145100 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:19.145106 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:19.151112 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=29, queue_size=29, entries=query-0000000000..query-0000000028, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000027, last_skipped_entry_name=none 2024.10.22 13:39:19.151152 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000028 2024.10.22 13:39:19.151160 [ 221779 ] {} DDLWorker: Checking task query-0000000028 2024.10.22 13:39:19.151588 [ 221779 ] {} DDLWorker: Processing task query-0000000028 (CREATE TABLE IF NOT EXISTS oximeter.measurements_u64_local UUID 'c3945f89-76d8-482c-a33a-5e547c937d0a' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:19.156501 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_u64_local UUID 'c3945f89-76d8-482c-a33a-5e547c937d0a' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:19.156670 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e84d2a71-000c-4016-8daf-e162749232c0) /* ddl_entry=query-0000000028 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u64_local UUID 'c3945f89-76d8-482c-a33a-5e547c937d0a' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:19.163036 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Loading data parts 2024.10.22 13:39:19.163574 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): There are no data parts 2024.10.22 13:39:19.167309 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Creating table /clickhouse/tables/01/measurements_u64_local 2024.10.22 13:39:19.207215 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Creating shared ID for table oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a) 2024.10.22 13:39:19.211446 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Shared ID for table oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_u64_local/table_shared_id 2024.10.22 13:39:19.211471 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Got candidate ID c3945f89-76d8-482c-a33a-5e547c937d0a, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_u64_local/table_shared_id 2024.10.22 13:39:19.219713 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Initializing table shared ID with c3945f89-76d8-482c-a33a-5e547c937d0a 2024.10.22 13:39:19.225199 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Starting up table 2024.10.22 13:39:19.229152 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Became leader 2024.10.22 13:39:19.229169 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} oximeter.measurements_u64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:19.229203 [ 221635 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:19.229221 [ 221635 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:19.238146 [ 221635 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:19.243684 [ 221635 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:19.243704 [ 221635 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_u64_local/replicas/02/queue 2024.10.22 13:39:19.243828 [ 221635 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:19.243976 [ 221635 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:19.250634 [ 221635 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:19.250686 [ 221571 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 6597ms 2024.10.22 13:39:19.250812 [ 221779 ] {db7dc81a-93ba-425f-85e1-8eee0a56e517} DDLWorker: Executed query: /* ddl_entry=query-0000000028 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u64_local UUID 'c3945f89-76d8-482c-a33a-5e547c937d0a' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_u64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:19.259531 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:19.323425 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:19.323430 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:19.327705 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=30, queue_size=30, entries=query-0000000000..query-0000000029, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000028, last_skipped_entry_name=none 2024.10.22 13:39:19.327724 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000029 2024.10.22 13:39:19.327731 [ 221779 ] {} DDLWorker: Checking task query-0000000029 2024.10.22 13:39:19.328171 [ 221779 ] {} DDLWorker: Processing task query-0000000029 (CREATE TABLE IF NOT EXISTS oximeter.measurements_u64 UUID '91b98efd-37f6-4bfc-a1c3-c1699a499ba6' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:19.336942 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_u64 UUID '91b98efd-37f6-4bfc-a1c3-c1699a499ba6' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:19.337091 [ 221779 ] {65414369-d372-467e-99ed-8d819128baf0} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4079a4d1-1e50-46e8-b247-341c545175de) /* ddl_entry=query-0000000029 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u64 UUID '91b98efd-37f6-4bfc-a1c3-c1699a499ba6' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:19.338852 [ 221779 ] {65414369-d372-467e-99ed-8d819128baf0} StorageDistributed (measurements_u64): Auto-increment is 0 2024.10.22 13:39:19.343926 [ 221779 ] {65414369-d372-467e-99ed-8d819128baf0} DDLWorker: Executed query: /* ddl_entry=query-0000000029 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_u64 UUID '91b98efd-37f6-4bfc-a1c3-c1699a499ba6' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_u64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:19.347645 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:19.442869 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:19.442884 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:19.446314 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=31, queue_size=31, entries=query-0000000000..query-0000000030, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000029, last_skipped_entry_name=none 2024.10.22 13:39:19.446333 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000030 2024.10.22 13:39:19.446341 [ 221779 ] {} DDLWorker: Checking task query-0000000030 2024.10.22 13:39:19.450343 [ 221779 ] {} DDLWorker: Processing task query-0000000030 (CREATE TABLE IF NOT EXISTS oximeter.measurements_f32_local UUID 'cbf4d6e9-971b-4446-a480-0873052a736c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_f32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:19.456213 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_f32_local UUID 'cbf4d6e9-971b-4446-a480-0873052a736c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_f32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:19.456406 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8925fe2c-b34f-43d8-988e-9cca21dad924) /* ddl_entry=query-0000000030 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_f32_local UUID 'cbf4d6e9-971b-4446-a480-0873052a736c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_f32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:19.465187 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Loading data parts 2024.10.22 13:39:19.466607 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): There are no data parts 2024.10.22 13:39:19.469925 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Creating table /clickhouse/tables/01/measurements_f32_local 2024.10.22 13:39:19.493371 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Creating shared ID for table oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c) 2024.10.22 13:39:19.493511 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Shared ID for table oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_f32_local/table_shared_id 2024.10.22 13:39:19.493528 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Got candidate ID cbf4d6e9-971b-4446-a480-0873052a736c, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_f32_local/table_shared_id 2024.10.22 13:39:19.498501 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Initializing table shared ID with cbf4d6e9-971b-4446-a480-0873052a736c 2024.10.22 13:39:19.503468 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Starting up table 2024.10.22 13:39:19.520138 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Became leader 2024.10.22 13:39:19.520162 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} oximeter.measurements_f32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:19.520185 [ 221645 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:19.520198 [ 221645 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:19.533726 [ 221645 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:19.534009 [ 221645 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:19.534028 [ 221645 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_f32_local/replicas/02/queue 2024.10.22 13:39:19.534146 [ 221645 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:19.534275 [ 221645 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:19.538956 [ 221645 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:19.539022 [ 221645 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 6249ms 2024.10.22 13:39:19.539155 [ 221779 ] {fa01bebe-a422-4fa7-8a87-44eabab0755f} DDLWorker: Executed query: /* ddl_entry=query-0000000030 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_f32_local UUID 'cbf4d6e9-971b-4446-a480-0873052a736c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_f32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:19.543732 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:19.597030 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:19.597037 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:19.597850 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=32, queue_size=32, entries=query-0000000000..query-0000000031, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000030, last_skipped_entry_name=none 2024.10.22 13:39:19.597869 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000031 2024.10.22 13:39:19.597876 [ 221779 ] {} DDLWorker: Checking task query-0000000031 2024.10.22 13:39:19.601968 [ 221779 ] {} DDLWorker: Processing task query-0000000031 (CREATE TABLE IF NOT EXISTS oximeter.measurements_f32 UUID 'af2d930b-f85e-44f1-9f16-df88bc927357' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_f32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:19.609716 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_f32 UUID 'af2d930b-f85e-44f1-9f16-df88bc927357' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_f32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:19.609935 [ 221779 ] {0e06e5d0-0c3d-4db2-a792-566bec7a52aa} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 03f0d270-4f6f-43ad-ae35-8e3e15268a7b) /* ddl_entry=query-0000000031 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_f32 UUID 'af2d930b-f85e-44f1-9f16-df88bc927357' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_f32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:19.610456 [ 221779 ] {0e06e5d0-0c3d-4db2-a792-566bec7a52aa} StorageDistributed (measurements_f32): Auto-increment is 0 2024.10.22 13:39:19.615355 [ 221779 ] {0e06e5d0-0c3d-4db2-a792-566bec7a52aa} DDLWorker: Executed query: /* ddl_entry=query-0000000031 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_f32 UUID 'af2d930b-f85e-44f1-9f16-df88bc927357' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_f32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:19.619047 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:19.725256 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:19.725258 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:19.731896 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=33, queue_size=33, entries=query-0000000000..query-0000000032, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000031, last_skipped_entry_name=none 2024.10.22 13:39:19.731916 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000032 2024.10.22 13:39:19.731922 [ 221779 ] {} DDLWorker: Checking task query-0000000032 2024.10.22 13:39:19.736584 [ 221779 ] {} DDLWorker: Processing task query-0000000032 (CREATE TABLE IF NOT EXISTS oximeter.measurements_f64_local UUID '18c5d239-04b8-4343-86a7-7f0eced60863' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_f64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:19.741306 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_f64_local UUID '18c5d239-04b8-4343-86a7-7f0eced60863' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_f64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:19.741529 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 2b4a1631-57a5-4722-861b-67827373b5da) /* ddl_entry=query-0000000032 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_f64_local UUID '18c5d239-04b8-4343-86a7-7f0eced60863' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_f64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:19.746540 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Loading data parts 2024.10.22 13:39:19.748030 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): There are no data parts 2024.10.22 13:39:19.763722 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Creating table /clickhouse/tables/01/measurements_f64_local 2024.10.22 13:39:19.777287 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): It looks like the table /clickhouse/tables/01/measurements_f64_local was created by another server at the same moment, will retry 2024.10.22 13:39:19.777504 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): This table /clickhouse/tables/01/measurements_f64_local is already created, will add new replica 2024.10.22 13:39:19.792124 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Creating replica /clickhouse/tables/01/measurements_f64_local/replicas/02 2024.10.22 13:39:19.839767 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Creating shared ID for table oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863) 2024.10.22 13:39:19.839909 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Shared ID for table oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_f64_local/table_shared_id 2024.10.22 13:39:19.839919 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Got candidate ID 18c5d239-04b8-4343-86a7-7f0eced60863, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_f64_local/table_shared_id 2024.10.22 13:39:19.844181 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Initializing table shared ID with 18c5d239-04b8-4343-86a7-7f0eced60863 2024.10.22 13:39:19.849561 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Starting up table 2024.10.22 13:39:19.854804 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Became leader 2024.10.22 13:39:19.854820 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} oximeter.measurements_f64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:19.854855 [ 221603 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:19.854873 [ 221603 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:19.868121 [ 221603 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:19.868152 [ 221603 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Will mimic 01 2024.10.22 13:39:19.872698 [ 221603 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:19.872714 [ 221603 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:19.876806 [ 221603 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Parts in ZooKeeper after mimic: 2024.10.22 13:39:19.876818 [ 221603 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Enqueued fetches after mimic: 2024.10.22 13:39:19.881249 [ 221603 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:19.881456 [ 221603 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:19.881468 [ 221603 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_f64_local/replicas/02/queue 2024.10.22 13:39:19.881563 [ 221603 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:19.881672 [ 221603 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:19.890156 [ 221603 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:19.890282 [ 221581 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 6222ms 2024.10.22 13:39:19.890352 [ 221779 ] {c89075e8-911d-45d6-846e-7675de6c57ee} DDLWorker: Executed query: /* ddl_entry=query-0000000032 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_f64_local UUID '18c5d239-04b8-4343-86a7-7f0eced60863' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_f64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:19.894135 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:20.014279 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:20.014276 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:20.014611 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=34, queue_size=34, entries=query-0000000000..query-0000000033, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000032, last_skipped_entry_name=none 2024.10.22 13:39:20.014625 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000033 2024.10.22 13:39:20.014632 [ 221779 ] {} DDLWorker: Checking task query-0000000033 2024.10.22 13:39:20.015146 [ 221779 ] {} DDLWorker: Processing task query-0000000033 (CREATE TABLE IF NOT EXISTS oximeter.measurements_f64 UUID 'd590984d-d59e-426b-b205-f142b0a55b19' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_f64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:20.019062 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_f64 UUID 'd590984d-d59e-426b-b205-f142b0a55b19' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_f64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:20.019234 [ 221779 ] {d9150f82-f969-4de5-834a-8cb7ad39938f} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 453f2f41-2a1e-4e2b-a009-87fd75d9ef47) /* ddl_entry=query-0000000033 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_f64 UUID 'd590984d-d59e-426b-b205-f142b0a55b19' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_f64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:20.019812 [ 221779 ] {d9150f82-f969-4de5-834a-8cb7ad39938f} StorageDistributed (measurements_f64): Auto-increment is 0 2024.10.22 13:39:20.026684 [ 221779 ] {d9150f82-f969-4de5-834a-8cb7ad39938f} DDLWorker: Executed query: /* ddl_entry=query-0000000033 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_f64 UUID 'd590984d-d59e-426b-b205-f142b0a55b19' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_f64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:20.031350 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:20.137308 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:20.137306 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:20.141784 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=35, queue_size=35, entries=query-0000000000..query-0000000034, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000033, last_skipped_entry_name=none 2024.10.22 13:39:20.141802 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000034 2024.10.22 13:39:20.141810 [ 221779 ] {} DDLWorker: Checking task query-0000000034 2024.10.22 13:39:20.142301 [ 221779 ] {} DDLWorker: Processing task query-0000000034 (CREATE TABLE IF NOT EXISTS oximeter.measurements_string_local UUID 'eea1a119-308f-477e-ad5d-b5867c90408c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(String)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_string_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:20.146123 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_string_local UUID 'eea1a119-308f-477e-ad5d-b5867c90408c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(String)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_string_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:20.146370 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 7787210d-e858-4707-a0ad-66a22354c82a) /* ddl_entry=query-0000000034 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_string_local UUID 'eea1a119-308f-477e-ad5d-b5867c90408c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(String)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_string_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:20.151367 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Loading data parts 2024.10.22 13:39:20.151631 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): There are no data parts 2024.10.22 13:39:20.156616 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Creating table /clickhouse/tables/01/measurements_string_local 2024.10.22 13:39:20.189611 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Creating shared ID for table oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c) 2024.10.22 13:39:20.189721 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Shared ID for table oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_string_local/table_shared_id 2024.10.22 13:39:20.189735 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Got candidate ID eea1a119-308f-477e-ad5d-b5867c90408c, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_string_local/table_shared_id 2024.10.22 13:39:20.194021 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Initializing table shared ID with eea1a119-308f-477e-ad5d-b5867c90408c 2024.10.22 13:39:20.199981 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Starting up table 2024.10.22 13:39:20.223201 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Became leader 2024.10.22 13:39:20.223242 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} oximeter.measurements_string_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:20.223315 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:20.223345 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:20.238755 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:20.239088 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:20.239105 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_string_local/replicas/02/queue 2024.10.22 13:39:20.239248 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:20.239363 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:20.246942 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:20.247010 [ 221553 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 6254ms 2024.10.22 13:39:20.247174 [ 221779 ] {67d78fcf-d499-4178-b646-3103cc309785} DDLWorker: Executed query: /* ddl_entry=query-0000000034 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_string_local UUID 'eea1a119-308f-477e-ad5d-b5867c90408c' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(String)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_string_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:20.250873 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:20.412807 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:20.412815 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:20.418707 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=36, queue_size=36, entries=query-0000000000..query-0000000035, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000034, last_skipped_entry_name=none 2024.10.22 13:39:20.418728 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000035 2024.10.22 13:39:20.418734 [ 221779 ] {} DDLWorker: Checking task query-0000000035 2024.10.22 13:39:20.419221 [ 221779 ] {} DDLWorker: Processing task query-0000000035 (CREATE TABLE IF NOT EXISTS oximeter.measurements_string UUID '20369ace-fddd-445b-aaf9-76d48dddace6' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(String)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_string_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:20.423594 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_string UUID '20369ace-fddd-445b-aaf9-76d48dddace6' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(String)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_string_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:20.423765 [ 221779 ] {8f5a1014-f87d-477c-b005-d1b1dd8d0f6e} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 3a1df13f-c177-4d1b-9bac-c4ca82bc1789) /* ddl_entry=query-0000000035 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_string UUID '20369ace-fddd-445b-aaf9-76d48dddace6' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(String)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_string_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:20.425724 [ 221779 ] {8f5a1014-f87d-477c-b005-d1b1dd8d0f6e} StorageDistributed (measurements_string): Auto-increment is 0 2024.10.22 13:39:20.431869 [ 221779 ] {8f5a1014-f87d-477c-b005-d1b1dd8d0f6e} DDLWorker: Executed query: /* ddl_entry=query-0000000035 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_string UUID '20369ace-fddd-445b-aaf9-76d48dddace6' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(String)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_string_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:20.439185 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:20.532909 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:20.532914 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:20.537389 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=37, queue_size=37, entries=query-0000000000..query-0000000036, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000035, last_skipped_entry_name=none 2024.10.22 13:39:20.537408 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000036 2024.10.22 13:39:20.537415 [ 221779 ] {} DDLWorker: Checking task query-0000000036 2024.10.22 13:39:20.537883 [ 221779 ] {} DDLWorker: Processing task query-0000000036 (CREATE TABLE IF NOT EXISTS oximeter.measurements_bytes_local UUID '9078c97c-b81f-4648-b62d-c70c642d6a9e' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Array(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_bytes_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:20.544250 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_bytes_local UUID '9078c97c-b81f-4648-b62d-c70c642d6a9e' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Array(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_bytes_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:20.544437 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 41e2e5fd-b331-4491-9278-ddc75513ea5c) /* ddl_entry=query-0000000036 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_bytes_local UUID '9078c97c-b81f-4648-b62d-c70c642d6a9e' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Array(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_bytes_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:20.550516 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Loading data parts 2024.10.22 13:39:20.550799 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): There are no data parts 2024.10.22 13:39:20.559377 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Creating table /clickhouse/tables/01/measurements_bytes_local 2024.10.22 13:39:20.582292 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): It looks like the table /clickhouse/tables/01/measurements_bytes_local was created by another server at the same moment, will retry 2024.10.22 13:39:20.582476 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): This table /clickhouse/tables/01/measurements_bytes_local is already created, will add new replica 2024.10.22 13:39:20.594547 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Creating replica /clickhouse/tables/01/measurements_bytes_local/replicas/02 2024.10.22 13:39:20.614916 [ 221640 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 7697ms 2024.10.22 13:39:20.682090 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Creating shared ID for table oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e) 2024.10.22 13:39:20.682279 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Initializing table shared ID with 9078c97c-b81f-4648-b62d-c70c642d6a9e 2024.10.22 13:39:20.685732 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Starting up table 2024.10.22 13:39:20.685906 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Became leader 2024.10.22 13:39:20.685916 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} oximeter.measurements_bytes_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:20.685956 [ 221668 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:20.685976 [ 221668 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:20.695488 [ 221668 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Replica 01 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:20.696994 [ 221668 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Will mimic 01 2024.10.22 13:39:20.705135 [ 221668 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:20.705153 [ 221668 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:20.705284 [ 221668 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Parts in ZooKeeper after mimic: 2024.10.22 13:39:20.705294 [ 221668 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Enqueued fetches after mimic: 2024.10.22 13:39:20.708530 [ 221668 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:20.708685 [ 221668 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:20.708702 [ 221668 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_bytes_local/replicas/02/queue 2024.10.22 13:39:20.708844 [ 221668 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:20.709010 [ 221668 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:20.710146 [ 221666 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 6531ms 2024.10.22 13:39:20.712951 [ 221668 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:20.714535 [ 221779 ] {2bfc8152-cb1b-40c8-9925-ee8857e7277d} DDLWorker: Executed query: /* ddl_entry=query-0000000036 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_bytes_local UUID '9078c97c-b81f-4648-b62d-c70c642d6a9e' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Array(UInt8)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_bytes_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:20.718332 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:20.766657 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1736 entries to flush up to offset 1736 2024.10.22 13:39:20.766713 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Creating new table system.asynchronous_metric_log for AsynchronousMetricLog 2024.10.22 13:39:20.772323 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Loading data parts 2024.10.22 13:39:20.772509 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): There are no data parts 2024.10.22 13:39:20.778354 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:20.778387 [ 221768 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.47 GiB. 2024.10.22 13:39:20.779371 [ 221768 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 13:39:20.779897 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:20.780214 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 1736 2024.10.22 13:39:20.808715 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:20.808723 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:20.814833 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=38, queue_size=38, entries=query-0000000000..query-0000000037, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000036, last_skipped_entry_name=none 2024.10.22 13:39:20.814847 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000037 2024.10.22 13:39:20.814852 [ 221779 ] {} DDLWorker: Checking task query-0000000037 2024.10.22 13:39:20.815299 [ 221779 ] {} DDLWorker: Processing task query-0000000037 (CREATE TABLE IF NOT EXISTS oximeter.measurements_bytes UUID '2e8c185e-dd24-4d81-9904-bdc5ea598bd3' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Array(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_bytes_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:20.820121 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_bytes UUID '2e8c185e-dd24-4d81-9904-bdc5ea598bd3' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Array(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_bytes_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:20.820251 [ 221779 ] {9b37644a-ef85-4835-a4eb-91ea399f3860} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 7a364013-531b-47ee-9fd9-25eca5498db7) /* ddl_entry=query-0000000037 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_bytes UUID '2e8c185e-dd24-4d81-9904-bdc5ea598bd3' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Array(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_bytes_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:20.822353 [ 221779 ] {9b37644a-ef85-4835-a4eb-91ea399f3860} StorageDistributed (measurements_bytes): Auto-increment is 0 2024.10.22 13:39:20.829591 [ 221779 ] {9b37644a-ef85-4835-a4eb-91ea399f3860} DDLWorker: Executed query: /* ddl_entry=query-0000000037 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_bytes UUID '2e8c185e-dd24-4d81-9904-bdc5ea598bd3' (`timeseries_name` String, `timeseries_key` UInt64, `timestamp` DateTime64(9, 'UTC'), `datum` Array(UInt8)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_bytes_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:20.832998 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:20.929057 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:20.929073 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:20.933779 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=39, queue_size=39, entries=query-0000000000..query-0000000038, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000037, last_skipped_entry_name=none 2024.10.22 13:39:20.933795 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000038 2024.10.22 13:39:20.933803 [ 221779 ] {} DDLWorker: Checking task query-0000000038 2024.10.22 13:39:20.934417 [ 221779 ] {} DDLWorker: Processing task query-0000000038 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64_local UUID 'c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativei64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:20.938468 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64_local UUID 'c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativei64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:20.938666 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6a661f09-50f0-4c19-9757-c9a06c62d5e4) /* ddl_entry=query-0000000038 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64_local UUID 'c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativei64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:20.944471 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Loading data parts 2024.10.22 13:39:20.945495 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): There are no data parts 2024.10.22 13:39:20.953713 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Creating table /clickhouse/tables/01/measurements_cumulativei64_local 2024.10.22 13:39:20.961604 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): It looks like the table /clickhouse/tables/01/measurements_cumulativei64_local was created by another server at the same moment, will retry 2024.10.22 13:39:20.961739 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): This table /clickhouse/tables/01/measurements_cumulativei64_local is already created, will add new replica 2024.10.22 13:39:20.972161 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Creating replica /clickhouse/tables/01/measurements_cumulativei64_local/replicas/02 2024.10.22 13:39:21.000403 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 392.51 MiB, peak 400.67 MiB, free memory in arenas 32.16 MiB, will set to 394.76 MiB (RSS), difference: 2.25 MiB 2024.10.22 13:39:21.014421 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Creating shared ID for table oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe) 2024.10.22 13:39:21.014621 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Initializing table shared ID with c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe 2024.10.22 13:39:21.020996 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Starting up table 2024.10.22 13:39:21.023400 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Became leader 2024.10.22 13:39:21.023416 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:21.023470 [ 221598 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:21.023499 [ 221598 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:21.029261 [ 221598 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:21.029278 [ 221598 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Will mimic 01 2024.10.22 13:39:21.042568 [ 221598 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:21.042585 [ 221598 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:21.042695 [ 221598 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Parts in ZooKeeper after mimic: 2024.10.22 13:39:21.042708 [ 221598 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Enqueued fetches after mimic: 2024.10.22 13:39:21.046544 [ 221598 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:21.046654 [ 221598 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:21.046663 [ 221598 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_cumulativei64_local/replicas/02/queue 2024.10.22 13:39:21.046740 [ 221598 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:21.046826 [ 221598 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:21.047535 [ 221598 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:21.047550 [ 221599 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 6224ms 2024.10.22 13:39:21.047712 [ 221779 ] {6c0d37fb-f760-4509-b86d-0b3594e41549} DDLWorker: Executed query: /* ddl_entry=query-0000000038 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64_local UUID 'c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativei64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:21.055546 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:21.084189 [ 221536 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 7803ms 2024.10.22 13:39:21.105923 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:21.105926 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:21.106143 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=40, queue_size=40, entries=query-0000000000..query-0000000039, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000038, last_skipped_entry_name=none 2024.10.22 13:39:21.106159 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000039 2024.10.22 13:39:21.106165 [ 221779 ] {} DDLWorker: Checking task query-0000000039 2024.10.22 13:39:21.110549 [ 221779 ] {} DDLWorker: Processing task query-0000000039 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64 UUID '4d8496af-6c5e-4898-958c-ca63d5ec0aed' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativei64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:21.116343 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64 UUID '4d8496af-6c5e-4898-958c-ca63d5ec0aed' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativei64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:21.116495 [ 221779 ] {d8b2680e-0097-4a05-bf8f-a0c197de2e04} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d881125a-2cef-41bd-9087-ae6a08e7846f) /* ddl_entry=query-0000000039 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64 UUID '4d8496af-6c5e-4898-958c-ca63d5ec0aed' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativei64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:21.116932 [ 221779 ] {d8b2680e-0097-4a05-bf8f-a0c197de2e04} StorageDistributed (measurements_cumulativei64): Auto-increment is 0 2024.10.22 13:39:21.125054 [ 221779 ] {d8b2680e-0097-4a05-bf8f-a0c197de2e04} DDLWorker: Executed query: /* ddl_entry=query-0000000039 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64 UUID '4d8496af-6c5e-4898-958c-ca63d5ec0aed' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Int64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativei64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:21.130130 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:21.228686 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:21.228690 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:21.234498 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=41, queue_size=41, entries=query-0000000000..query-0000000040, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000039, last_skipped_entry_name=none 2024.10.22 13:39:21.234520 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000040 2024.10.22 13:39:21.234527 [ 221779 ] {} DDLWorker: Checking task query-0000000040 2024.10.22 13:39:21.235083 [ 221779 ] {} DDLWorker: Processing task query-0000000040 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64_local UUID 'b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativeu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:21.239412 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64_local UUID 'b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativeu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:21.239600 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: eaba383f-4d6e-424e-aecb-39a1f7226ec8) /* ddl_entry=query-0000000040 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64_local UUID 'b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativeu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:21.246034 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Loading data parts 2024.10.22 13:39:21.247326 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): There are no data parts 2024.10.22 13:39:21.251006 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Creating table /clickhouse/tables/01/measurements_cumulativeu64_local 2024.10.22 13:39:21.266452 [ 221770 ] {} SystemLog (system.query_log): Flushing system log, 80 entries to flush up to offset 80 2024.10.22 13:39:21.266503 [ 221770 ] {} SystemLog (system.query_log): Creating new table system.query_log for QueryLog 2024.10.22 13:39:21.266508 [ 221771 ] {} SystemLog (system.trace_log): Flushing system log, 10 entries to flush up to offset 10 2024.10.22 13:39:21.266545 [ 221771 ] {} SystemLog (system.trace_log): Creating new table system.trace_log for TraceLog 2024.10.22 13:39:21.266743 [ 221765 ] {} SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 8 2024.10.22 13:39:21.266790 [ 221765 ] {} SystemLog (system.metric_log): Creating new table system.metric_log for MetricLog 2024.10.22 13:39:21.271175 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Loading data parts 2024.10.22 13:39:21.271337 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): There are no data parts 2024.10.22 13:39:21.273369 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Loading data parts 2024.10.22 13:39:21.275087 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): There are no data parts 2024.10.22 13:39:21.277956 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:21.277975 [ 221771 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.47 GiB. 2024.10.22 13:39:21.278143 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Loading data parts 2024.10.22 13:39:21.278377 [ 221771 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 13:39:21.279647 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): There are no data parts 2024.10.22 13:39:21.279863 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:21.279987 [ 221771 ] {} SystemLog (system.trace_log): Flushed system log up to offset 10 2024.10.22 13:39:21.281380 [ 221543 ] {} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Scheduling next merge selecting task after 8169ms 2024.10.22 13:39:21.285574 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:21.287696 [ 221770 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.47 GiB. 2024.10.22 13:39:21.290583 [ 221770 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 13:39:21.291366 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:21.291725 [ 221770 ] {} SystemLog (system.query_log): Flushed system log up to offset 80 2024.10.22 13:39:21.302618 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:21.302641 [ 221765 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.47 GiB. 2024.10.22 13:39:21.309397 [ 221765 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 13:39:21.310399 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Creating shared ID for table oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4) 2024.10.22 13:39:21.314797 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:21.315570 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Shared ID for table oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_cumulativeu64_local/table_shared_id 2024.10.22 13:39:21.316324 [ 221765 ] {} SystemLog (system.metric_log): Flushed system log up to offset 8 2024.10.22 13:39:21.316424 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Got candidate ID b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_cumulativeu64_local/table_shared_id 2024.10.22 13:39:21.324130 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Shared ID on path /clickhouse/tables/01/measurements_cumulativeu64_local/table_shared_id concurrently created, will set ID b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4 2024.10.22 13:39:21.324148 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Initializing table shared ID with b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4 2024.10.22 13:39:21.329342 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Starting up table 2024.10.22 13:39:21.332879 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Became leader 2024.10.22 13:39:21.332895 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:21.332919 [ 221614 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:21.332931 [ 221614 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:21.336924 [ 221614 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:21.337023 [ 221614 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:21.337032 [ 221614 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_cumulativeu64_local/replicas/02/queue 2024.10.22 13:39:21.344550 [ 221614 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:21.345005 [ 221614 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:21.353706 [ 221614 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:21.353726 [ 221569 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 6292ms 2024.10.22 13:39:21.353875 [ 221779 ] {63b3a615-3fce-45dd-b2a0-50738a51195b} DDLWorker: Executed query: /* ddl_entry=query-0000000040 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64_local UUID 'b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativeu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:21.358358 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:21.498601 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:21.498610 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:21.503429 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=42, queue_size=42, entries=query-0000000000..query-0000000041, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000040, last_skipped_entry_name=none 2024.10.22 13:39:21.503447 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000041 2024.10.22 13:39:21.503453 [ 221779 ] {} DDLWorker: Checking task query-0000000041 2024.10.22 13:39:21.504141 [ 221779 ] {} DDLWorker: Processing task query-0000000041 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64 UUID 'f3b309aa-14fa-4c26-8d0e-dbe0d34e012a' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativeu64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:21.512175 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64 UUID 'f3b309aa-14fa-4c26-8d0e-dbe0d34e012a' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativeu64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:21.512320 [ 221779 ] {1495349d-9da3-4757-b1fe-6c890b0d3a0c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f7012033-74a7-418f-a08b-c2266e87b7e0) /* ddl_entry=query-0000000041 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64 UUID 'f3b309aa-14fa-4c26-8d0e-dbe0d34e012a' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativeu64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:21.512713 [ 221779 ] {1495349d-9da3-4757-b1fe-6c890b0d3a0c} StorageDistributed (measurements_cumulativeu64): Auto-increment is 0 2024.10.22 13:39:21.521409 [ 221779 ] {1495349d-9da3-4757-b1fe-6c890b0d3a0c} DDLWorker: Executed query: /* ddl_entry=query-0000000041 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64 UUID 'f3b309aa-14fa-4c26-8d0e-dbe0d34e012a' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(UInt64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativeu64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:21.533722 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:21.619320 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:21.619357 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:21.626360 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=43, queue_size=43, entries=query-0000000000..query-0000000042, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000041, last_skipped_entry_name=none 2024.10.22 13:39:21.626374 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000042 2024.10.22 13:39:21.626384 [ 221779 ] {} DDLWorker: Checking task query-0000000042 2024.10.22 13:39:21.628903 [ 221779 ] {} DDLWorker: Processing task query-0000000042 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32_local UUID '66df5f5f-7076-47ae-b2cb-73746dfb5476' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:21.634638 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32_local UUID '66df5f5f-7076-47ae-b2cb-73746dfb5476' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:21.634846 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 055af766-1444-4523-90cb-cdc66a220dc6) /* ddl_entry=query-0000000042 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32_local UUID '66df5f5f-7076-47ae-b2cb-73746dfb5476' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:21.639471 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Loading data parts 2024.10.22 13:39:21.639698 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): There are no data parts 2024.10.22 13:39:21.646327 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Creating table /clickhouse/tables/01/measurements_cumulativef32_local 2024.10.22 13:39:21.652863 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): It looks like the table /clickhouse/tables/01/measurements_cumulativef32_local was created by another server at the same moment, will retry 2024.10.22 13:39:21.653045 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): This table /clickhouse/tables/01/measurements_cumulativef32_local is already created, will add new replica 2024.10.22 13:39:21.663657 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Creating replica /clickhouse/tables/01/measurements_cumulativef32_local/replicas/02 2024.10.22 13:39:21.700418 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Creating shared ID for table oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476) 2024.10.22 13:39:21.700551 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Initializing table shared ID with 66df5f5f-7076-47ae-b2cb-73746dfb5476 2024.10.22 13:39:21.705191 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Starting up table 2024.10.22 13:39:21.708772 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Became leader 2024.10.22 13:39:21.708788 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:21.708822 [ 221647 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:21.708844 [ 221647 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:21.718334 [ 221647 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Replica 01 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:21.718365 [ 221647 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Will mimic 01 2024.10.22 13:39:21.726268 [ 221647 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:21.726284 [ 221647 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:21.726404 [ 221647 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Parts in ZooKeeper after mimic: 2024.10.22 13:39:21.726415 [ 221647 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Enqueued fetches after mimic: 2024.10.22 13:39:21.731232 [ 221647 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:21.731366 [ 221647 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:21.731374 [ 221647 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_cumulativef32_local/replicas/02/queue 2024.10.22 13:39:21.731462 [ 221647 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:21.731554 [ 221647 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:21.732293 [ 221647 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:21.732375 [ 221642 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 6524ms 2024.10.22 13:39:21.732522 [ 221779 ] {70ac9fd7-4886-43c9-955e-8d497b033d14} DDLWorker: Executed query: /* ddl_entry=query-0000000042 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32_local UUID '66df5f5f-7076-47ae-b2cb-73746dfb5476' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:21.736824 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:21.787478 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:21.787482 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:21.790466 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=44, queue_size=44, entries=query-0000000000..query-0000000043, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000042, last_skipped_entry_name=none 2024.10.22 13:39:21.790490 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000043 2024.10.22 13:39:21.790497 [ 221779 ] {} DDLWorker: Checking task query-0000000043 2024.10.22 13:39:21.790971 [ 221779 ] {} DDLWorker: Processing task query-0000000043 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32 UUID '8f802252-f6da-454f-a393-d5fd9bf1ba29' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:21.796691 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32 UUID '8f802252-f6da-454f-a393-d5fd9bf1ba29' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:21.796857 [ 221779 ] {c62e6632-003c-4553-838a-d190ff15cd14} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 58e931e2-9c73-447a-8045-cdbb46cdaeb6) /* ddl_entry=query-0000000043 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32 UUID '8f802252-f6da-454f-a393-d5fd9bf1ba29' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:21.797290 [ 221779 ] {c62e6632-003c-4553-838a-d190ff15cd14} StorageDistributed (measurements_cumulativef32): Auto-increment is 0 2024.10.22 13:39:21.805208 [ 221779 ] {c62e6632-003c-4553-838a-d190ff15cd14} DDLWorker: Executed query: /* ddl_entry=query-0000000043 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32 UUID '8f802252-f6da-454f-a393-d5fd9bf1ba29' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float32)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:21.808843 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:21.909246 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:21.909249 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:21.916581 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=45, queue_size=45, entries=query-0000000000..query-0000000044, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000043, last_skipped_entry_name=none 2024.10.22 13:39:21.916603 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000044 2024.10.22 13:39:21.916614 [ 221779 ] {} DDLWorker: Checking task query-0000000044 2024.10.22 13:39:21.917320 [ 221779 ] {} DDLWorker: Processing task query-0000000044 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8_local UUID 'dcccea30-4ada-4786-8e01-ff13e790cedf' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:21.926343 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8_local UUID 'dcccea30-4ada-4786-8e01-ff13e790cedf' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:21.926580 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 2e1b4dd1-4ee5-4a10-9c96-febfd7da4114) /* ddl_entry=query-0000000044 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8_local UUID 'dcccea30-4ada-4786-8e01-ff13e790cedf' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:21.932445 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Loading data parts 2024.10.22 13:39:21.932691 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): There are no data parts 2024.10.22 13:39:21.937307 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Creating table /clickhouse/tables/01/measurements_histogrami8_local 2024.10.22 13:39:21.958414 [ 221581 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Scheduling next merge selecting task after 8327ms 2024.10.22 13:39:21.970330 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Creating shared ID for table oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf) 2024.10.22 13:39:21.976878 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Shared ID for table oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami8_local/table_shared_id 2024.10.22 13:39:21.976899 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Got candidate ID dcccea30-4ada-4786-8e01-ff13e790cedf, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami8_local/table_shared_id 2024.10.22 13:39:21.983303 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Initializing table shared ID with dcccea30-4ada-4786-8e01-ff13e790cedf 2024.10.22 13:39:21.987927 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Starting up table 2024.10.22 13:39:21.995224 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Became leader 2024.10.22 13:39:21.995245 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:21.995274 [ 221539 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:21.995296 [ 221539 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:22.000425 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 403.20 MiB, peak 411.72 MiB, free memory in arenas 48.69 MiB, will set to 407.89 MiB (RSS), difference: 4.69 MiB 2024.10.22 13:39:22.006590 [ 221539 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:22.006702 [ 221539 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:22.006712 [ 221539 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogrami8_local/replicas/02/queue 2024.10.22 13:39:22.006804 [ 221539 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:22.006888 [ 221539 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:22.012221 [ 221539 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:22.012291 [ 221657 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Scheduling next merge selecting task after 6159ms 2024.10.22 13:39:22.012481 [ 221779 ] {87f29640-46e8-4489-8fa8-53d3120dc627} DDLWorker: Executed query: /* ddl_entry=query-0000000044 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8_local UUID 'dcccea30-4ada-4786-8e01-ff13e790cedf' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:22.015923 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:22.083943 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:22.083948 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:22.088103 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=46, queue_size=46, entries=query-0000000000..query-0000000045, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000044, last_skipped_entry_name=none 2024.10.22 13:39:22.088124 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000045 2024.10.22 13:39:22.088138 [ 221779 ] {} DDLWorker: Checking task query-0000000045 2024.10.22 13:39:22.088743 [ 221779 ] {} DDLWorker: Processing task query-0000000045 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8 UUID '9c968dd6-b541-420e-8175-b5b01c4e40dd' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami8_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:22.098572 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8 UUID '9c968dd6-b541-420e-8175-b5b01c4e40dd' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:22.098823 [ 221779 ] {736aecfe-a30e-4373-8c01-4937101a442b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 10de1522-eeaa-441e-b8f9-21d2801a5bd1) /* ddl_entry=query-0000000045 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8 UUID '9c968dd6-b541-420e-8175-b5b01c4e40dd' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami8_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:22.099450 [ 221779 ] {736aecfe-a30e-4373-8c01-4937101a442b} StorageDistributed (measurements_histogrami8): Auto-increment is 0 2024.10.22 13:39:22.104661 [ 221779 ] {736aecfe-a30e-4373-8c01-4937101a442b} DDLWorker: Executed query: /* ddl_entry=query-0000000045 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8 UUID '9c968dd6-b541-420e-8175-b5b01c4e40dd' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:22.109716 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:22.208461 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:22.208459 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:22.208705 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=47, queue_size=47, entries=query-0000000000..query-0000000046, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000045, last_skipped_entry_name=none 2024.10.22 13:39:22.208721 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000046 2024.10.22 13:39:22.208732 [ 221779 ] {} DDLWorker: Checking task query-0000000046 2024.10.22 13:39:22.213778 [ 221779 ] {} DDLWorker: Processing task query-0000000046 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8_local UUID '4ec4e33c-f981-4047-a4ba-92302987c590' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:22.216885 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8_local UUID '4ec4e33c-f981-4047-a4ba-92302987c590' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:22.217132 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4279b453-4f68-411c-b60f-de4174a3316a) /* ddl_entry=query-0000000046 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8_local UUID '4ec4e33c-f981-4047-a4ba-92302987c590' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:22.222619 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Loading data parts 2024.10.22 13:39:22.222855 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): There are no data parts 2024.10.22 13:39:22.227957 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Creating table /clickhouse/tables/01/measurements_histogramu8_local 2024.10.22 13:39:22.242095 [ 221622 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 8067ms 2024.10.22 13:39:22.271345 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Creating shared ID for table oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590) 2024.10.22 13:39:22.280803 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Shared ID for table oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogramu8_local/table_shared_id 2024.10.22 13:39:22.280831 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Got candidate ID 4ec4e33c-f981-4047-a4ba-92302987c590, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogramu8_local/table_shared_id 2024.10.22 13:39:22.295030 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Initializing table shared ID with 4ec4e33c-f981-4047-a4ba-92302987c590 2024.10.22 13:39:22.299546 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Starting up table 2024.10.22 13:39:22.305605 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Became leader 2024.10.22 13:39:22.305623 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:22.305692 [ 221637 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:22.305724 [ 221637 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:22.316130 [ 221637 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:22.316289 [ 221637 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:22.316301 [ 221637 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramu8_local/replicas/02/queue 2024.10.22 13:39:22.316431 [ 221637 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:22.321660 [ 221637 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:22.331890 [ 221637 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:22.331958 [ 221659 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Scheduling next merge selecting task after 6018ms 2024.10.22 13:39:22.332106 [ 221779 ] {9154cdd9-40b7-4957-bac4-11aaea3b807e} DDLWorker: Executed query: /* ddl_entry=query-0000000046 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8_local UUID '4ec4e33c-f981-4047-a4ba-92302987c590' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:22.339163 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:22.485038 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:22.485043 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:22.491597 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=48, queue_size=48, entries=query-0000000000..query-0000000047, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000046, last_skipped_entry_name=none 2024.10.22 13:39:22.491612 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000047 2024.10.22 13:39:22.491617 [ 221779 ] {} DDLWorker: Checking task query-0000000047 2024.10.22 13:39:22.496640 [ 221779 ] {} DDLWorker: Processing task query-0000000047 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8 UUID 'b1775ffb-99a6-4f2d-8a7e-a39225988529' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu8_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:22.502515 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8 UUID 'b1775ffb-99a6-4f2d-8a7e-a39225988529' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:22.502696 [ 221779 ] {42fa6fd3-3456-43f8-9350-d8b0966fae44} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ee9f936d-93fc-4e15-8c52-042f7a8c8a6b) /* ddl_entry=query-0000000047 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8 UUID 'b1775ffb-99a6-4f2d-8a7e-a39225988529' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu8_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:22.503166 [ 221779 ] {42fa6fd3-3456-43f8-9350-d8b0966fae44} StorageDistributed (measurements_histogramu8): Auto-increment is 0 2024.10.22 13:39:22.510465 [ 221779 ] {42fa6fd3-3456-43f8-9350-d8b0966fae44} DDLWorker: Executed query: /* ddl_entry=query-0000000047 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8 UUID 'b1775ffb-99a6-4f2d-8a7e-a39225988529' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:22.515192 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:22.606233 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:22.606236 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:22.610215 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=49, queue_size=49, entries=query-0000000000..query-0000000048, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000047, last_skipped_entry_name=none 2024.10.22 13:39:22.610229 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000048 2024.10.22 13:39:22.610235 [ 221779 ] {} DDLWorker: Checking task query-0000000048 2024.10.22 13:39:22.610799 [ 221779 ] {} DDLWorker: Processing task query-0000000048 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16_local UUID '0b67f089-6eed-4a0d-a1f2-dc618681b658' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:22.614471 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16_local UUID '0b67f089-6eed-4a0d-a1f2-dc618681b658' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:22.614663 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ab4fc0d5-44b6-43d4-bbec-681f06371a85) /* ddl_entry=query-0000000048 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16_local UUID '0b67f089-6eed-4a0d-a1f2-dc618681b658' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:22.620319 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Loading data parts 2024.10.22 13:39:22.621664 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): There are no data parts 2024.10.22 13:39:22.629463 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Creating table /clickhouse/tables/01/measurements_histogrami16_local 2024.10.22 13:39:22.672539 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Creating shared ID for table oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658) 2024.10.22 13:39:22.678646 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Shared ID for table oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami16_local/table_shared_id 2024.10.22 13:39:22.678690 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Got candidate ID 0b67f089-6eed-4a0d-a1f2-dc618681b658, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami16_local/table_shared_id 2024.10.22 13:39:22.685542 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Initializing table shared ID with 0b67f089-6eed-4a0d-a1f2-dc618681b658 2024.10.22 13:39:22.691675 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Starting up table 2024.10.22 13:39:22.695221 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Became leader 2024.10.22 13:39:22.695248 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:22.695268 [ 221625 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:22.695288 [ 221625 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:22.700997 [ 221625 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:22.701139 [ 221625 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:22.701153 [ 221625 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogrami16_local/replicas/02/queue 2024.10.22 13:39:22.701299 [ 221625 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:22.704718 [ 221625 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:22.709271 [ 221540 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 7688ms 2024.10.22 13:39:22.715813 [ 221625 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:22.715933 [ 221575 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Scheduling next merge selecting task after 6260ms 2024.10.22 13:39:22.716321 [ 221779 ] {6b3b782a-0d97-4d01-b777-1dfe19f94869} DDLWorker: Executed query: /* ddl_entry=query-0000000048 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16_local UUID '0b67f089-6eed-4a0d-a1f2-dc618681b658' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:22.730790 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:22.819528 [ 221545 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 7531ms 2024.10.22 13:39:22.877637 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:22.877650 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:22.877829 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=50, queue_size=50, entries=query-0000000000..query-0000000049, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000048, last_skipped_entry_name=none 2024.10.22 13:39:22.877844 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000049 2024.10.22 13:39:22.877849 [ 221779 ] {} DDLWorker: Checking task query-0000000049 2024.10.22 13:39:22.882265 [ 221779 ] {} DDLWorker: Processing task query-0000000049 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16 UUID '994a9e25-5e5d-4320-ad1e-c319628305c2' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami16_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:22.885927 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16 UUID '994a9e25-5e5d-4320-ad1e-c319628305c2' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:22.886151 [ 221779 ] {05214135-7243-4a7b-977b-b050d295092b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1516161d-a350-4036-a7ad-f108273b1997) /* ddl_entry=query-0000000049 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16 UUID '994a9e25-5e5d-4320-ad1e-c319628305c2' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami16_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:22.887053 [ 221779 ] {05214135-7243-4a7b-977b-b050d295092b} StorageDistributed (measurements_histogrami16): Auto-increment is 0 2024.10.22 13:39:22.893413 [ 221779 ] {05214135-7243-4a7b-977b-b050d295092b} DDLWorker: Executed query: /* ddl_entry=query-0000000049 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16 UUID '994a9e25-5e5d-4320-ad1e-c319628305c2' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:22.897150 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:23.001434 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:23.001465 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:23.001652 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=51, queue_size=51, entries=query-0000000000..query-0000000050, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000049, last_skipped_entry_name=none 2024.10.22 13:39:23.001676 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000050 2024.10.22 13:39:23.001683 [ 221779 ] {} DDLWorker: Checking task query-0000000050 2024.10.22 13:39:23.005212 [ 221779 ] {} DDLWorker: Processing task query-0000000050 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16_local UUID '36824766-35d2-4400-9514-e29502fbde09' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:23.009788 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16_local UUID '36824766-35d2-4400-9514-e29502fbde09' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:23.009989 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d20e06d0-bd96-4312-a03f-6c97fc581419) /* ddl_entry=query-0000000050 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16_local UUID '36824766-35d2-4400-9514-e29502fbde09' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:23.015959 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Loading data parts 2024.10.22 13:39:23.017397 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): There are no data parts 2024.10.22 13:39:23.021591 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Creating table /clickhouse/tables/01/measurements_histogramu16_local 2024.10.22 13:39:23.061222 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Creating shared ID for table oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09) 2024.10.22 13:39:23.061380 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Shared ID for table oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogramu16_local/table_shared_id 2024.10.22 13:39:23.061392 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Got candidate ID 36824766-35d2-4400-9514-e29502fbde09, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogramu16_local/table_shared_id 2024.10.22 13:39:23.067501 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Initializing table shared ID with 36824766-35d2-4400-9514-e29502fbde09 2024.10.22 13:39:23.072738 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Starting up table 2024.10.22 13:39:23.084273 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Became leader 2024.10.22 13:39:23.084293 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:23.084323 [ 221542 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:23.084342 [ 221542 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:23.097290 [ 221542 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:23.097430 [ 221542 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:23.097439 [ 221542 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramu16_local/replicas/02/queue 2024.10.22 13:39:23.097586 [ 221542 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:23.097688 [ 221542 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:23.101820 [ 221542 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:23.101846 [ 221535 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Scheduling next merge selecting task after 6455ms 2024.10.22 13:39:23.102101 [ 221779 ] {59712443-da6f-421b-beb2-a6a41a5fb004} DDLWorker: Executed query: /* ddl_entry=query-0000000050 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16_local UUID '36824766-35d2-4400-9514-e29502fbde09' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:23.105651 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:23.138217 [ 221579 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 7751ms 2024.10.22 13:39:23.172080 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:23.172087 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:23.176516 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=52, queue_size=52, entries=query-0000000000..query-0000000051, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000050, last_skipped_entry_name=none 2024.10.22 13:39:23.176531 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000051 2024.10.22 13:39:23.176538 [ 221779 ] {} DDLWorker: Checking task query-0000000051 2024.10.22 13:39:23.177090 [ 221779 ] {} DDLWorker: Processing task query-0000000051 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16 UUID 'ba91fa5d-7f1d-4d5a-98cc-b3e8a98760dc' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu16_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:23.180906 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16 UUID 'ba91fa5d-7f1d-4d5a-98cc-b3e8a98760dc' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:23.181107 [ 221779 ] {bc602735-9e43-491a-afb2-0253e61d010f} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: cf72778c-b25f-412d-9ef7-cc0d61853db4) /* ddl_entry=query-0000000051 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16 UUID 'ba91fa5d-7f1d-4d5a-98cc-b3e8a98760dc' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu16_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:23.181657 [ 221779 ] {bc602735-9e43-491a-afb2-0253e61d010f} StorageDistributed (measurements_histogramu16): Auto-increment is 0 2024.10.22 13:39:23.187140 [ 221779 ] {bc602735-9e43-491a-afb2-0253e61d010f} DDLWorker: Executed query: /* ddl_entry=query-0000000051 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16 UUID 'ba91fa5d-7f1d-4d5a-98cc-b3e8a98760dc' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:23.193597 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:23.291274 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:23.291282 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:23.294871 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=53, queue_size=53, entries=query-0000000000..query-0000000052, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000051, last_skipped_entry_name=none 2024.10.22 13:39:23.294885 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000052 2024.10.22 13:39:23.294891 [ 221779 ] {} DDLWorker: Checking task query-0000000052 2024.10.22 13:39:23.295525 [ 221779 ] {} DDLWorker: Processing task query-0000000052 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32_local UUID 'aa9f4b49-21c5-46ea-8eb4-cc05c2e50258' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:23.299202 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32_local UUID 'aa9f4b49-21c5-46ea-8eb4-cc05c2e50258' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:23.299440 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 311bf7c8-721d-4399-9acd-8d370db30641) /* ddl_entry=query-0000000052 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32_local UUID 'aa9f4b49-21c5-46ea-8eb4-cc05c2e50258' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:23.304649 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Loading data parts 2024.10.22 13:39:23.305093 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): There are no data parts 2024.10.22 13:39:23.311784 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Creating table /clickhouse/tables/01/measurements_histogrami32_local 2024.10.22 13:39:23.349005 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Creating shared ID for table oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258) 2024.10.22 13:39:23.357156 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Shared ID for table oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami32_local/table_shared_id 2024.10.22 13:39:23.357180 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Got candidate ID aa9f4b49-21c5-46ea-8eb4-cc05c2e50258, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami32_local/table_shared_id 2024.10.22 13:39:23.364273 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Initializing table shared ID with aa9f4b49-21c5-46ea-8eb4-cc05c2e50258 2024.10.22 13:39:23.369523 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Starting up table 2024.10.22 13:39:23.374899 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Became leader 2024.10.22 13:39:23.374911 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:23.374962 [ 221586 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:23.374989 [ 221586 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:23.381245 [ 221586 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:23.381396 [ 221586 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:23.381411 [ 221586 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogrami32_local/replicas/02/queue 2024.10.22 13:39:23.381544 [ 221586 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:23.381739 [ 221586 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:23.400984 [ 221586 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:23.401057 [ 221526 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Scheduling next merge selecting task after 6543ms 2024.10.22 13:39:23.401211 [ 221779 ] {2503c77b-5606-454e-89a1-b4c9dd68a036} DDLWorker: Executed query: /* ddl_entry=query-0000000052 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32_local UUID 'aa9f4b49-21c5-46ea-8eb4-cc05c2e50258' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:23.405689 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:23.564195 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:23.564208 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:23.568685 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=54, queue_size=54, entries=query-0000000000..query-0000000053, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000052, last_skipped_entry_name=none 2024.10.22 13:39:23.568705 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000053 2024.10.22 13:39:23.568713 [ 221779 ] {} DDLWorker: Checking task query-0000000053 2024.10.22 13:39:23.569343 [ 221779 ] {} DDLWorker: Processing task query-0000000053 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32 UUID 'ec4d1bb5-6f9d-40cd-9097-dd28c5bac89a' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:23.574073 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32 UUID 'ec4d1bb5-6f9d-40cd-9097-dd28c5bac89a' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:23.574307 [ 221779 ] {ab9e848b-cb10-4fa2-8042-48ebbff1ffb2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: aae530f4-2585-4a4b-8357-f31aacab7efb) /* ddl_entry=query-0000000053 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32 UUID 'ec4d1bb5-6f9d-40cd-9097-dd28c5bac89a' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:23.575729 [ 221779 ] {ab9e848b-cb10-4fa2-8042-48ebbff1ffb2} StorageDistributed (measurements_histogrami32): Auto-increment is 0 2024.10.22 13:39:23.580894 [ 221779 ] {ab9e848b-cb10-4fa2-8042-48ebbff1ffb2} DDLWorker: Executed query: /* ddl_entry=query-0000000053 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32 UUID 'ec4d1bb5-6f9d-40cd-9097-dd28c5bac89a' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:23.589650 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:23.681030 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:23.681038 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:23.685940 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=55, queue_size=55, entries=query-0000000000..query-0000000054, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000053, last_skipped_entry_name=none 2024.10.22 13:39:23.685955 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000054 2024.10.22 13:39:23.685960 [ 221779 ] {} DDLWorker: Checking task query-0000000054 2024.10.22 13:39:23.686630 [ 221779 ] {} DDLWorker: Processing task query-0000000054 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32_local UUID '41efcbd7-bfc0-4ccf-9cd5-626c13481d21' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:23.695421 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32_local UUID '41efcbd7-bfc0-4ccf-9cd5-626c13481d21' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:23.695628 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 752254aa-f306-4090-9ea7-b787dc9c9288) /* ddl_entry=query-0000000054 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32_local UUID '41efcbd7-bfc0-4ccf-9cd5-626c13481d21' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:23.701561 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Loading data parts 2024.10.22 13:39:23.701812 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): There are no data parts 2024.10.22 13:39:23.706325 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Creating table /clickhouse/tables/01/measurements_histogramu32_local 2024.10.22 13:39:23.716703 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): It looks like the table /clickhouse/tables/01/measurements_histogramu32_local was created by another server at the same moment, will retry 2024.10.22 13:39:23.716857 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): This table /clickhouse/tables/01/measurements_histogramu32_local is already created, will add new replica 2024.10.22 13:39:23.721554 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Creating replica /clickhouse/tables/01/measurements_histogramu32_local/replicas/02 2024.10.22 13:39:23.774689 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Creating shared ID for table oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21) 2024.10.22 13:39:23.778874 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Shared ID for table oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogramu32_local/table_shared_id 2024.10.22 13:39:23.778897 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Got candidate ID 41efcbd7-bfc0-4ccf-9cd5-626c13481d21, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogramu32_local/table_shared_id 2024.10.22 13:39:23.788200 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Initializing table shared ID with 41efcbd7-bfc0-4ccf-9cd5-626c13481d21 2024.10.22 13:39:23.792373 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Starting up table 2024.10.22 13:39:23.809855 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Became leader 2024.10.22 13:39:23.809875 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:23.809901 [ 221606 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:23.809915 [ 221606 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:23.814081 [ 221606 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:23.814097 [ 221606 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Will mimic 01 2024.10.22 13:39:23.820347 [ 221606 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:23.820362 [ 221606 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:23.824104 [ 221606 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Parts in ZooKeeper after mimic: 2024.10.22 13:39:23.824120 [ 221606 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Enqueued fetches after mimic: 2024.10.22 13:39:23.827755 [ 221606 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:23.827893 [ 221606 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:23.827909 [ 221606 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramu32_local/replicas/02/queue 2024.10.22 13:39:23.828080 [ 221606 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:23.828231 [ 221606 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:23.838545 [ 221606 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:23.838567 [ 221619 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Scheduling next merge selecting task after 6577ms 2024.10.22 13:39:23.838739 [ 221779 ] {51e2b852-9f5e-4484-a90d-3e5442b31af2} DDLWorker: Executed query: /* ddl_entry=query-0000000054 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32_local UUID '41efcbd7-bfc0-4ccf-9cd5-626c13481d21' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:23.841994 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:23.972799 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:23.972807 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:23.976215 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=56, queue_size=56, entries=query-0000000000..query-0000000055, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000054, last_skipped_entry_name=none 2024.10.22 13:39:23.976239 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000055 2024.10.22 13:39:23.976250 [ 221779 ] {} DDLWorker: Checking task query-0000000055 2024.10.22 13:39:23.976808 [ 221779 ] {} DDLWorker: Processing task query-0000000055 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32 UUID 'ff4e0327-8059-4763-9b55-b00932921964' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:23.981368 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32 UUID 'ff4e0327-8059-4763-9b55-b00932921964' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:23.981612 [ 221779 ] {1dcd40bf-613c-4e4b-88e8-7d9bb2c42507} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d1303c21-c5e2-41a4-8bd6-3a9a63984553) /* ddl_entry=query-0000000055 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32 UUID 'ff4e0327-8059-4763-9b55-b00932921964' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:23.982092 [ 221779 ] {1dcd40bf-613c-4e4b-88e8-7d9bb2c42507} StorageDistributed (measurements_histogramu32): Auto-increment is 0 2024.10.22 13:39:23.986667 [ 221779 ] {1dcd40bf-613c-4e4b-88e8-7d9bb2c42507} DDLWorker: Executed query: /* ddl_entry=query-0000000055 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32 UUID 'ff4e0327-8059-4763-9b55-b00932921964' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:23.990476 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:24.000418 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 408.56 MiB, peak 411.72 MiB, free memory in arenas 27.20 MiB, will set to 396.84 MiB (RSS), difference: -11.73 MiB 2024.10.22 13:39:24.047280 [ 221588 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 8195ms 2024.10.22 13:39:24.090250 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:24.090255 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:24.090511 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=57, queue_size=57, entries=query-0000000000..query-0000000056, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000055, last_skipped_entry_name=none 2024.10.22 13:39:24.090526 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000056 2024.10.22 13:39:24.090567 [ 221779 ] {} DDLWorker: Checking task query-0000000056 2024.10.22 13:39:24.096096 [ 221779 ] {} DDLWorker: Processing task query-0000000056 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64_local UUID 'e253bc84-081c-44d7-b513-286bddd4eeeb' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:24.099312 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64_local UUID 'e253bc84-081c-44d7-b513-286bddd4eeeb' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:24.099570 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ad27370b-517c-4372-955d-0cf16d63a6e1) /* ddl_entry=query-0000000056 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64_local UUID 'e253bc84-081c-44d7-b513-286bddd4eeeb' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:24.106953 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Loading data parts 2024.10.22 13:39:24.107170 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): There are no data parts 2024.10.22 13:39:24.115052 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Creating table /clickhouse/tables/01/measurements_histogrami64_local 2024.10.22 13:39:24.143491 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Creating shared ID for table oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb) 2024.10.22 13:39:24.143765 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Shared ID for table oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami64_local/table_shared_id 2024.10.22 13:39:24.143789 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Got candidate ID e253bc84-081c-44d7-b513-286bddd4eeeb, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami64_local/table_shared_id 2024.10.22 13:39:24.154750 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Initializing table shared ID with e253bc84-081c-44d7-b513-286bddd4eeeb 2024.10.22 13:39:24.158783 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Starting up table 2024.10.22 13:39:24.164222 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Became leader 2024.10.22 13:39:24.164246 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:24.164281 [ 221658 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:24.164297 [ 221658 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:24.177563 [ 221658 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:24.177709 [ 221658 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:24.179328 [ 221658 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogrami64_local/replicas/02/queue 2024.10.22 13:39:24.183267 [ 221658 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:24.183447 [ 221658 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:24.194727 [ 221658 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:24.194764 [ 221667 ] {} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Scheduling next merge selecting task after 6379ms 2024.10.22 13:39:24.195088 [ 221779 ] {acd1fadd-bd69-49d2-bba3-c6cd6960b512} DDLWorker: Executed query: /* ddl_entry=query-0000000056 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64_local UUID 'e253bc84-081c-44d7-b513-286bddd4eeeb' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:24.204238 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:24.267643 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:24.267648 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:24.267840 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=58, queue_size=58, entries=query-0000000000..query-0000000057, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000056, last_skipped_entry_name=none 2024.10.22 13:39:24.267856 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000057 2024.10.22 13:39:24.267864 [ 221779 ] {} DDLWorker: Checking task query-0000000057 2024.10.22 13:39:24.272211 [ 221779 ] {} DDLWorker: Processing task query-0000000057 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64 UUID 'cf8a1200-a120-46b5-a230-1b775241d10e' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:24.275808 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64 UUID 'cf8a1200-a120-46b5-a230-1b775241d10e' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:24.276044 [ 221779 ] {c413f785-eaac-4a69-b4d5-ba14cedfdcd7} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 3a25825f-ee06-46e1-8f05-df378410897d) /* ddl_entry=query-0000000057 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64 UUID 'cf8a1200-a120-46b5-a230-1b775241d10e' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:24.276615 [ 221779 ] {c413f785-eaac-4a69-b4d5-ba14cedfdcd7} StorageDistributed (measurements_histogrami64): Auto-increment is 0 2024.10.22 13:39:24.281103 [ 221779 ] {c413f785-eaac-4a69-b4d5-ba14cedfdcd7} DDLWorker: Executed query: /* ddl_entry=query-0000000057 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64 UUID 'cf8a1200-a120-46b5-a230-1b775241d10e' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:24.286067 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:24.391471 [ 221540 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 8410ms 2024.10.22 13:39:24.392694 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:24.392702 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:24.392885 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=59, queue_size=59, entries=query-0000000000..query-0000000058, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000057, last_skipped_entry_name=none 2024.10.22 13:39:24.392902 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000058 2024.10.22 13:39:24.392908 [ 221779 ] {} DDLWorker: Checking task query-0000000058 2024.10.22 13:39:24.396695 [ 221779 ] {} DDLWorker: Processing task query-0000000058 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64_local UUID 'ddba52ef-8091-4994-8ccf-d9176f6f7124' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:24.399981 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64_local UUID 'ddba52ef-8091-4994-8ccf-d9176f6f7124' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:24.400220 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: af5fb433-9fbd-42b8-913c-41a57adcae19) /* ddl_entry=query-0000000058 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64_local UUID 'ddba52ef-8091-4994-8ccf-d9176f6f7124' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:24.404316 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Loading data parts 2024.10.22 13:39:24.404553 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): There are no data parts 2024.10.22 13:39:24.412951 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Creating table /clickhouse/tables/01/measurements_histogramu64_local 2024.10.22 13:39:24.516658 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Creating shared ID for table oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124) 2024.10.22 13:39:24.516787 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Shared ID for table oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogramu64_local/table_shared_id 2024.10.22 13:39:24.516797 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Got candidate ID ddba52ef-8091-4994-8ccf-d9176f6f7124, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogramu64_local/table_shared_id 2024.10.22 13:39:24.523089 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Shared ID on path /clickhouse/tables/01/measurements_histogramu64_local/table_shared_id concurrently created, will set ID ddba52ef-8091-4994-8ccf-d9176f6f7124 2024.10.22 13:39:24.523105 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Initializing table shared ID with ddba52ef-8091-4994-8ccf-d9176f6f7124 2024.10.22 13:39:24.528002 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Starting up table 2024.10.22 13:39:24.528166 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Became leader 2024.10.22 13:39:24.528180 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:24.528201 [ 221596 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:24.528211 [ 221596 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:24.543873 [ 221596 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:24.544033 [ 221596 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:24.544049 [ 221596 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramu64_local/replicas/02/queue 2024.10.22 13:39:24.544177 [ 221596 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:24.544331 [ 221596 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:24.553877 [ 221596 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:24.553894 [ 221604 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Scheduling next merge selecting task after 6428ms 2024.10.22 13:39:24.554099 [ 221779 ] {6386f326-9cfc-489a-b7a9-65dfc931ea2e} DDLWorker: Executed query: /* ddl_entry=query-0000000058 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64_local UUID 'ddba52ef-8091-4994-8ccf-d9176f6f7124' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:24.554556 [ 221537 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 8265ms 2024.10.22 13:39:24.559756 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:24.673231 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:24.673236 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:24.673627 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=60, queue_size=60, entries=query-0000000000..query-0000000059, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000058, last_skipped_entry_name=none 2024.10.22 13:39:24.673656 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000059 2024.10.22 13:39:24.673662 [ 221779 ] {} DDLWorker: Checking task query-0000000059 2024.10.22 13:39:24.677681 [ 221779 ] {} DDLWorker: Processing task query-0000000059 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64 UUID '6ae18c22-936c-48a1-ba9f-14fdcf9c1bac' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:24.681089 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64 UUID '6ae18c22-936c-48a1-ba9f-14fdcf9c1bac' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:24.681343 [ 221779 ] {1c13ec28-65dc-428a-9de4-39d3bf091421} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: aa9ca3b8-a9ee-4844-869e-1893659385cd) /* ddl_entry=query-0000000059 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64 UUID '6ae18c22-936c-48a1-ba9f-14fdcf9c1bac' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:24.681913 [ 221779 ] {1c13ec28-65dc-428a-9de4-39d3bf091421} StorageDistributed (measurements_histogramu64): Auto-increment is 0 2024.10.22 13:39:24.685633 [ 221779 ] {1c13ec28-65dc-428a-9de4-39d3bf091421} DDLWorker: Executed query: /* ddl_entry=query-0000000059 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64 UUID '6ae18c22-936c-48a1-ba9f-14fdcf9c1bac' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:24.689358 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:24.790033 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:24.790041 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:24.793906 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=61, queue_size=61, entries=query-0000000000..query-0000000060, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000059, last_skipped_entry_name=none 2024.10.22 13:39:24.793925 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000060 2024.10.22 13:39:24.793938 [ 221779 ] {} DDLWorker: Checking task query-0000000060 2024.10.22 13:39:24.794516 [ 221779 ] {} DDLWorker: Processing task query-0000000060 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32_local UUID '5694cca9-ebeb-42c8-ba5f-8a57212926a9' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:24.801114 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32_local UUID '5694cca9-ebeb-42c8-ba5f-8a57212926a9' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:24.801296 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 75d0680a-f4d2-4f2f-8905-df67bcf145a4) /* ddl_entry=query-0000000060 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32_local UUID '5694cca9-ebeb-42c8-ba5f-8a57212926a9' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:24.806677 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Loading data parts 2024.10.22 13:39:24.806907 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): There are no data parts 2024.10.22 13:39:24.810209 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Creating table /clickhouse/tables/01/measurements_histogramf32_local 2024.10.22 13:39:24.820488 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): It looks like the table /clickhouse/tables/01/measurements_histogramf32_local was created by another server at the same moment, will retry 2024.10.22 13:39:24.820615 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): This table /clickhouse/tables/01/measurements_histogramf32_local is already created, will add new replica 2024.10.22 13:39:24.834294 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Creating replica /clickhouse/tables/01/measurements_histogramf32_local/replicas/02 2024.10.22 13:39:24.857502 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Creating shared ID for table oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9) 2024.10.22 13:39:24.857617 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Initializing table shared ID with 5694cca9-ebeb-42c8-ba5f-8a57212926a9 2024.10.22 13:39:24.863300 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Starting up table 2024.10.22 13:39:24.864633 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Became leader 2024.10.22 13:39:24.865255 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:24.865284 [ 221639 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:24.865294 [ 221639 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:24.872284 [ 221639 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:24.872297 [ 221639 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Will mimic 01 2024.10.22 13:39:24.881571 [ 221639 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Log pointer of source replica 01 changed while we loading queue nodes. Will retry. 2024.10.22 13:39:24.890897 [ 221639 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:24.890914 [ 221639 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:24.891009 [ 221639 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Parts in ZooKeeper after mimic: 2024.10.22 13:39:24.891017 [ 221639 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Enqueued fetches after mimic: 2024.10.22 13:39:24.894358 [ 221639 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:24.894502 [ 221639 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:24.894515 [ 221639 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramf32_local/replicas/02/queue 2024.10.22 13:39:24.894624 [ 221639 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:24.894732 [ 221639 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:24.895437 [ 221639 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:24.895490 [ 221631 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Scheduling next merge selecting task after 6292ms 2024.10.22 13:39:24.895643 [ 221779 ] {855d70b6-7ac5-4e5d-b0cb-b8f755c61e5b} DDLWorker: Executed query: /* ddl_entry=query-0000000060 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32_local UUID '5694cca9-ebeb-42c8-ba5f-8a57212926a9' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:24.899075 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:24.955331 [ 221636 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 8009ms 2024.10.22 13:39:24.959451 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:24.959459 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:24.963287 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=62, queue_size=62, entries=query-0000000000..query-0000000061, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000060, last_skipped_entry_name=none 2024.10.22 13:39:24.963307 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000061 2024.10.22 13:39:24.963313 [ 221779 ] {} DDLWorker: Checking task query-0000000061 2024.10.22 13:39:24.963990 [ 221779 ] {} DDLWorker: Processing task query-0000000061 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32 UUID '66db7faa-4940-45ca-8e39-98d5250d5bfb' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:24.967600 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32 UUID '66db7faa-4940-45ca-8e39-98d5250d5bfb' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:24.967867 [ 221779 ] {20d65b18-4b33-4c0f-8c6e-fcb496cdbad6} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: af7866f7-4892-44f5-84d4-3738b6b7143b) /* ddl_entry=query-0000000061 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32 UUID '66db7faa-4940-45ca-8e39-98d5250d5bfb' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:24.968440 [ 221779 ] {20d65b18-4b33-4c0f-8c6e-fcb496cdbad6} StorageDistributed (measurements_histogramf32): Auto-increment is 0 2024.10.22 13:39:24.974465 [ 221779 ] {20d65b18-4b33-4c0f-8c6e-fcb496cdbad6} DDLWorker: Executed query: /* ddl_entry=query-0000000061 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32 UUID '66db7faa-4940-45ca-8e39-98d5250d5bfb' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:24.977997 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:25.000594 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 397.31 MiB, peak 411.72 MiB, free memory in arenas 17.29 MiB, will set to 396.22 MiB (RSS), difference: -1.09 MiB 2024.10.22 13:39:25.068299 [ 221633 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 8058ms 2024.10.22 13:39:25.075304 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:25.076059 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:25.080535 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=63, queue_size=63, entries=query-0000000000..query-0000000062, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000061, last_skipped_entry_name=none 2024.10.22 13:39:25.080558 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000062 2024.10.22 13:39:25.080565 [ 221779 ] {} DDLWorker: Checking task query-0000000062 2024.10.22 13:39:25.084399 [ 221779 ] {} DDLWorker: Processing task query-0000000062 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64_local UUID 'bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:25.090365 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64_local UUID 'bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:25.090716 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 77761e35-cf94-4b38-8ad3-35ef6ce14abf) /* ddl_entry=query-0000000062 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64_local UUID 'bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:25.095704 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Loading data parts 2024.10.22 13:39:25.095994 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): There are no data parts 2024.10.22 13:39:25.099903 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Creating table /clickhouse/tables/01/measurements_histogramf64_local 2024.10.22 13:39:25.108128 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): It looks like the table /clickhouse/tables/01/measurements_histogramf64_local was created by another server at the same moment, will retry 2024.10.22 13:39:25.108297 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): This table /clickhouse/tables/01/measurements_histogramf64_local is already created, will add new replica 2024.10.22 13:39:25.109428 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Creating replica /clickhouse/tables/01/measurements_histogramf64_local/replicas/02 2024.10.22 13:39:25.188444 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Creating shared ID for table oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64) 2024.10.22 13:39:25.188573 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Initializing table shared ID with bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64 2024.10.22 13:39:25.191840 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Starting up table 2024.10.22 13:39:25.192173 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Became leader 2024.10.22 13:39:25.192190 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:25.192217 [ 221533 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:25.192247 [ 221533 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:25.200215 [ 221533 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Replica 01 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:25.200235 [ 221533 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Will mimic 01 2024.10.22 13:39:25.204250 [ 221533 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:25.204265 [ 221533 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:25.204360 [ 221533 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Parts in ZooKeeper after mimic: 2024.10.22 13:39:25.204368 [ 221533 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Enqueued fetches after mimic: 2024.10.22 13:39:25.207463 [ 221533 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:25.207634 [ 221533 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:25.207647 [ 221533 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramf64_local/replicas/02/queue 2024.10.22 13:39:25.207751 [ 221533 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:25.207838 [ 221533 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:25.208479 [ 221533 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:25.208501 [ 221603 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Scheduling next merge selecting task after 6307ms 2024.10.22 13:39:25.209372 [ 221779 ] {c0170dd3-7d2b-4404-b3fe-da046440009c} DDLWorker: Executed query: /* ddl_entry=query-0000000062 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64_local UUID 'bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:25.213812 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:25.359796 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:25.359834 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:25.363208 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=64, queue_size=64, entries=query-0000000000..query-0000000063, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000062, last_skipped_entry_name=none 2024.10.22 13:39:25.363226 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000063 2024.10.22 13:39:25.363233 [ 221779 ] {} DDLWorker: Checking task query-0000000063 2024.10.22 13:39:25.363828 [ 221779 ] {} DDLWorker: Processing task query-0000000063 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64 UUID '729c812b-7b1a-4d5b-9e4a-b032642a6dfc' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:25.368853 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64 UUID '729c812b-7b1a-4d5b-9e4a-b032642a6dfc' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:25.369097 [ 221779 ] {bbcce514-d5a4-4224-a648-7ecc54c1485c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b84826d3-7f5e-4f85-8f80-e2372f1f497c) /* ddl_entry=query-0000000063 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64 UUID '729c812b-7b1a-4d5b-9e4a-b032642a6dfc' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:25.369651 [ 221779 ] {bbcce514-d5a4-4224-a648-7ecc54c1485c} StorageDistributed (measurements_histogramf64): Auto-increment is 0 2024.10.22 13:39:25.373249 [ 221779 ] {bbcce514-d5a4-4224-a648-7ecc54c1485c} DDLWorker: Executed query: /* ddl_entry=query-0000000063 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64 UUID '729c812b-7b1a-4d5b-9e4a-b032642a6dfc' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:25.377876 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:25.474486 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:25.474515 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:25.477965 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=65, queue_size=65, entries=query-0000000000..query-0000000064, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000063, last_skipped_entry_name=none 2024.10.22 13:39:25.477987 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000064 2024.10.22 13:39:25.477995 [ 221779 ] {} DDLWorker: Checking task query-0000000064 2024.10.22 13:39:25.478483 [ 221779 ] {} DDLWorker: Processing task query-0000000064 (CREATE TABLE IF NOT EXISTS oximeter.fields_bool_local UUID 'f3796524-2fef-4b07-932a-d46687e0a9e2' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_bool_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:25.481973 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_bool_local UUID 'f3796524-2fef-4b07-932a-d46687e0a9e2' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_bool_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:25.482173 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 04346c6b-fa1c-4d66-b635-e4c1df2f3f1b) /* ddl_entry=query-0000000064 */ CREATE TABLE IF NOT EXISTS oximeter.fields_bool_local UUID 'f3796524-2fef-4b07-932a-d46687e0a9e2' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_bool_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:25.486497 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Loading data parts 2024.10.22 13:39:25.486737 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): There are no data parts 2024.10.22 13:39:25.495116 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Creating table /clickhouse/tables/01/fields_bool_local 2024.10.22 13:39:25.505219 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): It looks like the table /clickhouse/tables/01/fields_bool_local was created by another server at the same moment, will retry 2024.10.22 13:39:25.505469 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): This table /clickhouse/tables/01/fields_bool_local is already created, will add new replica 2024.10.22 13:39:25.506816 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Creating replica /clickhouse/tables/01/fields_bool_local/replicas/02 2024.10.22 13:39:25.539797 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Creating shared ID for table oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2) 2024.10.22 13:39:25.539936 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Initializing table shared ID with f3796524-2fef-4b07-932a-d46687e0a9e2 2024.10.22 13:39:25.544495 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Starting up table 2024.10.22 13:39:25.545044 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Became leader 2024.10.22 13:39:25.545059 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} oximeter.fields_bool_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:25.545088 [ 221553 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:25.545105 [ 221553 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:25.551390 [ 221553 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:25.551405 [ 221553 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Will mimic 01 2024.10.22 13:39:25.559372 [ 221553 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:25.559802 [ 221553 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:25.564238 [ 221553 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Parts in ZooKeeper after mimic: 2024.10.22 13:39:25.564252 [ 221553 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Enqueued fetches after mimic: 2024.10.22 13:39:25.567700 [ 221553 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:25.567826 [ 221553 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:25.567838 [ 221553 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_bool_local/replicas/02/queue 2024.10.22 13:39:25.567974 [ 221553 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:25.568085 [ 221553 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:25.574220 [ 221553 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:25.574222 [ 221622 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Scheduling next merge selecting task after 6250ms 2024.10.22 13:39:25.574393 [ 221779 ] {4ea4e957-115b-4537-9504-c4467c105f9f} DDLWorker: Executed query: /* ddl_entry=query-0000000064 */ CREATE TABLE IF NOT EXISTS oximeter.fields_bool_local UUID 'f3796524-2fef-4b07-932a-d46687e0a9e2' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_bool_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:25.581982 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:25.592876 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:25.592881 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:25.593068 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=66, queue_size=66, entries=query-0000000000..query-0000000065, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000064, last_skipped_entry_name=none 2024.10.22 13:39:25.593078 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000065 2024.10.22 13:39:25.593084 [ 221779 ] {} DDLWorker: Checking task query-0000000065 2024.10.22 13:39:25.596755 [ 221779 ] {} DDLWorker: Processing task query-0000000065 (CREATE TABLE IF NOT EXISTS oximeter.fields_bool UUID '7b78961d-f992-46c8-8d36-caa461147dc8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_bool_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:25.600910 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_bool UUID '7b78961d-f992-46c8-8d36-caa461147dc8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_bool_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:25.601052 [ 221779 ] {c053dd37-5c71-4fb5-b8af-99fa9476c576} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5b40118b-1c6b-47ec-8ca3-c42ec29217ce) /* ddl_entry=query-0000000065 */ CREATE TABLE IF NOT EXISTS oximeter.fields_bool UUID '7b78961d-f992-46c8-8d36-caa461147dc8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_bool_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:25.601581 [ 221779 ] {c053dd37-5c71-4fb5-b8af-99fa9476c576} StorageDistributed (fields_bool): Auto-increment is 0 2024.10.22 13:39:25.605282 [ 221779 ] {c053dd37-5c71-4fb5-b8af-99fa9476c576} DDLWorker: Executed query: /* ddl_entry=query-0000000065 */ CREATE TABLE IF NOT EXISTS oximeter.fields_bool UUID '7b78961d-f992-46c8-8d36-caa461147dc8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_bool_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:25.609353 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:25.713102 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:25.713111 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:25.716455 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=67, queue_size=67, entries=query-0000000000..query-0000000066, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000065, last_skipped_entry_name=none 2024.10.22 13:39:25.716475 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000066 2024.10.22 13:39:25.716483 [ 221779 ] {} DDLWorker: Checking task query-0000000066 2024.10.22 13:39:25.716996 [ 221779 ] {} DDLWorker: Processing task query-0000000066 (CREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr_local UUID '5a6a1f25-8d1d-4c62-a62a-afbdf7311061' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` IPv6, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_ipaddr_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:25.721161 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr_local UUID '5a6a1f25-8d1d-4c62-a62a-afbdf7311061' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` IPv6, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_ipaddr_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:25.721345 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f3f194cd-4aa9-4e3e-a2a3-6325a214213a) /* ddl_entry=query-0000000066 */ CREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr_local UUID '5a6a1f25-8d1d-4c62-a62a-afbdf7311061' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` IPv6, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_ipaddr_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:25.726255 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Loading data parts 2024.10.22 13:39:25.726498 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): There are no data parts 2024.10.22 13:39:25.734429 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Creating table /clickhouse/tables/01/fields_ipaddr_local 2024.10.22 13:39:25.742124 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): It looks like the table /clickhouse/tables/01/fields_ipaddr_local was created by another server at the same moment, will retry 2024.10.22 13:39:25.742280 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): This table /clickhouse/tables/01/fields_ipaddr_local is already created, will add new replica 2024.10.22 13:39:25.743005 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Creating replica /clickhouse/tables/01/fields_ipaddr_local/replicas/02 2024.10.22 13:39:25.775396 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Creating shared ID for table oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061) 2024.10.22 13:39:25.778881 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Shared ID for table oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061) doesn't exist in ZooKeeper on path /clickhouse/tables/01/fields_ipaddr_local/table_shared_id 2024.10.22 13:39:25.778901 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Got candidate ID 5a6a1f25-8d1d-4c62-a62a-afbdf7311061, will try to create it in ZooKeeper on path /clickhouse/tables/01/fields_ipaddr_local/table_shared_id 2024.10.22 13:39:25.782690 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Initializing table shared ID with 5a6a1f25-8d1d-4c62-a62a-afbdf7311061 2024.10.22 13:39:25.786365 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Starting up table 2024.10.22 13:39:25.788159 [ 221527 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 7965ms 2024.10.22 13:39:25.789803 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Became leader 2024.10.22 13:39:25.789816 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} oximeter.fields_ipaddr_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:25.789840 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:25.789863 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:25.807354 [ 221546 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:25.807379 [ 221546 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Will mimic 01 2024.10.22 13:39:25.815500 [ 221546 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:25.815514 [ 221546 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:25.815651 [ 221546 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Parts in ZooKeeper after mimic: 2024.10.22 13:39:25.815665 [ 221546 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Enqueued fetches after mimic: 2024.10.22 13:39:25.819036 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:25.819176 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:25.819189 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_ipaddr_local/replicas/02/queue 2024.10.22 13:39:25.819311 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:25.819437 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:25.830246 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:25.830325 [ 221564 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Scheduling next merge selecting task after 6037ms 2024.10.22 13:39:25.830461 [ 221779 ] {c9f00579-72ab-4b74-907b-6d3a9c30e906} DDLWorker: Executed query: /* ddl_entry=query-0000000066 */ CREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr_local UUID '5a6a1f25-8d1d-4c62-a62a-afbdf7311061' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` IPv6, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_ipaddr_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:25.833737 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:25.847838 [ 221653 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 8322ms 2024.10.22 13:39:25.979443 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:25.979449 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:25.982974 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=68, queue_size=68, entries=query-0000000000..query-0000000067, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000066, last_skipped_entry_name=none 2024.10.22 13:39:25.982989 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000067 2024.10.22 13:39:25.982995 [ 221779 ] {} DDLWorker: Checking task query-0000000067 2024.10.22 13:39:25.983602 [ 221779 ] {} DDLWorker: Processing task query-0000000067 (CREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr UUID '7d97d034-0386-4490-9c39-70c74c893b9b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` IPv6, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_ipaddr_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:25.990825 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr UUID '7d97d034-0386-4490-9c39-70c74c893b9b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` IPv6, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_ipaddr_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:25.991009 [ 221779 ] {ad5737e3-e247-4c20-9487-bc917b3956c9} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 75c06e7e-8673-4e2b-9f75-49b56705352c) /* ddl_entry=query-0000000067 */ CREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr UUID '7d97d034-0386-4490-9c39-70c74c893b9b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` IPv6, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_ipaddr_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:25.991529 [ 221779 ] {ad5737e3-e247-4c20-9487-bc917b3956c9} StorageDistributed (fields_ipaddr): Auto-increment is 0 2024.10.22 13:39:25.995087 [ 221779 ] {ad5737e3-e247-4c20-9487-bc917b3956c9} DDLWorker: Executed query: /* ddl_entry=query-0000000067 */ CREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr UUID '7d97d034-0386-4490-9c39-70c74c893b9b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` IPv6, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_ipaddr_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:26.001867 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:26.093741 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:26.093752 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:26.097203 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=69, queue_size=69, entries=query-0000000000..query-0000000068, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000067, last_skipped_entry_name=none 2024.10.22 13:39:26.097226 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000068 2024.10.22 13:39:26.097235 [ 221779 ] {} DDLWorker: Checking task query-0000000068 2024.10.22 13:39:26.097777 [ 221779 ] {} DDLWorker: Processing task query-0000000068 (CREATE TABLE IF NOT EXISTS oximeter.fields_string_local UUID '1a7682b7-8009-431c-aef6-d5a74e3f181e' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` String, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_string_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:26.101954 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_string_local UUID '1a7682b7-8009-431c-aef6-d5a74e3f181e' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` String, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_string_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:26.102168 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f65350c1-bd51-4bc5-b6e9-84f539da75ee) /* ddl_entry=query-0000000068 */ CREATE TABLE IF NOT EXISTS oximeter.fields_string_local UUID '1a7682b7-8009-431c-aef6-d5a74e3f181e' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` String, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_string_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:26.106205 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Loading data parts 2024.10.22 13:39:26.106475 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): There are no data parts 2024.10.22 13:39:26.112413 [ 221565 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 7690ms 2024.10.22 13:39:26.114396 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Creating table /clickhouse/tables/01/fields_string_local 2024.10.22 13:39:26.122220 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): It looks like the table /clickhouse/tables/01/fields_string_local was created by another server at the same moment, will retry 2024.10.22 13:39:26.122374 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): This table /clickhouse/tables/01/fields_string_local is already created, will add new replica 2024.10.22 13:39:26.138842 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Creating replica /clickhouse/tables/01/fields_string_local/replicas/02 2024.10.22 13:39:26.162579 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Creating shared ID for table oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e) 2024.10.22 13:39:26.162734 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Shared ID for table oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e) doesn't exist in ZooKeeper on path /clickhouse/tables/01/fields_string_local/table_shared_id 2024.10.22 13:39:26.162751 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Got candidate ID 1a7682b7-8009-431c-aef6-d5a74e3f181e, will try to create it in ZooKeeper on path /clickhouse/tables/01/fields_string_local/table_shared_id 2024.10.22 13:39:26.169453 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Shared ID on path /clickhouse/tables/01/fields_string_local/table_shared_id concurrently created, will set ID 1a7682b7-8009-431c-aef6-d5a74e3f181e 2024.10.22 13:39:26.169489 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Initializing table shared ID with 1a7682b7-8009-431c-aef6-d5a74e3f181e 2024.10.22 13:39:26.172776 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Starting up table 2024.10.22 13:39:26.176201 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Became leader 2024.10.22 13:39:26.176218 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} oximeter.fields_string_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:26.176270 [ 221608 ] {} oximeter.fields_string_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:26.176299 [ 221608 ] {} oximeter.fields_string_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:26.184157 [ 221608 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:26.184186 [ 221608 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Will mimic 01 2024.10.22 13:39:26.191287 [ 221608 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:26.191310 [ 221608 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:26.191451 [ 221608 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Parts in ZooKeeper after mimic: 2024.10.22 13:39:26.191462 [ 221608 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Enqueued fetches after mimic: 2024.10.22 13:39:26.197456 [ 221608 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:26.197827 [ 221608 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:26.197841 [ 221608 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_string_local/replicas/02/queue 2024.10.22 13:39:26.201557 [ 221608 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:26.201731 [ 221608 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:26.205963 [ 221608 ] {} oximeter.fields_string_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:26.206029 [ 221608 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Scheduling next merge selecting task after 6058ms 2024.10.22 13:39:26.207767 [ 221779 ] {de61029e-3e08-4118-b10c-a8532fff6b0d} DDLWorker: Executed query: /* ddl_entry=query-0000000068 */ CREATE TABLE IF NOT EXISTS oximeter.fields_string_local UUID '1a7682b7-8009-431c-aef6-d5a74e3f181e' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` String, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_string_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:26.211756 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:26.262455 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:26.262458 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:26.262675 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=70, queue_size=70, entries=query-0000000000..query-0000000069, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000068, last_skipped_entry_name=none 2024.10.22 13:39:26.262692 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000069 2024.10.22 13:39:26.262699 [ 221779 ] {} DDLWorker: Checking task query-0000000069 2024.10.22 13:39:26.266615 [ 221779 ] {} DDLWorker: Processing task query-0000000069 (CREATE TABLE IF NOT EXISTS oximeter.fields_string UUID '89d17009-77e3-49f8-a883-38f7f734c15a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` String, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_string_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:26.273601 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_string UUID '89d17009-77e3-49f8-a883-38f7f734c15a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` String, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_string_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:26.273819 [ 221779 ] {360fe08d-069e-4933-9873-427b9a5ef51a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 06afcda4-a712-4763-b99e-c3399b7c1d33) /* ddl_entry=query-0000000069 */ CREATE TABLE IF NOT EXISTS oximeter.fields_string UUID '89d17009-77e3-49f8-a883-38f7f734c15a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` String, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_string_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:26.274389 [ 221779 ] {360fe08d-069e-4933-9873-427b9a5ef51a} StorageDistributed (fields_string): Auto-increment is 0 2024.10.22 13:39:26.279165 [ 221779 ] {360fe08d-069e-4933-9873-427b9a5ef51a} DDLWorker: Executed query: /* ddl_entry=query-0000000069 */ CREATE TABLE IF NOT EXISTS oximeter.fields_string UUID '89d17009-77e3-49f8-a883-38f7f734c15a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` String, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_string_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:26.287406 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:26.379806 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:26.379809 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:26.383372 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=71, queue_size=71, entries=query-0000000000..query-0000000070, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000069, last_skipped_entry_name=none 2024.10.22 13:39:26.383394 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000070 2024.10.22 13:39:26.383400 [ 221779 ] {} DDLWorker: Checking task query-0000000070 2024.10.22 13:39:26.383958 [ 221779 ] {} DDLWorker: Processing task query-0000000070 (CREATE TABLE IF NOT EXISTS oximeter.fields_i8_local UUID '2e7c271c-ed1c-4a43-8d27-2b86d32f6d73' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i8_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:26.387541 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i8_local UUID '2e7c271c-ed1c-4a43-8d27-2b86d32f6d73' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i8_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:26.387765 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: effd7f66-d982-46e4-aac8-b723d57ad5aa) /* ddl_entry=query-0000000070 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i8_local UUID '2e7c271c-ed1c-4a43-8d27-2b86d32f6d73' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i8_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:26.392422 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Loading data parts 2024.10.22 13:39:26.392688 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): There are no data parts 2024.10.22 13:39:26.400748 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Creating table /clickhouse/tables/01/fields_i8_local 2024.10.22 13:39:26.404274 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): It looks like the table /clickhouse/tables/01/fields_i8_local was created by another server at the same moment, will retry 2024.10.22 13:39:26.404417 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): This table /clickhouse/tables/01/fields_i8_local is already created, will add new replica 2024.10.22 13:39:26.405229 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Creating replica /clickhouse/tables/01/fields_i8_local/replicas/02 2024.10.22 13:39:26.437594 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Creating shared ID for table oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73) 2024.10.22 13:39:26.441018 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Initializing table shared ID with 2e7c271c-ed1c-4a43-8d27-2b86d32f6d73 2024.10.22 13:39:26.444628 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Starting up table 2024.10.22 13:39:26.449223 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Became leader 2024.10.22 13:39:26.449239 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} oximeter.fields_i8_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:26.449275 [ 221642 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:26.449292 [ 221642 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:26.460871 [ 221642 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:26.460889 [ 221642 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Will mimic 01 2024.10.22 13:39:26.466877 [ 221642 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:26.466894 [ 221642 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:26.467034 [ 221642 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Parts in ZooKeeper after mimic: 2024.10.22 13:39:26.467986 [ 221642 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Enqueued fetches after mimic: 2024.10.22 13:39:26.474859 [ 221642 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:26.475035 [ 221642 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:26.475049 [ 221642 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_i8_local/replicas/02/queue 2024.10.22 13:39:26.475287 [ 221642 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:26.475466 [ 221642 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:26.485778 [ 221642 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:26.485783 [ 221526 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Scheduling next merge selecting task after 6545ms 2024.10.22 13:39:26.485974 [ 221779 ] {770bd2a2-2a12-4704-be41-0865909017a0} DDLWorker: Executed query: /* ddl_entry=query-0000000070 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i8_local UUID '2e7c271c-ed1c-4a43-8d27-2b86d32f6d73' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i8_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:26.489487 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:26.501159 [ 221584 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 8046ms 2024.10.22 13:39:26.547992 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:26.547998 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:26.551801 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=72, queue_size=72, entries=query-0000000000..query-0000000071, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000070, last_skipped_entry_name=none 2024.10.22 13:39:26.551817 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000071 2024.10.22 13:39:26.551824 [ 221779 ] {} DDLWorker: Checking task query-0000000071 2024.10.22 13:39:26.552338 [ 221779 ] {} DDLWorker: Processing task query-0000000071 (CREATE TABLE IF NOT EXISTS oximeter.fields_i8 UUID '422be661-0bba-4720-b58d-68c58c379803' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i8_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:26.555723 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i8 UUID '422be661-0bba-4720-b58d-68c58c379803' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:26.555891 [ 221779 ] {0afa960d-390b-4649-a722-2251de31ab28} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0a75d73f-4b79-4eb2-81f9-a156331a0ff6) /* ddl_entry=query-0000000071 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i8 UUID '422be661-0bba-4720-b58d-68c58c379803' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i8_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:26.556429 [ 221779 ] {0afa960d-390b-4649-a722-2251de31ab28} StorageDistributed (fields_i8): Auto-increment is 0 2024.10.22 13:39:26.560025 [ 221779 ] {0afa960d-390b-4649-a722-2251de31ab28} DDLWorker: Executed query: /* ddl_entry=query-0000000071 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i8 UUID '422be661-0bba-4720-b58d-68c58c379803' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:26.565443 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:26.660860 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:26.660864 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:26.664382 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=73, queue_size=73, entries=query-0000000000..query-0000000072, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000071, last_skipped_entry_name=none 2024.10.22 13:39:26.664399 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000072 2024.10.22 13:39:26.664404 [ 221779 ] {} DDLWorker: Checking task query-0000000072 2024.10.22 13:39:26.664880 [ 221779 ] {} DDLWorker: Processing task query-0000000072 (CREATE TABLE IF NOT EXISTS oximeter.fields_u8_local UUID 'ccf4513e-49f9-4b42-ab8d-4d79efe2d01f' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u8_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:26.670537 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_u8_local UUID 'ccf4513e-49f9-4b42-ab8d-4d79efe2d01f' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u8_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:26.670692 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4da04b3d-5154-491d-8015-9339f9702bed) /* ddl_entry=query-0000000072 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u8_local UUID 'ccf4513e-49f9-4b42-ab8d-4d79efe2d01f' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u8_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:26.676693 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Loading data parts 2024.10.22 13:39:26.676925 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): There are no data parts 2024.10.22 13:39:26.682058 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Creating table /clickhouse/tables/01/fields_u8_local 2024.10.22 13:39:26.718537 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Creating shared ID for table oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f) 2024.10.22 13:39:26.722207 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Shared ID for table oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f) doesn't exist in ZooKeeper on path /clickhouse/tables/01/fields_u8_local/table_shared_id 2024.10.22 13:39:26.722222 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Got candidate ID ccf4513e-49f9-4b42-ab8d-4d79efe2d01f, will try to create it in ZooKeeper on path /clickhouse/tables/01/fields_u8_local/table_shared_id 2024.10.22 13:39:26.726555 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Initializing table shared ID with ccf4513e-49f9-4b42-ab8d-4d79efe2d01f 2024.10.22 13:39:26.731302 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Starting up table 2024.10.22 13:39:26.739315 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Became leader 2024.10.22 13:39:26.739333 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} oximeter.fields_u8_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:26.739379 [ 221603 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:26.739395 [ 221603 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:26.743183 [ 221603 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:26.743291 [ 221603 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:26.743303 [ 221603 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_u8_local/replicas/02/queue 2024.10.22 13:39:26.746648 [ 221603 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:26.746786 [ 221603 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:26.754245 [ 221603 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:26.754283 [ 221539 ] {} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Scheduling next merge selecting task after 6229ms 2024.10.22 13:39:26.754663 [ 221779 ] {40d0a22e-bbbf-47f5-9787-47868d2bc484} DDLWorker: Executed query: /* ddl_entry=query-0000000072 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u8_local UUID 'ccf4513e-49f9-4b42-ab8d-4d79efe2d01f' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u8_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:26.761392 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:26.826295 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:26.826301 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:26.829781 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=74, queue_size=74, entries=query-0000000000..query-0000000073, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000072, last_skipped_entry_name=none 2024.10.22 13:39:26.829800 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000073 2024.10.22 13:39:26.829804 [ 221779 ] {} DDLWorker: Checking task query-0000000073 2024.10.22 13:39:26.830326 [ 221779 ] {} DDLWorker: Processing task query-0000000073 (CREATE TABLE IF NOT EXISTS oximeter.fields_u8 UUID '9cd76a9b-2142-4f66-8174-32eeaf826c74' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u8_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:26.837338 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_u8 UUID '9cd76a9b-2142-4f66-8174-32eeaf826c74' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:26.837499 [ 221779 ] {ced27711-6185-4652-a9c8-65f0e82590af} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 7643cf86-d262-45d7-8bea-b5776f4f0868) /* ddl_entry=query-0000000073 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u8 UUID '9cd76a9b-2142-4f66-8174-32eeaf826c74' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u8_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:26.838005 [ 221779 ] {ced27711-6185-4652-a9c8-65f0e82590af} StorageDistributed (fields_u8): Auto-increment is 0 2024.10.22 13:39:26.841441 [ 221779 ] {ced27711-6185-4652-a9c8-65f0e82590af} DDLWorker: Executed query: /* ddl_entry=query-0000000073 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u8 UUID '9cd76a9b-2142-4f66-8174-32eeaf826c74' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt8, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:26.847814 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:26.940894 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:26.940901 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:26.944058 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=75, queue_size=75, entries=query-0000000000..query-0000000074, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000073, last_skipped_entry_name=none 2024.10.22 13:39:26.944073 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000074 2024.10.22 13:39:26.944079 [ 221779 ] {} DDLWorker: Checking task query-0000000074 2024.10.22 13:39:26.944688 [ 221779 ] {} DDLWorker: Processing task query-0000000074 (CREATE TABLE IF NOT EXISTS oximeter.fields_i16_local UUID 'd5ad83cf-9687-4724-a859-e5b8dfc5eef0' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i16_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:26.957902 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i16_local UUID 'd5ad83cf-9687-4724-a859-e5b8dfc5eef0' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i16_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:26.958202 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c7915adf-4461-4dd1-b2d3-0f5e4804066b) /* ddl_entry=query-0000000074 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i16_local UUID 'd5ad83cf-9687-4724-a859-e5b8dfc5eef0' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i16_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:26.962819 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Loading data parts 2024.10.22 13:39:26.963016 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): There are no data parts 2024.10.22 13:39:26.968256 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): This table /clickhouse/tables/01/fields_i16_local is already created, will add new replica 2024.10.22 13:39:26.973072 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Creating replica /clickhouse/tables/01/fields_i16_local/replicas/02 2024.10.22 13:39:27.001203 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 397.70 MiB, peak 411.72 MiB, free memory in arenas 12.79 MiB, will set to 394.73 MiB (RSS), difference: -2.96 MiB 2024.10.22 13:39:27.009150 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Creating shared ID for table oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0) 2024.10.22 13:39:27.009285 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Shared ID for table oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0) doesn't exist in ZooKeeper on path /clickhouse/tables/01/fields_i16_local/table_shared_id 2024.10.22 13:39:27.009302 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Got candidate ID d5ad83cf-9687-4724-a859-e5b8dfc5eef0, will try to create it in ZooKeeper on path /clickhouse/tables/01/fields_i16_local/table_shared_id 2024.10.22 13:39:27.013955 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Initializing table shared ID with d5ad83cf-9687-4724-a859-e5b8dfc5eef0 2024.10.22 13:39:27.018621 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Starting up table 2024.10.22 13:39:27.024401 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Became leader 2024.10.22 13:39:27.024417 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} oximeter.fields_i16_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:27.024435 [ 221670 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:27.024445 [ 221670 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:27.032065 [ 221670 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:27.032081 [ 221670 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Will mimic 01 2024.10.22 13:39:27.039553 [ 221670 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Log pointer of source replica 01 changed while we loading queue nodes. Will retry. 2024.10.22 13:39:27.048652 [ 221670 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:27.048664 [ 221670 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:27.048775 [ 221670 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Parts in ZooKeeper after mimic: 2024.10.22 13:39:27.048786 [ 221670 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Enqueued fetches after mimic: 2024.10.22 13:39:27.052200 [ 221670 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:27.052304 [ 221670 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:27.052311 [ 221670 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_i16_local/replicas/02/queue 2024.10.22 13:39:27.052413 [ 221670 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:27.052501 [ 221670 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:27.053098 [ 221667 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Scheduling next merge selecting task after 6482ms 2024.10.22 13:39:27.053103 [ 221670 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:27.053271 [ 221779 ] {4dc58b71-b892-4023-b654-f0ae5c586e5a} DDLWorker: Executed query: /* ddl_entry=query-0000000074 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i16_local UUID 'd5ad83cf-9687-4724-a859-e5b8dfc5eef0' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i16_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:27.057656 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:27.109105 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:27.109112 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:27.113348 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=76, queue_size=76, entries=query-0000000000..query-0000000075, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000074, last_skipped_entry_name=none 2024.10.22 13:39:27.113364 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000075 2024.10.22 13:39:27.113369 [ 221779 ] {} DDLWorker: Checking task query-0000000075 2024.10.22 13:39:27.113878 [ 221779 ] {} DDLWorker: Processing task query-0000000075 (CREATE TABLE IF NOT EXISTS oximeter.fields_i16 UUID '2a52aa99-39ad-4582-82f7-c29f1ae1caa3' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i16_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:27.121594 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i16 UUID '2a52aa99-39ad-4582-82f7-c29f1ae1caa3' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:27.121714 [ 221779 ] {65c785fc-3b21-46a9-b12d-a05007b91561} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 00c71937-c8c6-48b6-8cf2-8856dccd4961) /* ddl_entry=query-0000000075 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i16 UUID '2a52aa99-39ad-4582-82f7-c29f1ae1caa3' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i16_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:27.122149 [ 221779 ] {65c785fc-3b21-46a9-b12d-a05007b91561} StorageDistributed (fields_i16): Auto-increment is 0 2024.10.22 13:39:27.128260 [ 221779 ] {65c785fc-3b21-46a9-b12d-a05007b91561} DDLWorker: Executed query: /* ddl_entry=query-0000000075 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i16 UUID '2a52aa99-39ad-4582-82f7-c29f1ae1caa3' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:27.134233 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:27.224264 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:27.224273 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:27.227465 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=77, queue_size=77, entries=query-0000000000..query-0000000076, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000075, last_skipped_entry_name=none 2024.10.22 13:39:27.227485 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000076 2024.10.22 13:39:27.227492 [ 221779 ] {} DDLWorker: Checking task query-0000000076 2024.10.22 13:39:27.227982 [ 221779 ] {} DDLWorker: Processing task query-0000000076 (CREATE TABLE IF NOT EXISTS oximeter.fields_u16_local UUID '9ec340f3-de4a-48f9-bba4-d8da6cc7212a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u16_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:27.234871 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_u16_local UUID '9ec340f3-de4a-48f9-bba4-d8da6cc7212a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u16_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:27.235039 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d8764875-366a-4651-9646-9d2b0f56fa81) /* ddl_entry=query-0000000076 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u16_local UUID '9ec340f3-de4a-48f9-bba4-d8da6cc7212a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u16_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:27.238935 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Loading data parts 2024.10.22 13:39:27.239177 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): There are no data parts 2024.10.22 13:39:27.242246 [ 221555 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 7904ms 2024.10.22 13:39:27.243884 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Creating table /clickhouse/tables/01/fields_u16_local 2024.10.22 13:39:27.255292 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): It looks like the table /clickhouse/tables/01/fields_u16_local was created by another server at the same moment, will retry 2024.10.22 13:39:27.255427 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): This table /clickhouse/tables/01/fields_u16_local is already created, will add new replica 2024.10.22 13:39:27.259116 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Creating replica /clickhouse/tables/01/fields_u16_local/replicas/02 2024.10.22 13:39:27.271658 [ 221597 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 7926ms 2024.10.22 13:39:27.283317 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Creating shared ID for table oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a) 2024.10.22 13:39:27.286732 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Initializing table shared ID with 9ec340f3-de4a-48f9-bba4-d8da6cc7212a 2024.10.22 13:39:27.289977 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Starting up table 2024.10.22 13:39:27.294006 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Became leader 2024.10.22 13:39:27.294022 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} oximeter.fields_u16_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:27.294060 [ 221616 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:27.294088 [ 221616 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:27.303028 [ 221616 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:27.303051 [ 221616 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Will mimic 01 2024.10.22 13:39:27.306638 [ 221616 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:27.306649 [ 221616 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:27.311905 [ 221616 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Parts in ZooKeeper after mimic: 2024.10.22 13:39:27.311916 [ 221616 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Enqueued fetches after mimic: 2024.10.22 13:39:27.315344 [ 221616 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:27.315490 [ 221616 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:27.315505 [ 221616 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_u16_local/replicas/02/queue 2024.10.22 13:39:27.315676 [ 221616 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:27.315813 [ 221616 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:27.324179 [ 221616 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:27.324180 [ 221598 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Scheduling next merge selecting task after 6492ms 2024.10.22 13:39:27.324306 [ 221779 ] {f57b51e3-0079-4187-923a-246b3d3a30d0} DDLWorker: Executed query: /* ddl_entry=query-0000000076 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u16_local UUID '9ec340f3-de4a-48f9-bba4-d8da6cc7212a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u16_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:27.327346 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:27.338721 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:27.338760 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:27.341831 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=78, queue_size=78, entries=query-0000000000..query-0000000077, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000076, last_skipped_entry_name=none 2024.10.22 13:39:27.341846 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000077 2024.10.22 13:39:27.341852 [ 221779 ] {} DDLWorker: Checking task query-0000000077 2024.10.22 13:39:27.344921 [ 221779 ] {} DDLWorker: Processing task query-0000000077 (CREATE TABLE IF NOT EXISTS oximeter.fields_u16 UUID 'ac58ae3e-e31d-43a5-8cd0-59951b52949d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u16_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:27.348870 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_u16 UUID 'ac58ae3e-e31d-43a5-8cd0-59951b52949d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:27.348995 [ 221779 ] {96cabc15-57d9-4bda-b1b7-6d9f47e4aa36} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 744edfcf-ab7f-4c3b-9860-877334bfa519) /* ddl_entry=query-0000000077 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u16 UUID 'ac58ae3e-e31d-43a5-8cd0-59951b52949d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u16_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:27.349397 [ 221779 ] {96cabc15-57d9-4bda-b1b7-6d9f47e4aa36} StorageDistributed (fields_u16): Auto-increment is 0 2024.10.22 13:39:27.353712 [ 221779 ] {96cabc15-57d9-4bda-b1b7-6d9f47e4aa36} DDLWorker: Executed query: /* ddl_entry=query-0000000077 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u16 UUID 'ac58ae3e-e31d-43a5-8cd0-59951b52949d' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt16, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:27.359592 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:27.451200 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:27.451208 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:27.451420 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=79, queue_size=79, entries=query-0000000000..query-0000000078, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000077, last_skipped_entry_name=none 2024.10.22 13:39:27.451432 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000078 2024.10.22 13:39:27.451439 [ 221779 ] {} DDLWorker: Checking task query-0000000078 2024.10.22 13:39:27.455122 [ 221779 ] {} DDLWorker: Processing task query-0000000078 (CREATE TABLE IF NOT EXISTS oximeter.fields_i32_local UUID '7e213126-cb76-4dd1-a57e-bc790b9ffc46' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i32_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:27.460258 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i32_local UUID '7e213126-cb76-4dd1-a57e-bc790b9ffc46' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i32_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:27.460438 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 7332ce44-a630-4f61-9f82-a883c267326a) /* ddl_entry=query-0000000078 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i32_local UUID '7e213126-cb76-4dd1-a57e-bc790b9ffc46' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i32_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:27.464456 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Loading data parts 2024.10.22 13:39:27.464709 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): There are no data parts 2024.10.22 13:39:27.469614 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Creating table /clickhouse/tables/01/fields_i32_local 2024.10.22 13:39:27.499867 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Creating shared ID for table oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46) 2024.10.22 13:39:27.503262 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Shared ID for table oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46) doesn't exist in ZooKeeper on path /clickhouse/tables/01/fields_i32_local/table_shared_id 2024.10.22 13:39:27.503278 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Got candidate ID 7e213126-cb76-4dd1-a57e-bc790b9ffc46, will try to create it in ZooKeeper on path /clickhouse/tables/01/fields_i32_local/table_shared_id 2024.10.22 13:39:27.510015 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Initializing table shared ID with 7e213126-cb76-4dd1-a57e-bc790b9ffc46 2024.10.22 13:39:27.513536 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Starting up table 2024.10.22 13:39:27.518055 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): LeaderElection: leader suddenly changed or new node appeared, will retry 2024.10.22 13:39:27.518227 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Became leader 2024.10.22 13:39:27.518238 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} oximeter.fields_i32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:27.518280 [ 221566 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:27.518296 [ 221566 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:27.526305 [ 221566 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:27.526418 [ 221566 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:27.526431 [ 221566 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_i32_local/replicas/02/queue 2024.10.22 13:39:27.526530 [ 221566 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:27.526653 [ 221566 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:27.533972 [ 221566 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:27.534001 [ 221608 ] {} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Scheduling next merge selecting task after 6441ms 2024.10.22 13:39:27.534140 [ 221779 ] {f39e2874-d231-40cd-b18d-a9ad69849c68} DDLWorker: Executed query: /* ddl_entry=query-0000000078 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i32_local UUID '7e213126-cb76-4dd1-a57e-bc790b9ffc46' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i32_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:27.537682 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:27.574724 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:27.574731 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:27.578230 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=80, queue_size=80, entries=query-0000000000..query-0000000079, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000078, last_skipped_entry_name=none 2024.10.22 13:39:27.578248 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000079 2024.10.22 13:39:27.578256 [ 221779 ] {} DDLWorker: Checking task query-0000000079 2024.10.22 13:39:27.578669 [ 221779 ] {} DDLWorker: Processing task query-0000000079 (CREATE TABLE IF NOT EXISTS oximeter.fields_i32 UUID '30178811-cf73-4fa6-aae3-33ce95274694' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:27.581932 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i32 UUID '30178811-cf73-4fa6-aae3-33ce95274694' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:27.582101 [ 221779 ] {368cc46c-0d38-4f14-bbd3-a56a25849446} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c2243eba-e645-4fe0-9b36-8ea6c62587d0) /* ddl_entry=query-0000000079 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i32 UUID '30178811-cf73-4fa6-aae3-33ce95274694' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:27.582620 [ 221779 ] {368cc46c-0d38-4f14-bbd3-a56a25849446} StorageDistributed (fields_i32): Auto-increment is 0 2024.10.22 13:39:27.586818 [ 221779 ] {368cc46c-0d38-4f14-bbd3-a56a25849446} DDLWorker: Executed query: /* ddl_entry=query-0000000079 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i32 UUID '30178811-cf73-4fa6-aae3-33ce95274694' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:27.591464 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:27.645847 [ 221576 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 8095ms 2024.10.22 13:39:27.690429 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:27.690435 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:27.693316 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=81, queue_size=81, entries=query-0000000000..query-0000000080, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000079, last_skipped_entry_name=none 2024.10.22 13:39:27.693338 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000080 2024.10.22 13:39:27.693343 [ 221779 ] {} DDLWorker: Checking task query-0000000080 2024.10.22 13:39:27.693736 [ 221779 ] {} DDLWorker: Processing task query-0000000080 (CREATE TABLE IF NOT EXISTS oximeter.fields_u32_local UUID '987eb66a-c14b-4b5d-a6c7-af473fe2ee3c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u32_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:27.696737 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_u32_local UUID '987eb66a-c14b-4b5d-a6c7-af473fe2ee3c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u32_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:27.696941 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5b154e36-6b9d-4e14-9e61-ecd54f063b88) /* ddl_entry=query-0000000080 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u32_local UUID '987eb66a-c14b-4b5d-a6c7-af473fe2ee3c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u32_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:27.702290 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Loading data parts 2024.10.22 13:39:27.702519 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): There are no data parts 2024.10.22 13:39:27.711022 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Creating table /clickhouse/tables/01/fields_u32_local 2024.10.22 13:39:27.718164 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): It looks like the table /clickhouse/tables/01/fields_u32_local was created by another server at the same moment, will retry 2024.10.22 13:39:27.718313 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): This table /clickhouse/tables/01/fields_u32_local is already created, will add new replica 2024.10.22 13:39:27.719035 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Creating replica /clickhouse/tables/01/fields_u32_local/replicas/02 2024.10.22 13:39:27.746850 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Creating shared ID for table oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c) 2024.10.22 13:39:27.750180 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Initializing table shared ID with 987eb66a-c14b-4b5d-a6c7-af473fe2ee3c 2024.10.22 13:39:27.755909 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Starting up table 2024.10.22 13:39:27.760717 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): LeaderElection: leader suddenly changed or new node appeared, will retry 2024.10.22 13:39:27.760902 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Became leader 2024.10.22 13:39:27.760917 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} oximeter.fields_u32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:27.760951 [ 221642 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:27.760965 [ 221642 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:27.770294 [ 221642 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:27.770314 [ 221642 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Will mimic 01 2024.10.22 13:39:27.776559 [ 221642 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Log pointer of source replica 01 changed while we loading queue nodes. Will retry. 2024.10.22 13:39:27.780316 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1631 entries to flush up to offset 3367 2024.10.22 13:39:27.781922 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:27.781942 [ 221768 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 164.93 GiB. 2024.10.22 13:39:27.783633 [ 221768 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 13:39:27.783866 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:27.783971 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 3367 2024.10.22 13:39:27.785198 [ 221642 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:27.785435 [ 221642 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:27.785553 [ 221642 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Parts in ZooKeeper after mimic: 2024.10.22 13:39:27.785561 [ 221642 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Enqueued fetches after mimic: 2024.10.22 13:39:27.789435 [ 221642 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:27.789555 [ 221642 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:27.789567 [ 221642 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_u32_local/replicas/02/queue 2024.10.22 13:39:27.789668 [ 221642 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:27.789779 [ 221642 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:27.790427 [ 221642 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:27.790443 [ 221584 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Scheduling next merge selecting task after 6340ms 2024.10.22 13:39:27.790604 [ 221779 ] {a26d008b-dd70-4349-9514-d129c3756e74} DDLWorker: Executed query: /* ddl_entry=query-0000000080 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u32_local UUID '987eb66a-c14b-4b5d-a6c7-af473fe2ee3c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u32_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:27.794021 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:27.808281 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:27.808292 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:27.811733 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=82, queue_size=82, entries=query-0000000000..query-0000000081, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000080, last_skipped_entry_name=none 2024.10.22 13:39:27.811753 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000081 2024.10.22 13:39:27.811761 [ 221779 ] {} DDLWorker: Checking task query-0000000081 2024.10.22 13:39:27.812210 [ 221779 ] {} DDLWorker: Processing task query-0000000081 (CREATE TABLE IF NOT EXISTS oximeter.fields_u32 UUID 'a078d8d9-aaa5-4013-9e3c-ddb43433f177' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:27.815608 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_u32 UUID 'a078d8d9-aaa5-4013-9e3c-ddb43433f177' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:27.815766 [ 221779 ] {3df57faf-dc51-4d61-9a04-593c560b33cb} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 04cfefee-086f-4b6e-9c20-fb1a3d65fb02) /* ddl_entry=query-0000000081 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u32 UUID 'a078d8d9-aaa5-4013-9e3c-ddb43433f177' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:27.816325 [ 221779 ] {3df57faf-dc51-4d61-9a04-593c560b33cb} StorageDistributed (fields_u32): Auto-increment is 0 2024.10.22 13:39:27.821592 [ 221779 ] {3df57faf-dc51-4d61-9a04-593c560b33cb} DDLWorker: Executed query: /* ddl_entry=query-0000000081 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u32 UUID 'a078d8d9-aaa5-4013-9e3c-ddb43433f177' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt32, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:27.826717 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:27.928697 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:27.928721 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:27.929056 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=83, queue_size=83, entries=query-0000000000..query-0000000082, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000081, last_skipped_entry_name=none 2024.10.22 13:39:27.929071 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000082 2024.10.22 13:39:27.929076 [ 221779 ] {} DDLWorker: Checking task query-0000000082 2024.10.22 13:39:27.929534 [ 221779 ] {} DDLWorker: Processing task query-0000000082 (CREATE TABLE IF NOT EXISTS oximeter.fields_u64_local UUID 'f58d15d2-b41b-4822-8e1d-b1a332acd282' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:27.947441 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_u64_local UUID 'f58d15d2-b41b-4822-8e1d-b1a332acd282' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:27.947720 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ea7a5fe4-e4ff-45ee-ac65-e11198b19055) /* ddl_entry=query-0000000082 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u64_local UUID 'f58d15d2-b41b-4822-8e1d-b1a332acd282' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:27.953017 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Loading data parts 2024.10.22 13:39:27.953316 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): There are no data parts 2024.10.22 13:39:27.963437 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Creating table /clickhouse/tables/01/fields_u64_local 2024.10.22 13:39:27.974964 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): It looks like the table /clickhouse/tables/01/fields_u64_local was created by another server at the same moment, will retry 2024.10.22 13:39:27.980668 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): This table /clickhouse/tables/01/fields_u64_local is already created, will add new replica 2024.10.22 13:39:27.996396 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Creating replica /clickhouse/tables/01/fields_u64_local/replicas/02 2024.10.22 13:39:28.001188 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 395.24 MiB, peak 411.72 MiB, free memory in arenas 21.29 MiB, will set to 393.61 MiB (RSS), difference: -1.62 MiB 2024.10.22 13:39:28.033444 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Creating shared ID for table oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282) 2024.10.22 13:39:28.036708 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Initializing table shared ID with f58d15d2-b41b-4822-8e1d-b1a332acd282 2024.10.22 13:39:28.039900 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Starting up table 2024.10.22 13:39:28.040250 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Became leader 2024.10.22 13:39:28.040263 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} oximeter.fields_u64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:28.040297 [ 221547 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:28.040313 [ 221547 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:28.047265 [ 221547 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Replica 01 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:28.047286 [ 221547 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Will mimic 01 2024.10.22 13:39:28.052566 [ 221547 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:28.052582 [ 221547 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:28.052797 [ 221547 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Parts in ZooKeeper after mimic: 2024.10.22 13:39:28.052806 [ 221547 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Enqueued fetches after mimic: 2024.10.22 13:39:28.056266 [ 221547 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:28.056373 [ 221547 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:28.056383 [ 221547 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/fields_u64_local/replicas/02/queue 2024.10.22 13:39:28.056461 [ 221547 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:28.056542 [ 221547 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:28.057228 [ 221547 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:28.057244 [ 221628 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Scheduling next merge selecting task after 6164ms 2024.10.22 13:39:28.057377 [ 221779 ] {e17a1ab8-c0ff-4811-8f22-2b6cb80320b9} DDLWorker: Executed query: /* ddl_entry=query-0000000082 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u64_local UUID 'f58d15d2-b41b-4822-8e1d-b1a332acd282' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_u64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:28.060856 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:28.112413 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:28.112423 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:28.112605 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=84, queue_size=84, entries=query-0000000000..query-0000000083, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000082, last_skipped_entry_name=none 2024.10.22 13:39:28.112619 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000083 2024.10.22 13:39:28.112627 [ 221779 ] {} DDLWorker: Checking task query-0000000083 2024.10.22 13:39:28.116167 [ 221779 ] {} DDLWorker: Processing task query-0000000083 (CREATE TABLE IF NOT EXISTS oximeter.fields_u64 UUID 'c4a928f7-5a06-4466-9f32-b638cd078723' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:28.119494 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_u64 UUID 'c4a928f7-5a06-4466-9f32-b638cd078723' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:28.119642 [ 221779 ] {2f663837-6473-4032-a61e-d444ed632630} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d072a591-34eb-4715-abdf-7f7dbf0e38f4) /* ddl_entry=query-0000000083 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u64 UUID 'c4a928f7-5a06-4466-9f32-b638cd078723' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:28.120153 [ 221779 ] {2f663837-6473-4032-a61e-d444ed632630} StorageDistributed (fields_u64): Auto-increment is 0 2024.10.22 13:39:28.124101 [ 221779 ] {2f663837-6473-4032-a61e-d444ed632630} DDLWorker: Executed query: /* ddl_entry=query-0000000083 */ CREATE TABLE IF NOT EXISTS oximeter.fields_u64 UUID 'c4a928f7-5a06-4466-9f32-b638cd078723' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UInt64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_u64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:28.127555 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:28.171463 [ 221622 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Scheduling next merge selecting task after 8004ms 2024.10.22 13:39:28.243402 [ 221525 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.250510 [ 221525 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.10.22 13:39:28.250530 [ 221525 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.256500 [ 221668 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 8186ms 2024.10.22 13:39:28.257392 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_0_0_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:28.257915 [ 221730 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_0_0_0&client_protocol_version=8&compress=false 2024.10.22 13:39:28.258034 [ 221730 ] {} HTTPSessionAdapter: Created HTTP(S) session with :::9009 (:::9009) 2024.10.22 13:39:28.263350 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:28.263373 [ 221730 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.41 GiB. 2024.10.22 13:39:28.263386 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:39:28.263399 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.10.22 13:39:28.264344 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.10.22 13:39:28.264365 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:28.264405 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_0_0_0 to zookeeper 2024.10.22 13:39:28.271078 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_0_0_0 committed to zookeeper 2024.10.22 13:39:28.271122 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_0_0_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:28.271168 [ 221667 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=88802697216, merge_with_ttl_allowedtrue) 2024.10.22 13:39:28.271194 [ 221667 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 9804ms 2024.10.22 13:39:28.288450 [ 221662 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:28.293533 [ 221662 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.10.22 13:39:28.293553 [ 221662 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.298937 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_1_1_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:28.299143 [ 221745 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_1_1_0&client_protocol_version=8&compress=false 2024.10.22 13:39:28.299600 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:28.299619 [ 221745 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.41 GiB. 2024.10.22 13:39:28.299632 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:39:28.299642 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_1_1_0 onto disk default. 2024.10.22 13:39:28.300472 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_1_1_0 onto disk default finished. 2024.10.22 13:39:28.301796 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:28.301849 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_1_1_0 to zookeeper 2024.10.22 13:39:28.314130 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_1_1_0 committed to zookeeper 2024.10.22 13:39:28.314196 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_1_1_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:28.314275 [ 221600 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=88802523136, merge_with_ttl_allowedtrue) 2024.10.22 13:39:28.314295 [ 221600 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 12428ms 2024.10.22 13:39:28.322109 [ 221582 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.326256 [ 221582 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.326274 [ 221582 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.326282 [ 221582 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.334365 [ 221735 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.339133 [ 221735 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.344606 [ 221735 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.350114 [ 221564 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Scheduling next merge selecting task after 7583ms 2024.10.22 13:39:28.370812 [ 221563 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.374379 [ 221563 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.374389 [ 221563 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.374394 [ 221563 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.377883 [ 221740 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.383339 [ 221740 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.389615 [ 221740 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.415102 [ 221599 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.419323 [ 221599 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.419347 [ 221599 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.419356 [ 221599 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.426438 [ 221733 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.429856 [ 221733 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.434673 [ 221733 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.457804 [ 221570 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.462023 [ 221570 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.462038 [ 221570 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.462044 [ 221570 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.470958 [ 221741 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.476089 [ 221741 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.479421 [ 221741 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.502870 [ 221550 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.513670 [ 221550 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.513692 [ 221550 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.513698 [ 221550 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.518998 [ 221735 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.524235 [ 221735 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.530241 [ 221735 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.553462 [ 221566 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.562087 [ 221566 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.562101 [ 221566 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.562108 [ 221566 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.569747 [ 221740 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.574098 [ 221740 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.581609 [ 221740 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.589512 [ 221538 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.593520 [ 221538 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.593537 [ 221538 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.593550 [ 221538 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.601941 [ 221733 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.606878 [ 221733 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.610619 [ 221733 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.636446 [ 221631 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.640218 [ 221631 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.640238 [ 221631 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.640249 [ 221631 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.644004 [ 221735 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.649581 [ 221735 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.653556 [ 221735 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.676263 [ 221586 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.682435 [ 221586 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.682451 [ 221586 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.682457 [ 221586 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.688652 [ 221740 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.693586 [ 221740 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.697702 [ 221740 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.713474 [ 221526 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.716402 [ 221526 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.716423 [ 221526 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.716430 [ 221526 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.723783 [ 221736 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.732009 [ 221736 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.736559 [ 221736 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.743795 [ 221627 ] {} DNSResolver: Updating DNS cache 2024.10.22 13:39:28.743887 [ 221627 ] {} DNSResolver: Updated DNS cache 2024.10.22 13:39:28.761122 [ 221567 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.765392 [ 221567 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.765404 [ 221567 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.765413 [ 221567 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.766800 [ 221763 ] {} SystemLog (system.part_log): Flushing system log, 2 entries to flush up to offset 2 2024.10.22 13:39:28.767024 [ 221763 ] {} SystemLog (system.part_log): Creating new table system.part_log for PartLog 2024.10.22 13:39:28.771579 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Loading data parts 2024.10.22 13:39:28.771742 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): There are no data parts 2024.10.22 13:39:28.773082 [ 221733 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.777798 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:28.777848 [ 221763 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.41 GiB. 2024.10.22 13:39:28.777825 [ 221733 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.778339 [ 221763 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 13:39:28.780070 [ 221771 ] {} SystemLog (system.trace_log): Flushing system log, 5 entries to flush up to offset 15 2024.10.22 13:39:28.782231 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:28.782497 [ 221763 ] {} SystemLog (system.part_log): Flushed system log up to offset 2 2024.10.22 13:39:28.782917 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:28.783927 [ 221771 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.41 GiB. 2024.10.22 13:39:28.784234 [ 221771 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 13:39:28.784461 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:28.784604 [ 221771 ] {} SystemLog (system.trace_log): Flushed system log up to offset 15 2024.10.22 13:39:28.785204 [ 221733 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.791985 [ 221770 ] {} SystemLog (system.query_log): Flushing system log, 88 entries to flush up to offset 168 2024.10.22 13:39:28.795843 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:28.795868 [ 221770 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.41 GiB. 2024.10.22 13:39:28.796814 [ 221770 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 13:39:28.798667 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:28.798928 [ 221770 ] {} SystemLog (system.query_log): Flushed system log up to offset 168 2024.10.22 13:39:28.808319 [ 221644 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.816506 [ 221765 ] {} SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 16 2024.10.22 13:39:28.817854 [ 221644 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.817876 [ 221644 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.817888 [ 221644 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.824839 [ 221740 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.830079 [ 221740 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.830319 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:28.830343 [ 221765 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.41 GiB. 2024.10.22 13:39:28.835789 [ 221765 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 13:39:28.838540 [ 221740 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.841088 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:28.843298 [ 221765 ] {} SystemLog (system.metric_log): Flushed system log up to offset 16 2024.10.22 13:39:28.849420 [ 221629 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.853885 [ 221629 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.853908 [ 221629 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.853916 [ 221629 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.859250 [ 221741 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.863348 [ 221741 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.867891 [ 221741 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.888517 [ 221583 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 9571ms 2024.10.22 13:39:28.897445 [ 221539 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.901688 [ 221539 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.901703 [ 221539 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.901709 [ 221539 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.908926 [ 221733 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.914101 [ 221733 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.919336 [ 221733 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.945185 [ 221655 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.952845 [ 221655 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.952859 [ 221655 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.952865 [ 221655 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.960317 [ 221735 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.965350 [ 221735 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:28.969371 [ 221735 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:28.977405 [ 221640 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Scheduling next merge selecting task after 7533ms 2024.10.22 13:39:28.983713 [ 221664 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:28.987495 [ 221664 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:28.987510 [ 221664 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:28.987517 [ 221664 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:28.992647 [ 221740 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:28.996123 [ 221740 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:29.001002 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 391.02 MiB, peak 411.72 MiB, free memory in arenas 33.31 MiB, will set to 401.17 MiB (RSS), difference: 10.14 MiB 2024.10.22 13:39:29.007369 [ 221740 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:29.028435 [ 221667 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000002 - log-0000000002 2024.10.22 13:39:29.031965 [ 221667 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_2_2_0] 2024.10.22 13:39:29.031988 [ 221667 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:29.039300 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_2_2_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:29.045538 [ 221731 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_2_2_0&client_protocol_version=8&compress=false 2024.10.22 13:39:29.047197 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:29.047224 [ 221731 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.40 GiB. 2024.10.22 13:39:29.047232 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:39:29.047240 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_2_2_0 onto disk default. 2024.10.22 13:39:29.047868 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_2_2_0 onto disk default finished. 2024.10.22 13:39:29.049218 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_2_2_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:29.049267 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_2_2_0 to zookeeper 2024.10.22 13:39:29.054078 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:29.054116 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:29.054358 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_2_2_0 committed to zookeeper 2024.10.22 13:39:29.054396 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_2_2_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:29.054429 [ 221658 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=88800604160, merge_with_ttl_allowedtrue) 2024.10.22 13:39:29.054460 [ 221658 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 16185ms 2024.10.22 13:39:29.057291 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=85, queue_size=85, entries=query-0000000000..query-0000000084, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000083, last_skipped_entry_name=none 2024.10.22 13:39:29.057307 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000084 2024.10.22 13:39:29.057313 [ 221779 ] {} DDLWorker: Checking task query-0000000084 2024.10.22 13:39:29.065139 [ 221779 ] {} DDLWorker: Processing task query-0000000084 (DROP TABLE IF EXISTS oximeter.measurements_histogrami8_local SYNC) 2024.10.22 13:39:29.067761 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogrami8_local SYNC 2024.10.22 13:39:29.067866 [ 221779 ] {f1f82dae-3f48-4980-a17c-f538903499b8} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 148ceed6-7f71-46e5-a173-5e6e5a8fbea4) /* ddl_entry=query-0000000084 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami8_local SYNC (stage: Complete) 2024.10.22 13:39:29.067901 [ 221779 ] {f1f82dae-3f48-4980-a17c-f538903499b8} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Stopped being leader 2024.10.22 13:39:29.067944 [ 221779 ] {f1f82dae-3f48-4980-a17c-f538903499b8} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2024.10.22 13:39:29.067952 [ 221779 ] {f1f82dae-3f48-4980-a17c-f538903499b8} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Will not wait for unique parts to be fetched by other replicas because shutdown called from DROP/DETACH query 2024.10.22 13:39:29.073027 [ 221779 ] {f1f82dae-3f48-4980-a17c-f538903499b8} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Waiting for threads to finish 2024.10.22 13:39:29.073198 [ 221779 ] {f1f82dae-3f48-4980-a17c-f538903499b8} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Threads finished 2024.10.22 13:39:29.073211 [ 221779 ] {f1f82dae-3f48-4980-a17c-f538903499b8} oximeter.measurements_histogrami8_local (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2024.10.22 13:39:29.073299 [ 221779 ] {f1f82dae-3f48-4980-a17c-f538903499b8} DatabaseCatalog: Waiting for table dcccea30-4ada-4786-8e01-ff13e790cedf to be finally dropped 2024.10.22 13:39:29.073314 [ 221663 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf) 2024.10.22 13:39:29.080806 [ 221663 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): dropAllData: waiting for locks. 2024.10.22 13:39:29.080819 [ 221663 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): dropAllData: removing data parts (count 0) from filesystem. 2024.10.22 13:39:29.080822 [ 221663 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): dropAllData: removing all data parts from memory. 2024.10.22 13:39:29.080825 [ 221663 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): dropAllData: clearing temporary directories 2024.10.22 13:39:29.080871 [ 221663 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): dropAllData: remove format_version.txt, detached, moving and write ahead logs 2024.10.22 13:39:29.080938 [ 221663 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): dropAllData: removing table directory recursive to cleanup garbage 2024.10.22 13:39:29.080961 [ 221663 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): dropAllData: done. 2024.10.22 13:39:29.089520 [ 221663 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Removing replica /clickhouse/tables/01/measurements_histogrami8_local/replicas/02, marking it as lost 2024.10.22 13:39:29.114715 [ 221663 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): /clickhouse/tables/01/measurements_histogrami8_local/replicas/02 is the last replica, will remove table 2024.10.22 13:39:29.120724 [ 221663 ] {} oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf): Table /clickhouse/tables/01/measurements_histogrami8_local/replicas/02 is already started to be removing by another replica right now 2024.10.22 13:39:29.120763 [ 221663 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogrami8_local.dcccea30-4ada-4786-8e01-ff13e790cedf.sql of dropped table oximeter.measurements_histogrami8_local (dcccea30-4ada-4786-8e01-ff13e790cedf) 2024.10.22 13:39:29.120892 [ 221779 ] {f1f82dae-3f48-4980-a17c-f538903499b8} DDLWorker: Executed query: /* ddl_entry=query-0000000084 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami8_local SYNC 2024.10.22 13:39:29.127192 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:29.177399 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:29.177433 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:29.177617 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=86, queue_size=86, entries=query-0000000000..query-0000000085, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000084, last_skipped_entry_name=none 2024.10.22 13:39:29.177630 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000085 2024.10.22 13:39:29.177634 [ 221779 ] {} DDLWorker: Checking task query-0000000085 2024.10.22 13:39:29.181142 [ 221779 ] {} DDLWorker: Processing task query-0000000085 (DROP TABLE IF EXISTS oximeter.measurements_histogrami8 SYNC) 2024.10.22 13:39:29.187150 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogrami8 SYNC 2024.10.22 13:39:29.187252 [ 221779 ] {6cdb1b49-e50d-450d-aa0e-193e3cba8dca} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f8d9b4cd-0a69-4547-add6-03f9dbc8a858) /* ddl_entry=query-0000000085 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami8 SYNC (stage: Complete) 2024.10.22 13:39:29.187282 [ 221779 ] {6cdb1b49-e50d-450d-aa0e-193e3cba8dca} StorageDistributed (measurements_histogrami8): Joining background threads for async INSERT 2024.10.22 13:39:29.187288 [ 221779 ] {6cdb1b49-e50d-450d-aa0e-193e3cba8dca} StorageDistributed (measurements_histogrami8): Background threads for async INSERT joined 2024.10.22 13:39:29.187387 [ 221779 ] {6cdb1b49-e50d-450d-aa0e-193e3cba8dca} DatabaseCatalog: Waiting for table 9c968dd6-b541-420e-8175-b5b01c4e40dd to be finally dropped 2024.10.22 13:39:29.187401 [ 221564 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogrami8 (9c968dd6-b541-420e-8175-b5b01c4e40dd) 2024.10.22 13:39:29.187429 [ 221564 ] {} StorageDistributed (measurements_histogrami8): Joining background threads for async INSERT 2024.10.22 13:39:29.187434 [ 221564 ] {} StorageDistributed (measurements_histogrami8): Background threads for async INSERT joined 2024.10.22 13:39:29.187440 [ 221564 ] {} StorageDistributed (measurements_histogrami8): Removing pending blocks for async INSERT from filesystem on DROP TABLE 2024.10.22 13:39:29.187500 [ 221564 ] {} StorageDistributed (measurements_histogrami8): Removed 2024.10.22 13:39:29.187518 [ 221564 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogrami8.9c968dd6-b541-420e-8175-b5b01c4e40dd.sql of dropped table oximeter.measurements_histogrami8 (9c968dd6-b541-420e-8175-b5b01c4e40dd) 2024.10.22 13:39:29.187710 [ 221779 ] {6cdb1b49-e50d-450d-aa0e-193e3cba8dca} DDLWorker: Executed query: /* ddl_entry=query-0000000085 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami8 SYNC 2024.10.22 13:39:29.195076 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:29.297790 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:29.297828 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:29.298004 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=87, queue_size=87, entries=query-0000000000..query-0000000086, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000085, last_skipped_entry_name=none 2024.10.22 13:39:29.298019 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000086 2024.10.22 13:39:29.298027 [ 221779 ] {} DDLWorker: Checking task query-0000000086 2024.10.22 13:39:29.301653 [ 221779 ] {} DDLWorker: Processing task query-0000000086 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8_local UUID 'a506ad34-e679-4759-877b-48efcb98a091' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:29.308857 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8_local UUID 'a506ad34-e679-4759-877b-48efcb98a091' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:29.309143 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b504e0b6-b20a-47e7-9755-6e1b39ecee00) /* ddl_entry=query-0000000086 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8_local UUID 'a506ad34-e679-4759-877b-48efcb98a091' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:29.315253 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Loading data parts 2024.10.22 13:39:29.315554 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): There are no data parts 2024.10.22 13:39:29.319069 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Creating table /clickhouse/tables/01/measurements_histogrami8_local 2024.10.22 13:39:29.329736 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): It looks like the table /clickhouse/tables/01/measurements_histogrami8_local was created by another server at the same moment, will retry 2024.10.22 13:39:29.329908 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): This table /clickhouse/tables/01/measurements_histogrami8_local is already created, will add new replica 2024.10.22 13:39:29.330954 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Creating replica /clickhouse/tables/01/measurements_histogrami8_local/replicas/02 2024.10.22 13:39:29.370696 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Creating shared ID for table oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091) 2024.10.22 13:39:29.374464 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Initializing table shared ID with a506ad34-e679-4759-877b-48efcb98a091 2024.10.22 13:39:29.378163 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Starting up table 2024.10.22 13:39:29.378608 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Became leader 2024.10.22 13:39:29.378623 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:29.378650 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:29.378665 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:29.386676 [ 221537 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:29.386693 [ 221537 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Will mimic 01 2024.10.22 13:39:29.394533 [ 221537 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Log pointer of source replica 01 changed while we loading queue nodes. Will retry. 2024.10.22 13:39:29.402749 [ 221537 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:29.402768 [ 221537 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:29.402928 [ 221537 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Parts in ZooKeeper after mimic: 2024.10.22 13:39:29.402942 [ 221537 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Enqueued fetches after mimic: 2024.10.22 13:39:29.408959 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:29.409156 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:29.409178 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogrami8_local/replicas/02/queue 2024.10.22 13:39:29.409377 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:29.409532 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:29.410459 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:29.410491 [ 221570 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 6001ms 2024.10.22 13:39:29.410772 [ 221779 ] {6c1544f0-5265-430c-aa93-05b0376e422f} DDLWorker: Executed query: /* ddl_entry=query-0000000086 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8_local UUID 'a506ad34-e679-4759-877b-48efcb98a091' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:29.415163 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:29.450676 [ 221614 ] {} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Scheduling next merge selecting task after 10433ms 2024.10.22 13:39:29.463011 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:29.463020 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:29.466669 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=88, queue_size=88, entries=query-0000000000..query-0000000087, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000086, last_skipped_entry_name=none 2024.10.22 13:39:29.466686 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000087 2024.10.22 13:39:29.466694 [ 221779 ] {} DDLWorker: Checking task query-0000000087 2024.10.22 13:39:29.467266 [ 221779 ] {} DDLWorker: Processing task query-0000000087 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8 UUID '1770e025-8cc8-42fe-a878-7987bf176b99' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami8_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:29.470787 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8 UUID '1770e025-8cc8-42fe-a878-7987bf176b99' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:29.471053 [ 221779 ] {464cfb2d-f739-4a75-b75e-8df6d74e923b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 844f75fe-9d5d-4f62-831e-7f613966253a) /* ddl_entry=query-0000000087 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8 UUID '1770e025-8cc8-42fe-a878-7987bf176b99' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami8_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:29.471669 [ 221779 ] {464cfb2d-f739-4a75-b75e-8df6d74e923b} StorageDistributed (measurements_histogrami8): Auto-increment is 0 2024.10.22 13:39:29.476530 [ 221779 ] {464cfb2d-f739-4a75-b75e-8df6d74e923b} DDLWorker: Executed query: /* ddl_entry=query-0000000087 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8 UUID '1770e025-8cc8-42fe-a878-7987bf176b99' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int8), `counts` Array(UInt64), `min` Int8, `max` Int8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:29.480291 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:29.556984 [ 221579 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Scheduling next merge selecting task after 8048ms 2024.10.22 13:39:29.577646 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:29.577653 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:29.581310 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=89, queue_size=89, entries=query-0000000000..query-0000000088, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000087, last_skipped_entry_name=none 2024.10.22 13:39:29.581339 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000088 2024.10.22 13:39:29.581345 [ 221779 ] {} DDLWorker: Checking task query-0000000088 2024.10.22 13:39:29.581702 [ 221779 ] {} DDLWorker: Processing task query-0000000088 (DROP TABLE IF EXISTS oximeter.measurements_histogramu8_local SYNC) 2024.10.22 13:39:29.590056 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramu8_local SYNC 2024.10.22 13:39:29.590159 [ 221779 ] {644a8a2b-59a8-4b16-a9ec-91b9e44f22b2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c0bbd543-8d70-475c-8250-427385e0a846) /* ddl_entry=query-0000000088 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu8_local SYNC (stage: Complete) 2024.10.22 13:39:29.590202 [ 221779 ] {644a8a2b-59a8-4b16-a9ec-91b9e44f22b2} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Stopped being leader 2024.10.22 13:39:29.590220 [ 221779 ] {644a8a2b-59a8-4b16-a9ec-91b9e44f22b2} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2024.10.22 13:39:29.590226 [ 221779 ] {644a8a2b-59a8-4b16-a9ec-91b9e44f22b2} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Will not wait for unique parts to be fetched by other replicas because shutdown called from DROP/DETACH query 2024.10.22 13:39:29.596438 [ 221779 ] {644a8a2b-59a8-4b16-a9ec-91b9e44f22b2} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Waiting for threads to finish 2024.10.22 13:39:29.596591 [ 221779 ] {644a8a2b-59a8-4b16-a9ec-91b9e44f22b2} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Threads finished 2024.10.22 13:39:29.596599 [ 221779 ] {644a8a2b-59a8-4b16-a9ec-91b9e44f22b2} oximeter.measurements_histogramu8_local (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2024.10.22 13:39:29.596684 [ 221779 ] {644a8a2b-59a8-4b16-a9ec-91b9e44f22b2} DatabaseCatalog: Waiting for table 4ec4e33c-f981-4047-a4ba-92302987c590 to be finally dropped 2024.10.22 13:39:29.596697 [ 221634 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590) 2024.10.22 13:39:29.604698 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): dropAllData: waiting for locks. 2024.10.22 13:39:29.604714 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): dropAllData: removing data parts (count 0) from filesystem. 2024.10.22 13:39:29.604721 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): dropAllData: removing all data parts from memory. 2024.10.22 13:39:29.604727 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): dropAllData: clearing temporary directories 2024.10.22 13:39:29.604804 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): dropAllData: remove format_version.txt, detached, moving and write ahead logs 2024.10.22 13:39:29.604913 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): dropAllData: removing table directory recursive to cleanup garbage 2024.10.22 13:39:29.604957 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): dropAllData: done. 2024.10.22 13:39:29.613064 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Removing replica /clickhouse/tables/01/measurements_histogramu8_local/replicas/02, marking it as lost 2024.10.22 13:39:29.641519 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): /clickhouse/tables/01/measurements_histogramu8_local/replicas/02 is the last replica, will remove table 2024.10.22 13:39:29.646684 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Removing table /clickhouse/tables/01/measurements_histogramu8_local (this might take several minutes) 2024.10.22 13:39:29.688707 [ 221634 ] {} oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590): Table /clickhouse/tables/01/measurements_histogramu8_local was successfully removed from ZooKeeper 2024.10.22 13:39:29.688749 [ 221634 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramu8_local.4ec4e33c-f981-4047-a4ba-92302987c590.sql of dropped table oximeter.measurements_histogramu8_local (4ec4e33c-f981-4047-a4ba-92302987c590) 2024.10.22 13:39:29.688895 [ 221779 ] {644a8a2b-59a8-4b16-a9ec-91b9e44f22b2} DDLWorker: Executed query: /* ddl_entry=query-0000000088 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu8_local SYNC 2024.10.22 13:39:29.691782 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:29.749552 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:29.749560 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:29.753295 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=90, queue_size=90, entries=query-0000000000..query-0000000089, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000088, last_skipped_entry_name=none 2024.10.22 13:39:29.753319 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000089 2024.10.22 13:39:29.753341 [ 221779 ] {} DDLWorker: Checking task query-0000000089 2024.10.22 13:39:29.757187 [ 221779 ] {} DDLWorker: Processing task query-0000000089 (DROP TABLE IF EXISTS oximeter.measurements_histogramu8 SYNC) 2024.10.22 13:39:29.762981 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramu8 SYNC 2024.10.22 13:39:29.763090 [ 221779 ] {d661a489-46d3-4953-882e-924091f85197} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 67a39e71-a1a9-47e6-8ae0-08fa928ab2b0) /* ddl_entry=query-0000000089 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu8 SYNC (stage: Complete) 2024.10.22 13:39:29.763128 [ 221779 ] {d661a489-46d3-4953-882e-924091f85197} StorageDistributed (measurements_histogramu8): Joining background threads for async INSERT 2024.10.22 13:39:29.763137 [ 221779 ] {d661a489-46d3-4953-882e-924091f85197} StorageDistributed (measurements_histogramu8): Background threads for async INSERT joined 2024.10.22 13:39:29.763238 [ 221779 ] {d661a489-46d3-4953-882e-924091f85197} DatabaseCatalog: Waiting for table b1775ffb-99a6-4f2d-8a7e-a39225988529 to be finally dropped 2024.10.22 13:39:29.763246 [ 221642 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramu8 (b1775ffb-99a6-4f2d-8a7e-a39225988529) 2024.10.22 13:39:29.763262 [ 221642 ] {} StorageDistributed (measurements_histogramu8): Joining background threads for async INSERT 2024.10.22 13:39:29.763266 [ 221642 ] {} StorageDistributed (measurements_histogramu8): Background threads for async INSERT joined 2024.10.22 13:39:29.763270 [ 221642 ] {} StorageDistributed (measurements_histogramu8): Removing pending blocks for async INSERT from filesystem on DROP TABLE 2024.10.22 13:39:29.763333 [ 221642 ] {} StorageDistributed (measurements_histogramu8): Removed 2024.10.22 13:39:29.763348 [ 221642 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramu8.b1775ffb-99a6-4f2d-8a7e-a39225988529.sql of dropped table oximeter.measurements_histogramu8 (b1775ffb-99a6-4f2d-8a7e-a39225988529) 2024.10.22 13:39:29.763451 [ 221779 ] {d661a489-46d3-4953-882e-924091f85197} DDLWorker: Executed query: /* ddl_entry=query-0000000089 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu8 SYNC 2024.10.22 13:39:29.772642 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:29.864914 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:29.864921 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:29.868878 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=91, queue_size=91, entries=query-0000000000..query-0000000090, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000089, last_skipped_entry_name=none 2024.10.22 13:39:29.868896 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000090 2024.10.22 13:39:29.868900 [ 221779 ] {} DDLWorker: Checking task query-0000000090 2024.10.22 13:39:29.869565 [ 221779 ] {} DDLWorker: Processing task query-0000000090 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8_local UUID '4f18429a-a87d-4f5f-adac-b911ac3b7970' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:29.876172 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8_local UUID '4f18429a-a87d-4f5f-adac-b911ac3b7970' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:29.876371 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4ec8d0c6-9f81-45c9-be7a-946f75f1e37d) /* ddl_entry=query-0000000090 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8_local UUID '4f18429a-a87d-4f5f-adac-b911ac3b7970' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:29.880299 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Loading data parts 2024.10.22 13:39:29.880465 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): There are no data parts 2024.10.22 13:39:29.886072 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Creating table /clickhouse/tables/01/measurements_histogramu8_local 2024.10.22 13:39:29.895234 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): It looks like the table /clickhouse/tables/01/measurements_histogramu8_local was created by another server at the same moment, will retry 2024.10.22 13:39:29.895382 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): This table /clickhouse/tables/01/measurements_histogramu8_local is already created, will add new replica 2024.10.22 13:39:29.896392 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Creating replica /clickhouse/tables/01/measurements_histogramu8_local/replicas/02 2024.10.22 13:39:29.928517 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Creating shared ID for table oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970) 2024.10.22 13:39:29.932162 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Initializing table shared ID with 4f18429a-a87d-4f5f-adac-b911ac3b7970 2024.10.22 13:39:29.937855 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Starting up table 2024.10.22 13:39:29.941352 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Became leader 2024.10.22 13:39:29.941369 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:29.941394 [ 221573 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:29.941409 [ 221573 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:29.944202 [ 221620 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Scheduling next merge selecting task after 8200ms 2024.10.22 13:39:29.946607 [ 221573 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Replica 01 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:29.947564 [ 221573 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Will mimic 01 2024.10.22 13:39:29.954899 [ 221573 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:29.954912 [ 221573 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:29.954996 [ 221573 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Parts in ZooKeeper after mimic: 2024.10.22 13:39:29.955001 [ 221573 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Enqueued fetches after mimic: 2024.10.22 13:39:29.958261 [ 221573 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:29.958443 [ 221573 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:29.958453 [ 221573 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramu8_local/replicas/02/queue 2024.10.22 13:39:29.958534 [ 221573 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:29.958619 [ 221573 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:29.959210 [ 221573 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:29.959226 [ 221638 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 6202ms 2024.10.22 13:39:29.959379 [ 221779 ] {8546006c-3050-4830-afd8-d70101cc8e07} DDLWorker: Executed query: /* ddl_entry=query-0000000090 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8_local UUID '4f18429a-a87d-4f5f-adac-b911ac3b7970' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu8_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:29.962958 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:29.979499 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:29.979505 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:29.983016 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=92, queue_size=92, entries=query-0000000000..query-0000000091, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000090, last_skipped_entry_name=none 2024.10.22 13:39:29.983030 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000091 2024.10.22 13:39:29.983035 [ 221779 ] {} DDLWorker: Checking task query-0000000091 2024.10.22 13:39:29.983594 [ 221779 ] {} DDLWorker: Processing task query-0000000091 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8 UUID 'f85f1373-8f69-4571-b913-443476bbf400' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu8_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:29.989895 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8 UUID 'f85f1373-8f69-4571-b913-443476bbf400' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:29.990061 [ 221779 ] {48c05b7d-888a-458a-a1be-d793732ee8dc} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 2f45e7db-088f-47f9-a63c-ac08fe83b6ad) /* ddl_entry=query-0000000091 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8 UUID 'f85f1373-8f69-4571-b913-443476bbf400' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu8_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:29.992115 [ 221779 ] {48c05b7d-888a-458a-a1be-d793732ee8dc} StorageDistributed (measurements_histogramu8): Auto-increment is 0 2024.10.22 13:39:29.996426 [ 221779 ] {48c05b7d-888a-458a-a1be-d793732ee8dc} DDLWorker: Executed query: /* ddl_entry=query-0000000091 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8 UUID 'f85f1373-8f69-4571-b913-443476bbf400' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt8), `counts` Array(UInt64), `min` UInt8, `max` UInt8, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu8_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:30.001026 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 401.53 MiB, peak 411.72 MiB, free memory in arenas 32.25 MiB, will set to 402.54 MiB (RSS), difference: 1.01 MiB 2024.10.22 13:39:30.003067 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:30.093008 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:30.093056 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:30.093222 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=93, queue_size=93, entries=query-0000000000..query-0000000092, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000091, last_skipped_entry_name=none 2024.10.22 13:39:30.093235 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000092 2024.10.22 13:39:30.093239 [ 221779 ] {} DDLWorker: Checking task query-0000000092 2024.10.22 13:39:30.097781 [ 221779 ] {} DDLWorker: Processing task query-0000000092 (DROP TABLE IF EXISTS oximeter.measurements_histogrami16_local SYNC) 2024.10.22 13:39:30.101959 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogrami16_local SYNC 2024.10.22 13:39:30.102065 [ 221779 ] {bfd13ea8-6993-453f-9571-d85b9b45d6be} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ffc9155d-b581-4f00-9e5c-ca728dfbf44a) /* ddl_entry=query-0000000092 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami16_local SYNC (stage: Complete) 2024.10.22 13:39:30.102095 [ 221779 ] {bfd13ea8-6993-453f-9571-d85b9b45d6be} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Stopped being leader 2024.10.22 13:39:30.102115 [ 221779 ] {bfd13ea8-6993-453f-9571-d85b9b45d6be} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2024.10.22 13:39:30.102122 [ 221779 ] {bfd13ea8-6993-453f-9571-d85b9b45d6be} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Will not wait for unique parts to be fetched by other replicas because shutdown called from DROP/DETACH query 2024.10.22 13:39:30.108859 [ 221779 ] {bfd13ea8-6993-453f-9571-d85b9b45d6be} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Waiting for threads to finish 2024.10.22 13:39:30.109015 [ 221779 ] {bfd13ea8-6993-453f-9571-d85b9b45d6be} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Threads finished 2024.10.22 13:39:30.109025 [ 221779 ] {bfd13ea8-6993-453f-9571-d85b9b45d6be} oximeter.measurements_histogrami16_local (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2024.10.22 13:39:30.109133 [ 221779 ] {bfd13ea8-6993-453f-9571-d85b9b45d6be} DatabaseCatalog: Waiting for table 0b67f089-6eed-4a0d-a1f2-dc618681b658 to be finally dropped 2024.10.22 13:39:30.109150 [ 221583 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658) 2024.10.22 13:39:30.115724 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): dropAllData: waiting for locks. 2024.10.22 13:39:30.115736 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): dropAllData: removing data parts (count 0) from filesystem. 2024.10.22 13:39:30.115742 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): dropAllData: removing all data parts from memory. 2024.10.22 13:39:30.115748 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): dropAllData: clearing temporary directories 2024.10.22 13:39:30.115813 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): dropAllData: remove format_version.txt, detached, moving and write ahead logs 2024.10.22 13:39:30.115918 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): dropAllData: removing table directory recursive to cleanup garbage 2024.10.22 13:39:30.115961 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): dropAllData: done. 2024.10.22 13:39:30.121960 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Removing replica /clickhouse/tables/01/measurements_histogrami16_local/replicas/02, marking it as lost 2024.10.22 13:39:30.148740 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): /clickhouse/tables/01/measurements_histogrami16_local/replicas/02 is the last replica, will remove table 2024.10.22 13:39:30.152119 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Removing table /clickhouse/tables/01/measurements_histogrami16_local (this might take several minutes) 2024.10.22 13:39:30.196667 [ 221583 ] {} oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658): Table /clickhouse/tables/01/measurements_histogrami16_local was successfully removed from ZooKeeper 2024.10.22 13:39:30.196711 [ 221583 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogrami16_local.0b67f089-6eed-4a0d-a1f2-dc618681b658.sql of dropped table oximeter.measurements_histogrami16_local (0b67f089-6eed-4a0d-a1f2-dc618681b658) 2024.10.22 13:39:30.196850 [ 221779 ] {bfd13ea8-6993-453f-9571-d85b9b45d6be} DDLWorker: Executed query: /* ddl_entry=query-0000000092 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami16_local SYNC 2024.10.22 13:39:30.200395 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:30.211634 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:30.211667 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:30.211829 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=94, queue_size=94, entries=query-0000000000..query-0000000093, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000092, last_skipped_entry_name=none 2024.10.22 13:39:30.211844 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000093 2024.10.22 13:39:30.211852 [ 221779 ] {} DDLWorker: Checking task query-0000000093 2024.10.22 13:39:30.216547 [ 221779 ] {} DDLWorker: Processing task query-0000000093 (DROP TABLE IF EXISTS oximeter.measurements_histogrami16 SYNC) 2024.10.22 13:39:30.223755 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogrami16 SYNC 2024.10.22 13:39:30.223853 [ 221779 ] {2f5fb5ba-eda4-4315-87df-41c105c5af39} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: a38768c4-0ffa-492a-82ba-fde8272278d2) /* ddl_entry=query-0000000093 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami16 SYNC (stage: Complete) 2024.10.22 13:39:30.223882 [ 221779 ] {2f5fb5ba-eda4-4315-87df-41c105c5af39} StorageDistributed (measurements_histogrami16): Joining background threads for async INSERT 2024.10.22 13:39:30.223887 [ 221779 ] {2f5fb5ba-eda4-4315-87df-41c105c5af39} StorageDistributed (measurements_histogrami16): Background threads for async INSERT joined 2024.10.22 13:39:30.223961 [ 221779 ] {2f5fb5ba-eda4-4315-87df-41c105c5af39} DatabaseCatalog: Waiting for table 994a9e25-5e5d-4320-ad1e-c319628305c2 to be finally dropped 2024.10.22 13:39:30.223970 [ 221664 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogrami16 (994a9e25-5e5d-4320-ad1e-c319628305c2) 2024.10.22 13:39:30.223986 [ 221664 ] {} StorageDistributed (measurements_histogrami16): Joining background threads for async INSERT 2024.10.22 13:39:30.223990 [ 221664 ] {} StorageDistributed (measurements_histogrami16): Background threads for async INSERT joined 2024.10.22 13:39:30.223994 [ 221664 ] {} StorageDistributed (measurements_histogrami16): Removing pending blocks for async INSERT from filesystem on DROP TABLE 2024.10.22 13:39:30.224052 [ 221664 ] {} StorageDistributed (measurements_histogrami16): Removed 2024.10.22 13:39:30.224066 [ 221664 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogrami16.994a9e25-5e5d-4320-ad1e-c319628305c2.sql of dropped table oximeter.measurements_histogrami16 (994a9e25-5e5d-4320-ad1e-c319628305c2) 2024.10.22 13:39:30.224156 [ 221779 ] {2f5fb5ba-eda4-4315-87df-41c105c5af39} DDLWorker: Executed query: /* ddl_entry=query-0000000093 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami16 SYNC 2024.10.22 13:39:30.230631 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:30.285561 [ 221525 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Scheduling next merge selecting task after 10535ms 2024.10.22 13:39:30.309236 [ 221532 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 10477ms 2024.10.22 13:39:30.336525 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:30.336530 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:30.340592 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=95, queue_size=95, entries=query-0000000000..query-0000000094, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000093, last_skipped_entry_name=none 2024.10.22 13:39:30.340608 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000094 2024.10.22 13:39:30.340614 [ 221779 ] {} DDLWorker: Checking task query-0000000094 2024.10.22 13:39:30.344405 [ 221779 ] {} DDLWorker: Processing task query-0000000094 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16_local UUID 'dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:30.350667 [ 221667 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 9429ms 2024.10.22 13:39:30.354488 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16_local UUID 'dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:30.354737 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1c559095-7318-43da-9c70-447d7657fd8f) /* ddl_entry=query-0000000094 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16_local UUID 'dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:30.359201 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Loading data parts 2024.10.22 13:39:30.359415 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): There are no data parts 2024.10.22 13:39:30.363910 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): This table /clickhouse/tables/01/measurements_histogrami16_local is already created, will add new replica 2024.10.22 13:39:30.364738 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Creating replica /clickhouse/tables/01/measurements_histogrami16_local/replicas/02 2024.10.22 13:39:30.391557 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Creating shared ID for table oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77) 2024.10.22 13:39:30.391661 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Shared ID for table oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami16_local/table_shared_id 2024.10.22 13:39:30.391670 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Got candidate ID dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami16_local/table_shared_id 2024.10.22 13:39:30.397405 [ 221527 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 9888ms 2024.10.22 13:39:30.400204 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Shared ID on path /clickhouse/tables/01/measurements_histogrami16_local/table_shared_id concurrently created, will set ID dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77 2024.10.22 13:39:30.400214 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Initializing table shared ID with dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77 2024.10.22 13:39:30.403327 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Starting up table 2024.10.22 13:39:30.406658 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Became leader 2024.10.22 13:39:30.406674 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:30.406704 [ 221593 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:30.406723 [ 221593 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:30.411030 [ 221593 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:30.411049 [ 221593 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Will mimic 01 2024.10.22 13:39:30.415681 [ 221540 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Scheduling next merge selecting task after 8559ms 2024.10.22 13:39:30.418114 [ 221593 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:30.418125 [ 221593 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:30.418304 [ 221593 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Parts in ZooKeeper after mimic: 2024.10.22 13:39:30.418316 [ 221593 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Enqueued fetches after mimic: 2024.10.22 13:39:30.423293 [ 221593 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:30.427464 [ 221593 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:30.427479 [ 221593 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogrami16_local/replicas/02/queue 2024.10.22 13:39:30.427604 [ 221593 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:30.427684 [ 221593 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:30.431909 [ 221593 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:30.431916 [ 221582 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 6330ms 2024.10.22 13:39:30.432107 [ 221779 ] {9b9a8ae9-ca9e-450e-91a8-c7e60185c553} DDLWorker: Executed query: /* ddl_entry=query-0000000094 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16_local UUID 'dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:30.436091 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:30.460353 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:30.460360 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:30.464276 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=96, queue_size=96, entries=query-0000000000..query-0000000095, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000094, last_skipped_entry_name=none 2024.10.22 13:39:30.464296 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000095 2024.10.22 13:39:30.464303 [ 221779 ] {} DDLWorker: Checking task query-0000000095 2024.10.22 13:39:30.464844 [ 221779 ] {} DDLWorker: Processing task query-0000000095 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16 UUID '24032848-7c1d-42cf-970d-e91a29c901a3' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami16_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:30.474557 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16 UUID '24032848-7c1d-42cf-970d-e91a29c901a3' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:30.474734 [ 221779 ] {27efb720-1c56-4802-98aa-7e56819c5d26} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4230a45b-97c8-4e56-ad99-c9bd89b341f4) /* ddl_entry=query-0000000095 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16 UUID '24032848-7c1d-42cf-970d-e91a29c901a3' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami16_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:30.475239 [ 221779 ] {27efb720-1c56-4802-98aa-7e56819c5d26} StorageDistributed (measurements_histogrami16): Auto-increment is 0 2024.10.22 13:39:30.479033 [ 221779 ] {27efb720-1c56-4802-98aa-7e56819c5d26} DDLWorker: Executed query: /* ddl_entry=query-0000000095 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16 UUID '24032848-7c1d-42cf-970d-e91a29c901a3' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int16), `counts` Array(UInt64), `min` Int16, `max` Int16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:30.482434 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:30.573972 [ 221653 ] {} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Scheduling next merge selecting task after 7813ms 2024.10.22 13:39:30.575659 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:30.575667 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:30.584990 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=97, queue_size=97, entries=query-0000000000..query-0000000096, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000095, last_skipped_entry_name=none 2024.10.22 13:39:30.585011 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000096 2024.10.22 13:39:30.585017 [ 221779 ] {} DDLWorker: Checking task query-0000000096 2024.10.22 13:39:30.585586 [ 221779 ] {} DDLWorker: Processing task query-0000000096 (DROP TABLE IF EXISTS oximeter.measurements_histogramu16_local SYNC) 2024.10.22 13:39:30.593318 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramu16_local SYNC 2024.10.22 13:39:30.593441 [ 221779 ] {826d52a9-2e67-4027-9a16-64cc70bb805d} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 9e458bc4-73a9-47bd-b027-ff0b7e7cfb8e) /* ddl_entry=query-0000000096 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu16_local SYNC (stage: Complete) 2024.10.22 13:39:30.593471 [ 221779 ] {826d52a9-2e67-4027-9a16-64cc70bb805d} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Stopped being leader 2024.10.22 13:39:30.593491 [ 221779 ] {826d52a9-2e67-4027-9a16-64cc70bb805d} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2024.10.22 13:39:30.593497 [ 221779 ] {826d52a9-2e67-4027-9a16-64cc70bb805d} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Will not wait for unique parts to be fetched by other replicas because shutdown called from DROP/DETACH query 2024.10.22 13:39:30.602816 [ 221779 ] {826d52a9-2e67-4027-9a16-64cc70bb805d} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Waiting for threads to finish 2024.10.22 13:39:30.603032 [ 221779 ] {826d52a9-2e67-4027-9a16-64cc70bb805d} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Threads finished 2024.10.22 13:39:30.603841 [ 221779 ] {826d52a9-2e67-4027-9a16-64cc70bb805d} oximeter.measurements_histogramu16_local (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2024.10.22 13:39:30.603979 [ 221779 ] {826d52a9-2e67-4027-9a16-64cc70bb805d} DatabaseCatalog: Waiting for table 36824766-35d2-4400-9514-e29502fbde09 to be finally dropped 2024.10.22 13:39:30.603992 [ 221545 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09) 2024.10.22 13:39:30.615350 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): dropAllData: waiting for locks. 2024.10.22 13:39:30.615374 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): dropAllData: removing data parts (count 0) from filesystem. 2024.10.22 13:39:30.615379 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): dropAllData: removing all data parts from memory. 2024.10.22 13:39:30.615386 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): dropAllData: clearing temporary directories 2024.10.22 13:39:30.615468 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): dropAllData: remove format_version.txt, detached, moving and write ahead logs 2024.10.22 13:39:30.615562 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): dropAllData: removing table directory recursive to cleanup garbage 2024.10.22 13:39:30.615597 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): dropAllData: done. 2024.10.22 13:39:30.626704 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Removing replica /clickhouse/tables/01/measurements_histogramu16_local/replicas/02, marking it as lost 2024.10.22 13:39:30.656800 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): /clickhouse/tables/01/measurements_histogramu16_local/replicas/02 is the last replica, will remove table 2024.10.22 13:39:30.660318 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Removing table /clickhouse/tables/01/measurements_histogramu16_local (this might take several minutes) 2024.10.22 13:39:30.714950 [ 221545 ] {} oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09): Table /clickhouse/tables/01/measurements_histogramu16_local was successfully removed from ZooKeeper 2024.10.22 13:39:30.715015 [ 221545 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramu16_local.36824766-35d2-4400-9514-e29502fbde09.sql of dropped table oximeter.measurements_histogramu16_local (36824766-35d2-4400-9514-e29502fbde09) 2024.10.22 13:39:30.715469 [ 221779 ] {826d52a9-2e67-4027-9a16-64cc70bb805d} DDLWorker: Executed query: /* ddl_entry=query-0000000096 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu16_local SYNC 2024.10.22 13:39:30.719396 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:30.760410 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:30.760415 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:30.760657 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=98, queue_size=98, entries=query-0000000000..query-0000000097, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000096, last_skipped_entry_name=none 2024.10.22 13:39:30.760671 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000097 2024.10.22 13:39:30.760677 [ 221779 ] {} DDLWorker: Checking task query-0000000097 2024.10.22 13:39:30.764585 [ 221779 ] {} DDLWorker: Processing task query-0000000097 (DROP TABLE IF EXISTS oximeter.measurements_histogramu16 SYNC) 2024.10.22 13:39:30.768217 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramu16 SYNC 2024.10.22 13:39:30.768343 [ 221779 ] {0a944fdb-7413-4505-9436-d9e11fda44d7} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 9435c863-69dd-4942-a8bb-4efa671022cc) /* ddl_entry=query-0000000097 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu16 SYNC (stage: Complete) 2024.10.22 13:39:30.768376 [ 221779 ] {0a944fdb-7413-4505-9436-d9e11fda44d7} StorageDistributed (measurements_histogramu16): Joining background threads for async INSERT 2024.10.22 13:39:30.768382 [ 221779 ] {0a944fdb-7413-4505-9436-d9e11fda44d7} StorageDistributed (measurements_histogramu16): Background threads for async INSERT joined 2024.10.22 13:39:30.768483 [ 221779 ] {0a944fdb-7413-4505-9436-d9e11fda44d7} DatabaseCatalog: Waiting for table ba91fa5d-7f1d-4d5a-98cc-b3e8a98760dc to be finally dropped 2024.10.22 13:39:30.768496 [ 221614 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramu16 (ba91fa5d-7f1d-4d5a-98cc-b3e8a98760dc) 2024.10.22 13:39:30.768518 [ 221614 ] {} StorageDistributed (measurements_histogramu16): Joining background threads for async INSERT 2024.10.22 13:39:30.768522 [ 221614 ] {} StorageDistributed (measurements_histogramu16): Background threads for async INSERT joined 2024.10.22 13:39:30.768526 [ 221614 ] {} StorageDistributed (measurements_histogramu16): Removing pending blocks for async INSERT from filesystem on DROP TABLE 2024.10.22 13:39:30.768587 [ 221614 ] {} StorageDistributed (measurements_histogramu16): Removed 2024.10.22 13:39:30.768602 [ 221614 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramu16.ba91fa5d-7f1d-4d5a-98cc-b3e8a98760dc.sql of dropped table oximeter.measurements_histogramu16 (ba91fa5d-7f1d-4d5a-98cc-b3e8a98760dc) 2024.10.22 13:39:30.768703 [ 221779 ] {0a944fdb-7413-4505-9436-d9e11fda44d7} DDLWorker: Executed query: /* ddl_entry=query-0000000097 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu16 SYNC 2024.10.22 13:39:30.775558 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:30.888951 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:30.888960 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:30.889909 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=99, queue_size=99, entries=query-0000000000..query-0000000098, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000097, last_skipped_entry_name=none 2024.10.22 13:39:30.889922 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000098 2024.10.22 13:39:30.889928 [ 221779 ] {} DDLWorker: Checking task query-0000000098 2024.10.22 13:39:30.890148 [ 221576 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 9680ms 2024.10.22 13:39:30.894220 [ 221779 ] {} DDLWorker: Processing task query-0000000098 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16_local UUID 'bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:30.897993 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16_local UUID 'bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:30.898242 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b3bbcf36-e0a9-4eeb-a47d-1f546a702299) /* ddl_entry=query-0000000098 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16_local UUID 'bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:30.902037 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Loading data parts 2024.10.22 13:39:30.902355 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): There are no data parts 2024.10.22 13:39:30.910371 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): This table /clickhouse/tables/01/measurements_histogramu16_local is already created, will add new replica 2024.10.22 13:39:30.914926 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Creating replica /clickhouse/tables/01/measurements_histogramu16_local/replicas/02 2024.10.22 13:39:30.982050 [ 221634 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Scheduling next merge selecting task after 7859ms 2024.10.22 13:39:30.988031 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Creating shared ID for table oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35) 2024.10.22 13:39:30.988211 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Initializing table shared ID with bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35 2024.10.22 13:39:30.991550 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Starting up table 2024.10.22 13:39:30.991984 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Became leader 2024.10.22 13:39:30.991997 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:30.992042 [ 221632 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:30.992062 [ 221632 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:30.999820 [ 221632 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Replica 01 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:30.999846 [ 221632 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Will mimic 01 2024.10.22 13:39:31.007830 [ 221632 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:31.007852 [ 221632 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:31.007965 [ 221632 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Parts in ZooKeeper after mimic: 2024.10.22 13:39:31.007974 [ 221632 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Enqueued fetches after mimic: 2024.10.22 13:39:31.013512 [ 221632 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:31.013647 [ 221632 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:31.013658 [ 221632 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramu16_local/replicas/02/queue 2024.10.22 13:39:31.013754 [ 221632 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:31.013865 [ 221632 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:31.014631 [ 221632 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:31.014651 [ 221642 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 6468ms 2024.10.22 13:39:31.014857 [ 221779 ] {35687286-2c58-4ba7-aef4-c53f538c1aeb} DDLWorker: Executed query: /* ddl_entry=query-0000000098 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16_local UUID 'bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu16_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:31.018490 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:31.154072 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:31.154076 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:31.158350 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=100, queue_size=100, entries=query-0000000000..query-0000000099, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000098, last_skipped_entry_name=none 2024.10.22 13:39:31.158363 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000099 2024.10.22 13:39:31.158367 [ 221779 ] {} DDLWorker: Checking task query-0000000099 2024.10.22 13:39:31.158916 [ 221779 ] {} DDLWorker: Processing task query-0000000099 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16 UUID '17663e30-f5d6-41be-975e-c1fe34aaad4f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu16_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:31.167404 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16 UUID '17663e30-f5d6-41be-975e-c1fe34aaad4f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:31.167659 [ 221779 ] {db7de0db-d1b2-4a5e-8ca5-7e4bfa3d531c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b13aa939-dbe7-49df-bb08-9bdb09bb7dbc) /* ddl_entry=query-0000000099 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16 UUID '17663e30-f5d6-41be-975e-c1fe34aaad4f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu16_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:31.169776 [ 221779 ] {db7de0db-d1b2-4a5e-8ca5-7e4bfa3d531c} StorageDistributed (measurements_histogramu16): Auto-increment is 0 2024.10.22 13:39:31.175041 [ 221779 ] {db7de0db-d1b2-4a5e-8ca5-7e4bfa3d531c} DDLWorker: Executed query: /* ddl_entry=query-0000000099 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16 UUID '17663e30-f5d6-41be-975e-c1fe34aaad4f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt16), `counts` Array(UInt64), `min` UInt16, `max` UInt16, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu16_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:31.186640 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:31.187639 [ 221626 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Scheduling next merge selecting task after 7960ms 2024.10.22 13:39:31.270709 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:31.270751 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:31.270911 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=101, queue_size=101, entries=query-0000000000..query-0000000100, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000099, last_skipped_entry_name=none 2024.10.22 13:39:31.270924 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000100 2024.10.22 13:39:31.270929 [ 221779 ] {} DDLWorker: Checking task query-0000000100 2024.10.22 13:39:31.274701 [ 221779 ] {} DDLWorker: Processing task query-0000000100 (DROP TABLE IF EXISTS oximeter.measurements_histogrami32_local SYNC) 2024.10.22 13:39:31.278603 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogrami32_local SYNC 2024.10.22 13:39:31.278730 [ 221779 ] {8e37b54b-8e13-4af0-85e3-fd5ee2ab2840} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 35361683-408a-4695-bf48-ad6b9be93c7e) /* ddl_entry=query-0000000100 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami32_local SYNC (stage: Complete) 2024.10.22 13:39:31.278768 [ 221779 ] {8e37b54b-8e13-4af0-85e3-fd5ee2ab2840} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Stopped being leader 2024.10.22 13:39:31.278789 [ 221779 ] {8e37b54b-8e13-4af0-85e3-fd5ee2ab2840} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2024.10.22 13:39:31.278796 [ 221779 ] {8e37b54b-8e13-4af0-85e3-fd5ee2ab2840} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Will not wait for unique parts to be fetched by other replicas because shutdown called from DROP/DETACH query 2024.10.22 13:39:31.285630 [ 221779 ] {8e37b54b-8e13-4af0-85e3-fd5ee2ab2840} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Waiting for threads to finish 2024.10.22 13:39:31.285860 [ 221779 ] {8e37b54b-8e13-4af0-85e3-fd5ee2ab2840} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Threads finished 2024.10.22 13:39:31.285869 [ 221779 ] {8e37b54b-8e13-4af0-85e3-fd5ee2ab2840} oximeter.measurements_histogrami32_local (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2024.10.22 13:39:31.286003 [ 221779 ] {8e37b54b-8e13-4af0-85e3-fd5ee2ab2840} DatabaseCatalog: Waiting for table aa9f4b49-21c5-46ea-8eb4-cc05c2e50258 to be finally dropped 2024.10.22 13:39:31.286016 [ 221556 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258) 2024.10.22 13:39:31.292617 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): dropAllData: waiting for locks. 2024.10.22 13:39:31.292635 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): dropAllData: removing data parts (count 0) from filesystem. 2024.10.22 13:39:31.292642 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): dropAllData: removing all data parts from memory. 2024.10.22 13:39:31.292649 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): dropAllData: clearing temporary directories 2024.10.22 13:39:31.292733 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): dropAllData: remove format_version.txt, detached, moving and write ahead logs 2024.10.22 13:39:31.292811 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): dropAllData: removing table directory recursive to cleanup garbage 2024.10.22 13:39:31.292836 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): dropAllData: done. 2024.10.22 13:39:31.302738 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Removing replica /clickhouse/tables/01/measurements_histogrami32_local/replicas/02, marking it as lost 2024.10.22 13:39:31.330855 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): /clickhouse/tables/01/measurements_histogrami32_local/replicas/02 is the last replica, will remove table 2024.10.22 13:39:31.335444 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Removing table /clickhouse/tables/01/measurements_histogrami32_local (this might take several minutes) 2024.10.22 13:39:31.379437 [ 221556 ] {} oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258): Table /clickhouse/tables/01/measurements_histogrami32_local was successfully removed from ZooKeeper 2024.10.22 13:39:31.379500 [ 221556 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogrami32_local.aa9f4b49-21c5-46ea-8eb4-cc05c2e50258.sql of dropped table oximeter.measurements_histogrami32_local (aa9f4b49-21c5-46ea-8eb4-cc05c2e50258) 2024.10.22 13:39:31.379680 [ 221779 ] {8e37b54b-8e13-4af0-85e3-fd5ee2ab2840} DDLWorker: Executed query: /* ddl_entry=query-0000000100 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami32_local SYNC 2024.10.22 13:39:31.383806 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:31.393550 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:31.393555 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:31.397028 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=102, queue_size=102, entries=query-0000000000..query-0000000101, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000100, last_skipped_entry_name=none 2024.10.22 13:39:31.397043 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000101 2024.10.22 13:39:31.397055 [ 221779 ] {} DDLWorker: Checking task query-0000000101 2024.10.22 13:39:31.397483 [ 221779 ] {} DDLWorker: Processing task query-0000000101 (DROP TABLE IF EXISTS oximeter.measurements_histogrami32 SYNC) 2024.10.22 13:39:31.401057 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogrami32 SYNC 2024.10.22 13:39:31.401173 [ 221779 ] {c6aa3ea7-75a2-464d-ba97-6b9f0bc36493} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 52b217af-4976-45fe-80dd-754390beac39) /* ddl_entry=query-0000000101 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami32 SYNC (stage: Complete) 2024.10.22 13:39:31.401207 [ 221779 ] {c6aa3ea7-75a2-464d-ba97-6b9f0bc36493} StorageDistributed (measurements_histogrami32): Joining background threads for async INSERT 2024.10.22 13:39:31.401214 [ 221779 ] {c6aa3ea7-75a2-464d-ba97-6b9f0bc36493} StorageDistributed (measurements_histogrami32): Background threads for async INSERT joined 2024.10.22 13:39:31.401365 [ 221779 ] {c6aa3ea7-75a2-464d-ba97-6b9f0bc36493} DatabaseCatalog: Waiting for table ec4d1bb5-6f9d-40cd-9097-dd28c5bac89a to be finally dropped 2024.10.22 13:39:31.401378 [ 221656 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogrami32 (ec4d1bb5-6f9d-40cd-9097-dd28c5bac89a) 2024.10.22 13:39:31.401395 [ 221656 ] {} StorageDistributed (measurements_histogrami32): Joining background threads for async INSERT 2024.10.22 13:39:31.401399 [ 221656 ] {} StorageDistributed (measurements_histogrami32): Background threads for async INSERT joined 2024.10.22 13:39:31.401402 [ 221656 ] {} StorageDistributed (measurements_histogrami32): Removing pending blocks for async INSERT from filesystem on DROP TABLE 2024.10.22 13:39:31.401478 [ 221656 ] {} StorageDistributed (measurements_histogrami32): Removed 2024.10.22 13:39:31.401494 [ 221656 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogrami32.ec4d1bb5-6f9d-40cd-9097-dd28c5bac89a.sql of dropped table oximeter.measurements_histogrami32 (ec4d1bb5-6f9d-40cd-9097-dd28c5bac89a) 2024.10.22 13:39:31.401582 [ 221779 ] {c6aa3ea7-75a2-464d-ba97-6b9f0bc36493} DDLWorker: Executed query: /* ddl_entry=query-0000000101 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami32 SYNC 2024.10.22 13:39:31.412381 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:31.510271 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:31.510303 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:31.510498 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=103, queue_size=103, entries=query-0000000000..query-0000000102, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000101, last_skipped_entry_name=none 2024.10.22 13:39:31.510514 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000102 2024.10.22 13:39:31.510521 [ 221779 ] {} DDLWorker: Checking task query-0000000102 2024.10.22 13:39:31.515687 [ 221779 ] {} DDLWorker: Processing task query-0000000102 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32_local UUID 'c1289a14-fd9a-4835-bddd-793c4df6b53f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:31.516329 [ 221660 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Scheduling next merge selecting task after 7831ms 2024.10.22 13:39:31.519239 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32_local UUID 'c1289a14-fd9a-4835-bddd-793c4df6b53f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:31.519495 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e0fe06a1-79cd-47d3-a0c1-b68b52ffc289) /* ddl_entry=query-0000000102 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32_local UUID 'c1289a14-fd9a-4835-bddd-793c4df6b53f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:31.524207 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Loading data parts 2024.10.22 13:39:31.524476 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): There are no data parts 2024.10.22 13:39:31.533999 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Creating table /clickhouse/tables/01/measurements_histogrami32_local 2024.10.22 13:39:31.572125 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Creating shared ID for table oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f) 2024.10.22 13:39:31.578404 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Shared ID for table oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami32_local/table_shared_id 2024.10.22 13:39:31.578426 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Got candidate ID c1289a14-fd9a-4835-bddd-793c4df6b53f, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami32_local/table_shared_id 2024.10.22 13:39:31.587378 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Initializing table shared ID with c1289a14-fd9a-4835-bddd-793c4df6b53f 2024.10.22 13:39:31.590767 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Starting up table 2024.10.22 13:39:31.595284 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Became leader 2024.10.22 13:39:31.595301 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:31.595328 [ 221637 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:31.595347 [ 221637 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:31.602891 [ 221637 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:31.603016 [ 221637 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:31.603030 [ 221637 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogrami32_local/replicas/02/queue 2024.10.22 13:39:31.603137 [ 221637 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:31.603264 [ 221637 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:31.607514 [ 221637 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:31.607546 [ 221668 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 6349ms 2024.10.22 13:39:31.607884 [ 221779 ] {dcbdb99e-1dec-45a2-8c06-97c653df9f33} DDLWorker: Executed query: /* ddl_entry=query-0000000102 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32_local UUID 'c1289a14-fd9a-4835-bddd-793c4df6b53f' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:31.614574 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:31.683307 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:31.683311 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:31.688903 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=104, queue_size=104, entries=query-0000000000..query-0000000103, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000102, last_skipped_entry_name=none 2024.10.22 13:39:31.688923 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000103 2024.10.22 13:39:31.688938 [ 221779 ] {} DDLWorker: Checking task query-0000000103 2024.10.22 13:39:31.690021 [ 221779 ] {} DDLWorker: Processing task query-0000000103 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32 UUID 'dec59326-a5a7-423c-b044-2f9ea82eac32' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:31.694301 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32 UUID 'dec59326-a5a7-423c-b044-2f9ea82eac32' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:31.694552 [ 221779 ] {6460feda-1c51-4b0e-969a-8520f093f8a5} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b27b8613-dc91-4b84-a1b2-35e49f0e7bb2) /* ddl_entry=query-0000000103 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32 UUID 'dec59326-a5a7-423c-b044-2f9ea82eac32' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:31.696191 [ 221779 ] {6460feda-1c51-4b0e-969a-8520f093f8a5} StorageDistributed (measurements_histogrami32): Auto-increment is 0 2024.10.22 13:39:31.700742 [ 221779 ] {6460feda-1c51-4b0e-969a-8520f093f8a5} DDLWorker: Executed query: /* ddl_entry=query-0000000103 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32 UUID 'dec59326-a5a7-423c-b044-2f9ea82eac32' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int32), `counts` Array(UInt64), `min` Int32, `max` Int32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:31.707400 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:31.799723 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:31.799757 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:31.804268 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=105, queue_size=105, entries=query-0000000000..query-0000000104, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000103, last_skipped_entry_name=none 2024.10.22 13:39:31.804284 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000104 2024.10.22 13:39:31.804292 [ 221779 ] {} DDLWorker: Checking task query-0000000104 2024.10.22 13:39:31.804787 [ 221779 ] {} DDLWorker: Processing task query-0000000104 (DROP TABLE IF EXISTS oximeter.measurements_histogramu32_local SYNC) 2024.10.22 13:39:31.813493 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramu32_local SYNC 2024.10.22 13:39:31.813595 [ 221779 ] {da89929a-696c-457a-829d-15d95c1e081c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 132061d4-8b3b-44f7-96dd-ba4fc50983bf) /* ddl_entry=query-0000000104 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu32_local SYNC (stage: Complete) 2024.10.22 13:39:31.813623 [ 221779 ] {da89929a-696c-457a-829d-15d95c1e081c} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Stopped being leader 2024.10.22 13:39:31.813642 [ 221779 ] {da89929a-696c-457a-829d-15d95c1e081c} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2024.10.22 13:39:31.813648 [ 221779 ] {da89929a-696c-457a-829d-15d95c1e081c} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Will not wait for unique parts to be fetched by other replicas because shutdown called from DROP/DETACH query 2024.10.22 13:39:31.820436 [ 221779 ] {da89929a-696c-457a-829d-15d95c1e081c} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Waiting for threads to finish 2024.10.22 13:39:31.820629 [ 221779 ] {da89929a-696c-457a-829d-15d95c1e081c} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Threads finished 2024.10.22 13:39:31.820637 [ 221779 ] {da89929a-696c-457a-829d-15d95c1e081c} oximeter.measurements_histogramu32_local (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2024.10.22 13:39:31.820740 [ 221779 ] {da89929a-696c-457a-829d-15d95c1e081c} DatabaseCatalog: Waiting for table 41efcbd7-bfc0-4ccf-9cd5-626c13481d21 to be finally dropped 2024.10.22 13:39:31.820751 [ 221616 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21) 2024.10.22 13:39:31.824385 [ 221531 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Scheduling next merge selecting task after 8054ms 2024.10.22 13:39:31.828439 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): dropAllData: waiting for locks. 2024.10.22 13:39:31.828461 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): dropAllData: removing data parts (count 0) from filesystem. 2024.10.22 13:39:31.828467 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): dropAllData: removing all data parts from memory. 2024.10.22 13:39:31.828473 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): dropAllData: clearing temporary directories 2024.10.22 13:39:31.828556 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): dropAllData: remove format_version.txt, detached, moving and write ahead logs 2024.10.22 13:39:31.828704 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): dropAllData: removing table directory recursive to cleanup garbage 2024.10.22 13:39:31.828750 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): dropAllData: done. 2024.10.22 13:39:31.835654 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Removing replica /clickhouse/tables/01/measurements_histogramu32_local/replicas/02, marking it as lost 2024.10.22 13:39:31.867468 [ 221653 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Scheduling next merge selecting task after 7641ms 2024.10.22 13:39:31.877875 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): /clickhouse/tables/01/measurements_histogramu32_local/replicas/02 is the last replica, will remove table 2024.10.22 13:39:31.880924 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Removing table /clickhouse/tables/01/measurements_histogramu32_local (this might take several minutes) 2024.10.22 13:39:31.926583 [ 221616 ] {} oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21): Table /clickhouse/tables/01/measurements_histogramu32_local was successfully removed from ZooKeeper 2024.10.22 13:39:31.926631 [ 221616 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramu32_local.41efcbd7-bfc0-4ccf-9cd5-626c13481d21.sql of dropped table oximeter.measurements_histogramu32_local (41efcbd7-bfc0-4ccf-9cd5-626c13481d21) 2024.10.22 13:39:31.926808 [ 221779 ] {da89929a-696c-457a-829d-15d95c1e081c} DDLWorker: Executed query: /* ddl_entry=query-0000000104 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu32_local SYNC 2024.10.22 13:39:31.930551 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:31.975057 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:31.975077 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:31.975297 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=106, queue_size=106, entries=query-0000000000..query-0000000105, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000104, last_skipped_entry_name=none 2024.10.22 13:39:31.975313 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000105 2024.10.22 13:39:31.975321 [ 221779 ] {} DDLWorker: Checking task query-0000000105 2024.10.22 13:39:31.979872 [ 221779 ] {} DDLWorker: Processing task query-0000000105 (DROP TABLE IF EXISTS oximeter.measurements_histogramu32 SYNC) 2024.10.22 13:39:31.983604 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramu32 SYNC 2024.10.22 13:39:31.983709 [ 221779 ] {775a1a4a-d2a1-4e8a-8ef6-39828d87690e} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e6b3afa7-8013-4bd7-9a82-61879d660584) /* ddl_entry=query-0000000105 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu32 SYNC (stage: Complete) 2024.10.22 13:39:31.983744 [ 221779 ] {775a1a4a-d2a1-4e8a-8ef6-39828d87690e} StorageDistributed (measurements_histogramu32): Joining background threads for async INSERT 2024.10.22 13:39:31.983753 [ 221779 ] {775a1a4a-d2a1-4e8a-8ef6-39828d87690e} StorageDistributed (measurements_histogramu32): Background threads for async INSERT joined 2024.10.22 13:39:31.983877 [ 221779 ] {775a1a4a-d2a1-4e8a-8ef6-39828d87690e} DatabaseCatalog: Waiting for table ff4e0327-8059-4763-9b55-b00932921964 to be finally dropped 2024.10.22 13:39:31.983887 [ 221552 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramu32 (ff4e0327-8059-4763-9b55-b00932921964) 2024.10.22 13:39:31.983906 [ 221552 ] {} StorageDistributed (measurements_histogramu32): Joining background threads for async INSERT 2024.10.22 13:39:31.983912 [ 221552 ] {} StorageDistributed (measurements_histogramu32): Background threads for async INSERT joined 2024.10.22 13:39:31.983916 [ 221552 ] {} StorageDistributed (measurements_histogramu32): Removing pending blocks for async INSERT from filesystem on DROP TABLE 2024.10.22 13:39:31.983989 [ 221552 ] {} StorageDistributed (measurements_histogramu32): Removed 2024.10.22 13:39:31.984014 [ 221552 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramu32.ff4e0327-8059-4763-9b55-b00932921964.sql of dropped table oximeter.measurements_histogramu32 (ff4e0327-8059-4763-9b55-b00932921964) 2024.10.22 13:39:31.984186 [ 221779 ] {775a1a4a-d2a1-4e8a-8ef6-39828d87690e} DDLWorker: Executed query: /* ddl_entry=query-0000000105 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu32 SYNC 2024.10.22 13:39:31.992713 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:32.096171 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:32.096177 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:32.096452 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=107, queue_size=107, entries=query-0000000000..query-0000000106, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000105, last_skipped_entry_name=none 2024.10.22 13:39:32.096470 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000106 2024.10.22 13:39:32.096478 [ 221779 ] {} DDLWorker: Checking task query-0000000106 2024.10.22 13:39:32.101007 [ 221779 ] {} DDLWorker: Processing task query-0000000106 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32_local UUID '4a3801e7-9bc3-4218-a094-95f1b71e310c' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:32.105406 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32_local UUID '4a3801e7-9bc3-4218-a094-95f1b71e310c' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:32.105650 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0c569df5-2a4c-468d-a29c-87246c80ab43) /* ddl_entry=query-0000000106 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32_local UUID '4a3801e7-9bc3-4218-a094-95f1b71e310c' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:32.109639 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Loading data parts 2024.10.22 13:39:32.110000 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): There are no data parts 2024.10.22 13:39:32.115768 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Creating table /clickhouse/tables/01/measurements_histogramu32_local 2024.10.22 13:39:32.149969 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Creating shared ID for table oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c) 2024.10.22 13:39:32.150075 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Shared ID for table oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogramu32_local/table_shared_id 2024.10.22 13:39:32.150087 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Got candidate ID 4a3801e7-9bc3-4218-a094-95f1b71e310c, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogramu32_local/table_shared_id 2024.10.22 13:39:32.154398 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Initializing table shared ID with 4a3801e7-9bc3-4218-a094-95f1b71e310c 2024.10.22 13:39:32.159091 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Starting up table 2024.10.22 13:39:32.171033 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Became leader 2024.10.22 13:39:32.171055 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:32.171085 [ 221535 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:32.171107 [ 221535 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:32.174577 [ 221535 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:32.174693 [ 221535 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:32.174703 [ 221535 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramu32_local/replicas/02/queue 2024.10.22 13:39:32.174835 [ 221535 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:32.174932 [ 221535 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:32.180652 [ 221535 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:32.180681 [ 221639 ] {} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Scheduling next merge selecting task after 6298ms 2024.10.22 13:39:32.180844 [ 221779 ] {f79076d2-c01c-4117-a2cb-ecb648779053} DDLWorker: Executed query: /* ddl_entry=query-0000000106 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32_local UUID '4a3801e7-9bc3-4218-a094-95f1b71e310c' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:32.189986 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:32.220823 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:32.220831 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:32.226048 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=108, queue_size=108, entries=query-0000000000..query-0000000107, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000106, last_skipped_entry_name=none 2024.10.22 13:39:32.226063 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000107 2024.10.22 13:39:32.226070 [ 221779 ] {} DDLWorker: Checking task query-0000000107 2024.10.22 13:39:32.233598 [ 221779 ] {} DDLWorker: Processing task query-0000000107 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32 UUID '8e285284-d090-45f9-be9e-a5e128439947' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:32.238207 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32 UUID '8e285284-d090-45f9-be9e-a5e128439947' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:32.238385 [ 221779 ] {7e4913bd-a464-4a00-8c0b-48d93aa59990} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5cb17bd1-53cd-4d7a-a964-7ac7b149282b) /* ddl_entry=query-0000000107 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32 UUID '8e285284-d090-45f9-be9e-a5e128439947' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:32.238945 [ 221779 ] {7e4913bd-a464-4a00-8c0b-48d93aa59990} StorageDistributed (measurements_histogramu32): Auto-increment is 0 2024.10.22 13:39:32.242420 [ 221643 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 10130ms 2024.10.22 13:39:32.245454 [ 221779 ] {7e4913bd-a464-4a00-8c0b-48d93aa59990} DDLWorker: Executed query: /* ddl_entry=query-0000000107 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32 UUID '8e285284-d090-45f9-be9e-a5e128439947' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt32), `counts` Array(UInt64), `min` UInt32, `max` UInt32, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:32.251326 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:32.264148 [ 221636 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Scheduling next merge selecting task after 7738ms 2024.10.22 13:39:32.344888 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:32.344887 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:32.345147 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=109, queue_size=109, entries=query-0000000000..query-0000000108, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000107, last_skipped_entry_name=none 2024.10.22 13:39:32.345165 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000108 2024.10.22 13:39:32.345173 [ 221779 ] {} DDLWorker: Checking task query-0000000108 2024.10.22 13:39:32.348457 [ 221779 ] {} DDLWorker: Processing task query-0000000108 (DROP TABLE IF EXISTS oximeter.measurements_histogrami64_local SYNC) 2024.10.22 13:39:32.352978 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogrami64_local SYNC 2024.10.22 13:39:32.353084 [ 221779 ] {4b00fe3b-ba38-4660-8d48-645d8c1340a8} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 36e9fb09-ef2a-4399-96ec-a3ec5105dcc6) /* ddl_entry=query-0000000108 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami64_local SYNC (stage: Complete) 2024.10.22 13:39:32.353117 [ 221779 ] {4b00fe3b-ba38-4660-8d48-645d8c1340a8} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Stopped being leader 2024.10.22 13:39:32.353137 [ 221779 ] {4b00fe3b-ba38-4660-8d48-645d8c1340a8} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2024.10.22 13:39:32.353144 [ 221779 ] {4b00fe3b-ba38-4660-8d48-645d8c1340a8} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Will not wait for unique parts to be fetched by other replicas because shutdown called from DROP/DETACH query 2024.10.22 13:39:32.357547 [ 221779 ] {4b00fe3b-ba38-4660-8d48-645d8c1340a8} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Waiting for threads to finish 2024.10.22 13:39:32.357765 [ 221779 ] {4b00fe3b-ba38-4660-8d48-645d8c1340a8} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Threads finished 2024.10.22 13:39:32.357776 [ 221779 ] {4b00fe3b-ba38-4660-8d48-645d8c1340a8} oximeter.measurements_histogrami64_local (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2024.10.22 13:39:32.357892 [ 221779 ] {4b00fe3b-ba38-4660-8d48-645d8c1340a8} DatabaseCatalog: Waiting for table e253bc84-081c-44d7-b513-286bddd4eeeb to be finally dropped 2024.10.22 13:39:32.357901 [ 221526 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb) 2024.10.22 13:39:32.361569 [ 221526 ] {} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): dropAllData: waiting for locks. 2024.10.22 13:39:32.361585 [ 221526 ] {} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): dropAllData: removing data parts (count 0) from filesystem. 2024.10.22 13:39:32.361592 [ 221526 ] {} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): dropAllData: removing all data parts from memory. 2024.10.22 13:39:32.361598 [ 221526 ] {} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): dropAllData: clearing temporary directories 2024.10.22 13:39:32.361686 [ 221526 ] {} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): dropAllData: remove format_version.txt, detached, moving and write ahead logs 2024.10.22 13:39:32.361806 [ 221526 ] {} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): dropAllData: removing table directory recursive to cleanup garbage 2024.10.22 13:39:32.361852 [ 221526 ] {} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): dropAllData: done. 2024.10.22 13:39:32.371568 [ 221526 ] {} oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb): Removing replica /clickhouse/tables/01/measurements_histogrami64_local/replicas/02, marking it as lost 2024.10.22 13:39:32.398920 [ 221526 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogrami64_local.e253bc84-081c-44d7-b513-286bddd4eeeb.sql of dropped table oximeter.measurements_histogrami64_local (e253bc84-081c-44d7-b513-286bddd4eeeb) 2024.10.22 13:39:32.399354 [ 221779 ] {4b00fe3b-ba38-4660-8d48-645d8c1340a8} DDLWorker: Executed query: /* ddl_entry=query-0000000108 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami64_local SYNC 2024.10.22 13:39:32.405915 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:32.470253 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:32.470262 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:32.473881 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=110, queue_size=110, entries=query-0000000000..query-0000000109, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000108, last_skipped_entry_name=none 2024.10.22 13:39:32.473899 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000109 2024.10.22 13:39:32.473907 [ 221779 ] {} DDLWorker: Checking task query-0000000109 2024.10.22 13:39:32.474265 [ 221779 ] {} DDLWorker: Processing task query-0000000109 (DROP TABLE IF EXISTS oximeter.measurements_histogrami64 SYNC) 2024.10.22 13:39:32.477654 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogrami64 SYNC 2024.10.22 13:39:32.477748 [ 221779 ] {fea6a3c2-a643-4de2-8306-517ab7f63fbe} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 11ea2ac9-04f9-42b1-a139-9819534eb566) /* ddl_entry=query-0000000109 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami64 SYNC (stage: Complete) 2024.10.22 13:39:32.477786 [ 221779 ] {fea6a3c2-a643-4de2-8306-517ab7f63fbe} StorageDistributed (measurements_histogrami64): Joining background threads for async INSERT 2024.10.22 13:39:32.477795 [ 221779 ] {fea6a3c2-a643-4de2-8306-517ab7f63fbe} StorageDistributed (measurements_histogrami64): Background threads for async INSERT joined 2024.10.22 13:39:32.477896 [ 221779 ] {fea6a3c2-a643-4de2-8306-517ab7f63fbe} DatabaseCatalog: Waiting for table cf8a1200-a120-46b5-a230-1b775241d10e to be finally dropped 2024.10.22 13:39:32.477914 [ 221530 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogrami64 (cf8a1200-a120-46b5-a230-1b775241d10e) 2024.10.22 13:39:32.477939 [ 221530 ] {} StorageDistributed (measurements_histogrami64): Joining background threads for async INSERT 2024.10.22 13:39:32.477944 [ 221530 ] {} StorageDistributed (measurements_histogrami64): Background threads for async INSERT joined 2024.10.22 13:39:32.477949 [ 221530 ] {} StorageDistributed (measurements_histogrami64): Removing pending blocks for async INSERT from filesystem on DROP TABLE 2024.10.22 13:39:32.478019 [ 221530 ] {} StorageDistributed (measurements_histogrami64): Removed 2024.10.22 13:39:32.478037 [ 221530 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogrami64.cf8a1200-a120-46b5-a230-1b775241d10e.sql of dropped table oximeter.measurements_histogrami64 (cf8a1200-a120-46b5-a230-1b775241d10e) 2024.10.22 13:39:32.478146 [ 221779 ] {fea6a3c2-a643-4de2-8306-517ab7f63fbe} DDLWorker: Executed query: /* ddl_entry=query-0000000109 */ DROP TABLE IF EXISTS oximeter.measurements_histogrami64 SYNC 2024.10.22 13:39:32.486252 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:32.586312 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:32.586315 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:32.589973 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=111, queue_size=111, entries=query-0000000000..query-0000000110, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000109, last_skipped_entry_name=none 2024.10.22 13:39:32.589990 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000110 2024.10.22 13:39:32.590006 [ 221779 ] {} DDLWorker: Checking task query-0000000110 2024.10.22 13:39:32.590670 [ 221779 ] {} DDLWorker: Processing task query-0000000110 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64_local UUID '98988eb0-10cf-4c56-b964-0165249a4fbd' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:32.594155 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64_local UUID '98988eb0-10cf-4c56-b964-0165249a4fbd' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:32.594449 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 608a3090-0bea-48a9-834b-564e3a04644d) /* ddl_entry=query-0000000110 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64_local UUID '98988eb0-10cf-4c56-b964-0165249a4fbd' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:32.599000 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Loading data parts 2024.10.22 13:39:32.599219 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): There are no data parts 2024.10.22 13:39:32.607442 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Creating table /clickhouse/tables/01/measurements_histogrami64_local 2024.10.22 13:39:32.658363 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Creating shared ID for table oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd) 2024.10.22 13:39:32.663841 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Shared ID for table oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami64_local/table_shared_id 2024.10.22 13:39:32.663859 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Got candidate ID 98988eb0-10cf-4c56-b964-0165249a4fbd, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogrami64_local/table_shared_id 2024.10.22 13:39:32.669430 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Initializing table shared ID with 98988eb0-10cf-4c56-b964-0165249a4fbd 2024.10.22 13:39:32.672881 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Starting up table 2024.10.22 13:39:32.681572 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Became leader 2024.10.22 13:39:32.681597 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:32.681623 [ 221573 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:32.681640 [ 221573 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:32.703117 [ 221573 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:32.703338 [ 221573 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:32.703348 [ 221573 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogrami64_local/replicas/02/queue 2024.10.22 13:39:32.705974 [ 221573 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:32.709782 [ 221573 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:32.716168 [ 221573 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:32.716261 [ 221644 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 6494ms 2024.10.22 13:39:32.716388 [ 221779 ] {494eab19-5793-46e2-8ccb-45f5243cd320} DDLWorker: Executed query: /* ddl_entry=query-0000000110 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64_local UUID '98988eb0-10cf-4c56-b964-0165249a4fbd' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogrami64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:32.722369 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:32.801619 [ 221588 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 10991ms 2024.10.22 13:39:32.819695 [ 221621 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 9958ms 2024.10.22 13:39:32.878203 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:32.878212 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:32.883382 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=112, queue_size=112, entries=query-0000000000..query-0000000111, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000110, last_skipped_entry_name=none 2024.10.22 13:39:32.883409 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000111 2024.10.22 13:39:32.883416 [ 221779 ] {} DDLWorker: Checking task query-0000000111 2024.10.22 13:39:32.884144 [ 221779 ] {} DDLWorker: Processing task query-0000000111 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64 UUID 'e57767f0-db58-4845-929b-a821ec2c2903' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:32.895656 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64 UUID 'e57767f0-db58-4845-929b-a821ec2c2903' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:32.895992 [ 221779 ] {e6d7ac15-557d-4265-bb19-19290aae1183} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 57ca85a8-9380-4e05-9e5c-3332cb64b27d) /* ddl_entry=query-0000000111 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64 UUID 'e57767f0-db58-4845-929b-a821ec2c2903' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:32.896725 [ 221779 ] {e6d7ac15-557d-4265-bb19-19290aae1183} StorageDistributed (measurements_histogrami64): Auto-increment is 0 2024.10.22 13:39:32.900445 [ 221779 ] {e6d7ac15-557d-4265-bb19-19290aae1183} DDLWorker: Executed query: /* ddl_entry=query-0000000111 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64 UUID 'e57767f0-db58-4845-929b-a821ec2c2903' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Int64), `counts` Array(UInt64), `min` Int64, `max` Int64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogrami64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:32.905124 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:32.964487 [ 221667 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 9739ms 2024.10.22 13:39:32.984386 [ 221662 ] {} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Scheduling next merge selecting task after 7646ms 2024.10.22 13:39:33.005240 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:33.005250 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:33.006065 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=113, queue_size=113, entries=query-0000000000..query-0000000112, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000111, last_skipped_entry_name=none 2024.10.22 13:39:33.006083 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000112 2024.10.22 13:39:33.006091 [ 221779 ] {} DDLWorker: Checking task query-0000000112 2024.10.22 13:39:33.014034 [ 221779 ] {} DDLWorker: Processing task query-0000000112 (DROP TABLE IF EXISTS oximeter.measurements_histogramu64_local SYNC) 2024.10.22 13:39:33.024428 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramu64_local SYNC 2024.10.22 13:39:33.024576 [ 221779 ] {e00765ee-407b-4211-84ae-0a322ca71a2f} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8f5d1959-8aad-4765-ad9a-88850f8bb1fb) /* ddl_entry=query-0000000112 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu64_local SYNC (stage: Complete) 2024.10.22 13:39:33.024614 [ 221779 ] {e00765ee-407b-4211-84ae-0a322ca71a2f} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Stopped being leader 2024.10.22 13:39:33.024632 [ 221779 ] {e00765ee-407b-4211-84ae-0a322ca71a2f} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2024.10.22 13:39:33.024640 [ 221779 ] {e00765ee-407b-4211-84ae-0a322ca71a2f} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Will not wait for unique parts to be fetched by other replicas because shutdown called from DROP/DETACH query 2024.10.22 13:39:33.030933 [ 221661 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Scheduling next merge selecting task after 8429ms 2024.10.22 13:39:33.032785 [ 221779 ] {e00765ee-407b-4211-84ae-0a322ca71a2f} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Waiting for threads to finish 2024.10.22 13:39:33.032999 [ 221779 ] {e00765ee-407b-4211-84ae-0a322ca71a2f} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Threads finished 2024.10.22 13:39:33.033019 [ 221779 ] {e00765ee-407b-4211-84ae-0a322ca71a2f} oximeter.measurements_histogramu64_local (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2024.10.22 13:39:33.033126 [ 221779 ] {e00765ee-407b-4211-84ae-0a322ca71a2f} DatabaseCatalog: Waiting for table ddba52ef-8091-4994-8ccf-d9176f6f7124 to be finally dropped 2024.10.22 13:39:33.033139 [ 221600 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124) 2024.10.22 13:39:33.040407 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): dropAllData: waiting for locks. 2024.10.22 13:39:33.040420 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): dropAllData: removing data parts (count 0) from filesystem. 2024.10.22 13:39:33.040427 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): dropAllData: removing all data parts from memory. 2024.10.22 13:39:33.040432 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): dropAllData: clearing temporary directories 2024.10.22 13:39:33.040502 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): dropAllData: remove format_version.txt, detached, moving and write ahead logs 2024.10.22 13:39:33.040606 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): dropAllData: removing table directory recursive to cleanup garbage 2024.10.22 13:39:33.040644 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): dropAllData: done. 2024.10.22 13:39:33.047092 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Removing replica /clickhouse/tables/01/measurements_histogramu64_local/replicas/02, marking it as lost 2024.10.22 13:39:33.078118 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): /clickhouse/tables/01/measurements_histogramu64_local/replicas/02 is the last replica, will remove table 2024.10.22 13:39:33.083057 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Removing table /clickhouse/tables/01/measurements_histogramu64_local (this might take several minutes) 2024.10.22 13:39:33.121037 [ 221600 ] {} oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124): Table /clickhouse/tables/01/measurements_histogramu64_local was successfully removed from ZooKeeper 2024.10.22 13:39:33.121092 [ 221600 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramu64_local.ddba52ef-8091-4994-8ccf-d9176f6f7124.sql of dropped table oximeter.measurements_histogramu64_local (ddba52ef-8091-4994-8ccf-d9176f6f7124) 2024.10.22 13:39:33.121453 [ 221779 ] {e00765ee-407b-4211-84ae-0a322ca71a2f} DDLWorker: Executed query: /* ddl_entry=query-0000000112 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu64_local SYNC 2024.10.22 13:39:33.125257 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:33.126449 [ 221575 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 10064ms 2024.10.22 13:39:33.139345 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:33.139390 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:33.142997 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=114, queue_size=114, entries=query-0000000000..query-0000000113, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000112, last_skipped_entry_name=none 2024.10.22 13:39:33.143022 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000113 2024.10.22 13:39:33.143029 [ 221779 ] {} DDLWorker: Checking task query-0000000113 2024.10.22 13:39:33.143422 [ 221779 ] {} DDLWorker: Processing task query-0000000113 (DROP TABLE IF EXISTS oximeter.measurements_histogramu64 SYNC) 2024.10.22 13:39:33.150806 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramu64 SYNC 2024.10.22 13:39:33.150901 [ 221779 ] {a29a0e9a-ca4d-401b-9a75-d4ad1d564de3} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5050e6ad-f2ce-4683-8572-a165a7eb2087) /* ddl_entry=query-0000000113 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu64 SYNC (stage: Complete) 2024.10.22 13:39:33.150926 [ 221779 ] {a29a0e9a-ca4d-401b-9a75-d4ad1d564de3} StorageDistributed (measurements_histogramu64): Joining background threads for async INSERT 2024.10.22 13:39:33.150931 [ 221779 ] {a29a0e9a-ca4d-401b-9a75-d4ad1d564de3} StorageDistributed (measurements_histogramu64): Background threads for async INSERT joined 2024.10.22 13:39:33.151006 [ 221779 ] {a29a0e9a-ca4d-401b-9a75-d4ad1d564de3} DatabaseCatalog: Waiting for table 6ae18c22-936c-48a1-ba9f-14fdcf9c1bac to be finally dropped 2024.10.22 13:39:33.151015 [ 221572 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramu64 (6ae18c22-936c-48a1-ba9f-14fdcf9c1bac) 2024.10.22 13:39:33.151045 [ 221572 ] {} StorageDistributed (measurements_histogramu64): Joining background threads for async INSERT 2024.10.22 13:39:33.151049 [ 221572 ] {} StorageDistributed (measurements_histogramu64): Background threads for async INSERT joined 2024.10.22 13:39:33.151053 [ 221572 ] {} StorageDistributed (measurements_histogramu64): Removing pending blocks for async INSERT from filesystem on DROP TABLE 2024.10.22 13:39:33.151100 [ 221572 ] {} StorageDistributed (measurements_histogramu64): Removed 2024.10.22 13:39:33.151115 [ 221572 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramu64.6ae18c22-936c-48a1-ba9f-14fdcf9c1bac.sql of dropped table oximeter.measurements_histogramu64 (6ae18c22-936c-48a1-ba9f-14fdcf9c1bac) 2024.10.22 13:39:33.151198 [ 221779 ] {a29a0e9a-ca4d-401b-9a75-d4ad1d564de3} DDLWorker: Executed query: /* ddl_entry=query-0000000113 */ DROP TABLE IF EXISTS oximeter.measurements_histogramu64 SYNC 2024.10.22 13:39:33.157685 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:33.270298 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:33.270301 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:33.274133 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=115, queue_size=115, entries=query-0000000000..query-0000000114, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000113, last_skipped_entry_name=none 2024.10.22 13:39:33.274148 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000114 2024.10.22 13:39:33.274155 [ 221779 ] {} DDLWorker: Checking task query-0000000114 2024.10.22 13:39:33.274784 [ 221779 ] {} DDLWorker: Processing task query-0000000114 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64_local UUID '815843a1-e3f7-4b17-a3b9-d9bda6362620' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:33.278871 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64_local UUID '815843a1-e3f7-4b17-a3b9-d9bda6362620' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:33.279059 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8582e739-9f4c-40fd-bb13-672affca0a5e) /* ddl_entry=query-0000000114 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64_local UUID '815843a1-e3f7-4b17-a3b9-d9bda6362620' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:33.282953 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Loading data parts 2024.10.22 13:39:33.283163 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): There are no data parts 2024.10.22 13:39:33.289707 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Creating table /clickhouse/tables/01/measurements_histogramu64_local 2024.10.22 13:39:33.296722 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): It looks like the table /clickhouse/tables/01/measurements_histogramu64_local was created by another server at the same moment, will retry 2024.10.22 13:39:33.296849 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): This table /clickhouse/tables/01/measurements_histogramu64_local is already created, will add new replica 2024.10.22 13:39:33.297697 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Creating replica /clickhouse/tables/01/measurements_histogramu64_local/replicas/02 2024.10.22 13:39:33.331316 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Creating shared ID for table oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620) 2024.10.22 13:39:33.331468 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Initializing table shared ID with 815843a1-e3f7-4b17-a3b9-d9bda6362620 2024.10.22 13:39:33.337293 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Starting up table 2024.10.22 13:39:33.338551 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Became leader 2024.10.22 13:39:33.338565 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:33.338588 [ 221570 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:33.338601 [ 221570 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:33.342956 [ 221570 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Replica 01 has log pointer '', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:33.342968 [ 221570 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Will mimic 01 2024.10.22 13:39:33.355577 [ 221570 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:33.355590 [ 221570 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:33.355771 [ 221570 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Parts in ZooKeeper after mimic: 2024.10.22 13:39:33.355787 [ 221570 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Enqueued fetches after mimic: 2024.10.22 13:39:33.359357 [ 221570 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:33.363012 [ 221570 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:33.363030 [ 221570 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramu64_local/replicas/02/queue 2024.10.22 13:39:33.363189 [ 221570 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:33.363304 [ 221570 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:33.367874 [ 221570 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:33.367879 [ 221545 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 6515ms 2024.10.22 13:39:33.368095 [ 221779 ] {0a4bb9f7-a67e-4e49-af87-c75730b9a58b} DDLWorker: Executed query: /* ddl_entry=query-0000000114 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64_local UUID '815843a1-e3f7-4b17-a3b9-d9bda6362620' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramu64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:33.372552 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:33.389981 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:33.389987 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:33.392577 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=116, queue_size=116, entries=query-0000000000..query-0000000115, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000114, last_skipped_entry_name=none 2024.10.22 13:39:33.392591 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000115 2024.10.22 13:39:33.392595 [ 221779 ] {} DDLWorker: Checking task query-0000000115 2024.10.22 13:39:33.393144 [ 221779 ] {} DDLWorker: Processing task query-0000000115 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64 UUID '3667f6ca-7795-442f-b09e-6d0dceb91ea6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:33.400573 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64 UUID '3667f6ca-7795-442f-b09e-6d0dceb91ea6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:33.400761 [ 221779 ] {4264b885-3367-4f3a-9271-81a0e2697b63} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 67fae5b6-cc1d-4649-acbf-eaa097d3fc85) /* ddl_entry=query-0000000115 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64 UUID '3667f6ca-7795-442f-b09e-6d0dceb91ea6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:33.401293 [ 221779 ] {4264b885-3367-4f3a-9271-81a0e2697b63} StorageDistributed (measurements_histogramu64): Auto-increment is 0 2024.10.22 13:39:33.406030 [ 221779 ] {4264b885-3367-4f3a-9271-81a0e2697b63} DDLWorker: Executed query: /* ddl_entry=query-0000000115 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64 UUID '3667f6ca-7795-442f-b09e-6d0dceb91ea6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(UInt64), `counts` Array(UInt64), `min` UInt64, `max` UInt64, `sum_of_samples` Int64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramu64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:33.411431 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:33.504846 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:33.504851 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:33.505130 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=117, queue_size=117, entries=query-0000000000..query-0000000116, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000115, last_skipped_entry_name=none 2024.10.22 13:39:33.505146 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000116 2024.10.22 13:39:33.505152 [ 221779 ] {} DDLWorker: Checking task query-0000000116 2024.10.22 13:39:33.510052 [ 221779 ] {} DDLWorker: Processing task query-0000000116 (DROP TABLE IF EXISTS oximeter.measurements_histogramf32_local SYNC) 2024.10.22 13:39:33.515676 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramf32_local SYNC 2024.10.22 13:39:33.515789 [ 221779 ] {cd2f4cd4-da04-4185-8da7-ae668a1df792} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: da05e15c-f68d-499a-8e75-9caf5ed096e3) /* ddl_entry=query-0000000116 */ DROP TABLE IF EXISTS oximeter.measurements_histogramf32_local SYNC (stage: Complete) 2024.10.22 13:39:33.515822 [ 221779 ] {cd2f4cd4-da04-4185-8da7-ae668a1df792} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Stopped being leader 2024.10.22 13:39:33.515847 [ 221779 ] {cd2f4cd4-da04-4185-8da7-ae668a1df792} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2024.10.22 13:39:33.515857 [ 221779 ] {cd2f4cd4-da04-4185-8da7-ae668a1df792} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Will not wait for unique parts to be fetched by other replicas because shutdown called from DROP/DETACH query 2024.10.22 13:39:33.525669 [ 221779 ] {cd2f4cd4-da04-4185-8da7-ae668a1df792} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Waiting for threads to finish 2024.10.22 13:39:33.525888 [ 221779 ] {cd2f4cd4-da04-4185-8da7-ae668a1df792} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Threads finished 2024.10.22 13:39:33.525897 [ 221779 ] {cd2f4cd4-da04-4185-8da7-ae668a1df792} oximeter.measurements_histogramf32_local (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2024.10.22 13:39:33.526024 [ 221779 ] {cd2f4cd4-da04-4185-8da7-ae668a1df792} DatabaseCatalog: Waiting for table 5694cca9-ebeb-42c8-ba5f-8a57212926a9 to be finally dropped 2024.10.22 13:39:33.526034 [ 221579 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9) 2024.10.22 13:39:33.535241 [ 221577 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Scheduling next merge selecting task after 8348ms 2024.10.22 13:39:33.536533 [ 221579 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): dropAllData: waiting for locks. 2024.10.22 13:39:33.536546 [ 221579 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): dropAllData: removing data parts (count 0) from filesystem. 2024.10.22 13:39:33.536550 [ 221579 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): dropAllData: removing all data parts from memory. 2024.10.22 13:39:33.536555 [ 221579 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): dropAllData: clearing temporary directories 2024.10.22 13:39:33.536641 [ 221579 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): dropAllData: remove format_version.txt, detached, moving and write ahead logs 2024.10.22 13:39:33.536752 [ 221579 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): dropAllData: removing table directory recursive to cleanup garbage 2024.10.22 13:39:33.538397 [ 221579 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): dropAllData: done. 2024.10.22 13:39:33.550522 [ 221579 ] {} oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9): Removing replica /clickhouse/tables/01/measurements_histogramf32_local/replicas/02, marking it as lost 2024.10.22 13:39:33.599663 [ 221579 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramf32_local.5694cca9-ebeb-42c8-ba5f-8a57212926a9.sql of dropped table oximeter.measurements_histogramf32_local (5694cca9-ebeb-42c8-ba5f-8a57212926a9) 2024.10.22 13:39:33.599848 [ 221779 ] {cd2f4cd4-da04-4185-8da7-ae668a1df792} DDLWorker: Executed query: /* ddl_entry=query-0000000116 */ DROP TABLE IF EXISTS oximeter.measurements_histogramf32_local SYNC 2024.10.22 13:39:33.604571 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:33.696108 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:33.696107 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:33.699914 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=118, queue_size=118, entries=query-0000000000..query-0000000117, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000116, last_skipped_entry_name=none 2024.10.22 13:39:33.699932 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000117 2024.10.22 13:39:33.699955 [ 221779 ] {} DDLWorker: Checking task query-0000000117 2024.10.22 13:39:33.700394 [ 221779 ] {} DDLWorker: Processing task query-0000000117 (DROP TABLE IF EXISTS oximeter.measurements_histogramf32 SYNC) 2024.10.22 13:39:33.704566 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramf32 SYNC 2024.10.22 13:39:33.704676 [ 221779 ] {9ff51d61-c94c-4e34-a697-00847d414860} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 78485703-6054-4efd-ae3c-48fc352b66f2) /* ddl_entry=query-0000000117 */ DROP TABLE IF EXISTS oximeter.measurements_histogramf32 SYNC (stage: Complete) 2024.10.22 13:39:33.704711 [ 221779 ] {9ff51d61-c94c-4e34-a697-00847d414860} StorageDistributed (measurements_histogramf32): Joining background threads for async INSERT 2024.10.22 13:39:33.704724 [ 221779 ] {9ff51d61-c94c-4e34-a697-00847d414860} StorageDistributed (measurements_histogramf32): Background threads for async INSERT joined 2024.10.22 13:39:33.704818 [ 221779 ] {9ff51d61-c94c-4e34-a697-00847d414860} DatabaseCatalog: Waiting for table 66db7faa-4940-45ca-8e39-98d5250d5bfb to be finally dropped 2024.10.22 13:39:33.704835 [ 221641 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramf32 (66db7faa-4940-45ca-8e39-98d5250d5bfb) 2024.10.22 13:39:33.704852 [ 221641 ] {} StorageDistributed (measurements_histogramf32): Joining background threads for async INSERT 2024.10.22 13:39:33.704859 [ 221641 ] {} StorageDistributed (measurements_histogramf32): Background threads for async INSERT joined 2024.10.22 13:39:33.704866 [ 221641 ] {} StorageDistributed (measurements_histogramf32): Removing pending blocks for async INSERT from filesystem on DROP TABLE 2024.10.22 13:39:33.704941 [ 221641 ] {} StorageDistributed (measurements_histogramf32): Removed 2024.10.22 13:39:33.704966 [ 221641 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramf32.66db7faa-4940-45ca-8e39-98d5250d5bfb.sql of dropped table oximeter.measurements_histogramf32 (66db7faa-4940-45ca-8e39-98d5250d5bfb) 2024.10.22 13:39:33.705116 [ 221779 ] {9ff51d61-c94c-4e34-a697-00847d414860} DDLWorker: Executed query: /* ddl_entry=query-0000000117 */ DROP TABLE IF EXISTS oximeter.measurements_histogramf32 SYNC 2024.10.22 13:39:33.713988 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:33.753565 [ 221636 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 10086ms 2024.10.22 13:39:33.802541 [ 221632 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 10125ms 2024.10.22 13:39:33.816315 [ 221615 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Scheduling next merge selecting task after 7998ms 2024.10.22 13:39:33.818968 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:33.818976 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:33.819195 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=119, queue_size=119, entries=query-0000000000..query-0000000118, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000117, last_skipped_entry_name=none 2024.10.22 13:39:33.819212 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000118 2024.10.22 13:39:33.819217 [ 221779 ] {} DDLWorker: Checking task query-0000000118 2024.10.22 13:39:33.823242 [ 221779 ] {} DDLWorker: Processing task query-0000000118 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32_local UUID 'f7d3d6f4-4828-4c60-bb6c-60be4c814f3e' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:33.826873 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32_local UUID 'f7d3d6f4-4828-4c60-bb6c-60be4c814f3e' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:33.827167 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0f2f9700-7c14-4464-8d29-a908e9648ade) /* ddl_entry=query-0000000118 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32_local UUID 'f7d3d6f4-4828-4c60-bb6c-60be4c814f3e' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:33.832605 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Loading data parts 2024.10.22 13:39:33.832840 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): There are no data parts 2024.10.22 13:39:33.843826 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Creating table /clickhouse/tables/01/measurements_histogramf32_local 2024.10.22 13:39:33.875561 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Creating shared ID for table oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e) 2024.10.22 13:39:33.882180 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Shared ID for table oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e) doesn't exist in ZooKeeper on path /clickhouse/tables/01/measurements_histogramf32_local/table_shared_id 2024.10.22 13:39:33.882212 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Got candidate ID f7d3d6f4-4828-4c60-bb6c-60be4c814f3e, will try to create it in ZooKeeper on path /clickhouse/tables/01/measurements_histogramf32_local/table_shared_id 2024.10.22 13:39:33.895301 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Initializing table shared ID with f7d3d6f4-4828-4c60-bb6c-60be4c814f3e 2024.10.22 13:39:33.898799 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Starting up table 2024.10.22 13:39:33.906570 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Became leader 2024.10.22 13:39:33.906581 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:33.906602 [ 221627 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:33.906629 [ 221627 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:33.910079 [ 221627 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:33.910167 [ 221627 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:33.910176 [ 221627 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramf32_local/replicas/02/queue 2024.10.22 13:39:33.910296 [ 221627 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:33.910385 [ 221627 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:33.914895 [ 221627 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:33.914906 [ 221647 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 6230ms 2024.10.22 13:39:33.915082 [ 221779 ] {37d9fcd5-4ff8-4d07-812f-950738814bc7} DDLWorker: Executed query: /* ddl_entry=query-0000000118 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32_local UUID 'f7d3d6f4-4828-4c60-bb6c-60be4c814f3e' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf32_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:33.924749 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:33.975120 [ 221581 ] {} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Scheduling next merge selecting task after 8375ms 2024.10.22 13:39:33.987014 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:33.987024 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:33.990830 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=120, queue_size=120, entries=query-0000000000..query-0000000119, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000118, last_skipped_entry_name=none 2024.10.22 13:39:33.990851 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000119 2024.10.22 13:39:33.990857 [ 221779 ] {} DDLWorker: Checking task query-0000000119 2024.10.22 13:39:33.991415 [ 221779 ] {} DDLWorker: Processing task query-0000000119 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32 UUID '0174a422-06cd-4239-b3ed-3d4dc06f7b80' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf32_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:33.996454 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32 UUID '0174a422-06cd-4239-b3ed-3d4dc06f7b80' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:33.996650 [ 221779 ] {c9a43bb7-6d3f-4286-89ec-824721c2e95e} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: fa0abe31-87fe-4ca6-ab97-3d2b07711e9f) /* ddl_entry=query-0000000119 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32 UUID '0174a422-06cd-4239-b3ed-3d4dc06f7b80' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf32_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:33.997199 [ 221779 ] {c9a43bb7-6d3f-4286-89ec-824721c2e95e} StorageDistributed (measurements_histogramf32): Auto-increment is 0 2024.10.22 13:39:34.004042 [ 221779 ] {c9a43bb7-6d3f-4286-89ec-824721c2e95e} DDLWorker: Executed query: /* ddl_entry=query-0000000119 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32 UUID '0174a422-06cd-4239-b3ed-3d4dc06f7b80' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float32), `counts` Array(UInt64), `min` Float32, `max` Float32, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf32_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:34.008436 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:34.102707 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:34.102712 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:34.102955 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=121, queue_size=121, entries=query-0000000000..query-0000000120, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000119, last_skipped_entry_name=none 2024.10.22 13:39:34.102969 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000120 2024.10.22 13:39:34.102975 [ 221779 ] {} DDLWorker: Checking task query-0000000120 2024.10.22 13:39:34.106822 [ 221779 ] {} DDLWorker: Processing task query-0000000120 (DROP TABLE IF EXISTS oximeter.measurements_histogramf64_local SYNC) 2024.10.22 13:39:34.110885 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramf64_local SYNC 2024.10.22 13:39:34.110980 [ 221779 ] {cbcf7051-0a72-4d86-86cb-f1eb79882687} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 68239cc2-105c-4c41-bd66-7680ceb2cbf2) /* ddl_entry=query-0000000120 */ DROP TABLE IF EXISTS oximeter.measurements_histogramf64_local SYNC (stage: Complete) 2024.10.22 13:39:34.112040 [ 221779 ] {cbcf7051-0a72-4d86-86cb-f1eb79882687} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Stopped being leader 2024.10.22 13:39:34.112061 [ 221779 ] {cbcf7051-0a72-4d86-86cb-f1eb79882687} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2024.10.22 13:39:34.112069 [ 221779 ] {cbcf7051-0a72-4d86-86cb-f1eb79882687} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Will not wait for unique parts to be fetched by other replicas because shutdown called from DROP/DETACH query 2024.10.22 13:39:34.118587 [ 221779 ] {cbcf7051-0a72-4d86-86cb-f1eb79882687} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Waiting for threads to finish 2024.10.22 13:39:34.118830 [ 221779 ] {cbcf7051-0a72-4d86-86cb-f1eb79882687} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Threads finished 2024.10.22 13:39:34.118842 [ 221779 ] {cbcf7051-0a72-4d86-86cb-f1eb79882687} oximeter.measurements_histogramf64_local (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2024.10.22 13:39:34.118947 [ 221779 ] {cbcf7051-0a72-4d86-86cb-f1eb79882687} DatabaseCatalog: Waiting for table bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64 to be finally dropped 2024.10.22 13:39:34.118958 [ 221628 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64) 2024.10.22 13:39:34.127837 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): dropAllData: waiting for locks. 2024.10.22 13:39:34.127850 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): dropAllData: removing data parts (count 0) from filesystem. 2024.10.22 13:39:34.127854 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): dropAllData: removing all data parts from memory. 2024.10.22 13:39:34.127857 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): dropAllData: clearing temporary directories 2024.10.22 13:39:34.127923 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): dropAllData: remove format_version.txt, detached, moving and write ahead logs 2024.10.22 13:39:34.128017 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): dropAllData: removing table directory recursive to cleanup garbage 2024.10.22 13:39:34.128043 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): dropAllData: done. 2024.10.22 13:39:34.130580 [ 221556 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Scheduling next merge selecting task after 7931ms 2024.10.22 13:39:34.135379 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Removing replica /clickhouse/tables/01/measurements_histogramf64_local/replicas/02, marking it as lost 2024.10.22 13:39:34.169963 [ 221573 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 10565ms 2024.10.22 13:39:34.171273 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): /clickhouse/tables/01/measurements_histogramf64_local/replicas/02 is the last replica, will remove table 2024.10.22 13:39:34.174346 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Removing table /clickhouse/tables/01/measurements_histogramf64_local (this might take several minutes) 2024.10.22 13:39:34.217463 [ 221628 ] {} oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64): Table /clickhouse/tables/01/measurements_histogramf64_local was successfully removed from ZooKeeper 2024.10.22 13:39:34.217499 [ 221628 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramf64_local.bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64.sql of dropped table oximeter.measurements_histogramf64_local (bc50b9f7-4d3e-43ec-82cd-eef6b8cf7a64) 2024.10.22 13:39:34.217637 [ 221779 ] {cbcf7051-0a72-4d86-86cb-f1eb79882687} DDLWorker: Executed query: /* ddl_entry=query-0000000120 */ DROP TABLE IF EXISTS oximeter.measurements_histogramf64_local SYNC 2024.10.22 13:39:34.221219 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:34.221367 [ 221589 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Scheduling next merge selecting task after 7777ms 2024.10.22 13:39:34.278440 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:34.278448 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:34.281885 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=122, queue_size=122, entries=query-0000000000..query-0000000121, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000120, last_skipped_entry_name=none 2024.10.22 13:39:34.281900 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000121 2024.10.22 13:39:34.281907 [ 221779 ] {} DDLWorker: Checking task query-0000000121 2024.10.22 13:39:34.282284 [ 221779 ] {} DDLWorker: Processing task query-0000000121 (DROP TABLE IF EXISTS oximeter.measurements_histogramf64 SYNC) 2024.10.22 13:39:34.290126 [ 221779 ] {} DDLWorker: Executing query: DROP TABLE IF EXISTS oximeter.measurements_histogramf64 SYNC 2024.10.22 13:39:34.290230 [ 221779 ] {6290c6fe-6947-41d6-8555-e91065b84ad7} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c6035e0f-66a5-4de6-a4d2-911ace194261) /* ddl_entry=query-0000000121 */ DROP TABLE IF EXISTS oximeter.measurements_histogramf64 SYNC (stage: Complete) 2024.10.22 13:39:34.290264 [ 221779 ] {6290c6fe-6947-41d6-8555-e91065b84ad7} StorageDistributed (measurements_histogramf64): Joining background threads for async INSERT 2024.10.22 13:39:34.290275 [ 221779 ] {6290c6fe-6947-41d6-8555-e91065b84ad7} StorageDistributed (measurements_histogramf64): Background threads for async INSERT joined 2024.10.22 13:39:34.290357 [ 221779 ] {6290c6fe-6947-41d6-8555-e91065b84ad7} DatabaseCatalog: Waiting for table 729c812b-7b1a-4d5b-9e4a-b032642a6dfc to be finally dropped 2024.10.22 13:39:34.290378 [ 221618 ] {} DatabaseCatalog: Have 1 tables in drop queue (0 of them are in use), will try drop oximeter.measurements_histogramf64 (729c812b-7b1a-4d5b-9e4a-b032642a6dfc) 2024.10.22 13:39:34.290402 [ 221618 ] {} StorageDistributed (measurements_histogramf64): Joining background threads for async INSERT 2024.10.22 13:39:34.290410 [ 221618 ] {} StorageDistributed (measurements_histogramf64): Background threads for async INSERT joined 2024.10.22 13:39:34.290417 [ 221618 ] {} StorageDistributed (measurements_histogramf64): Removing pending blocks for async INSERT from filesystem on DROP TABLE 2024.10.22 13:39:34.290491 [ 221618 ] {} StorageDistributed (measurements_histogramf64): Removed 2024.10.22 13:39:34.290515 [ 221618 ] {} DatabaseCatalog: Removing metadata /var/tmp/omicron_tmp/oximeter_db-febbef400f51ee2f-check_db_init_is_sum_of_all_up_replicated.219807.5-clickhouse-VTZB38/datastore/metadata_dropped/oximeter.measurements_histogramf64.729c812b-7b1a-4d5b-9e4a-b032642a6dfc.sql of dropped table oximeter.measurements_histogramf64 (729c812b-7b1a-4d5b-9e4a-b032642a6dfc) 2024.10.22 13:39:34.290641 [ 221779 ] {6290c6fe-6947-41d6-8555-e91065b84ad7} DDLWorker: Executed query: /* ddl_entry=query-0000000121 */ DROP TABLE IF EXISTS oximeter.measurements_histogramf64 SYNC 2024.10.22 13:39:34.299173 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:34.393617 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:34.393620 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:34.397362 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=123, queue_size=123, entries=query-0000000000..query-0000000122, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000121, last_skipped_entry_name=none 2024.10.22 13:39:34.397381 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000122 2024.10.22 13:39:34.397388 [ 221779 ] {} DDLWorker: Checking task query-0000000122 2024.10.22 13:39:34.397932 [ 221779 ] {} DDLWorker: Processing task query-0000000122 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64_local UUID '06ab915c-d456-4833-bd24-11a0b51f3286' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.10.22 13:39:34.407360 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64_local UUID '06ab915c-d456-4833-bd24-11a0b51f3286' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:34.407569 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ee95681c-e466-4b95-b07e-273336e285ef) /* ddl_entry=query-0000000122 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64_local UUID '06ab915c-d456-4833-bd24-11a0b51f3286' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:34.412064 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Loading data parts 2024.10.22 13:39:34.412322 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): There are no data parts 2024.10.22 13:39:34.417212 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Creating table /clickhouse/tables/01/measurements_histogramf64_local 2024.10.22 13:39:34.425135 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): It looks like the table /clickhouse/tables/01/measurements_histogramf64_local was created by another server at the same moment, will retry 2024.10.22 13:39:34.425280 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): This table /clickhouse/tables/01/measurements_histogramf64_local is already created, will add new replica 2024.10.22 13:39:34.434240 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Creating replica /clickhouse/tables/01/measurements_histogramf64_local/replicas/02 2024.10.22 13:39:34.464304 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Creating shared ID for table oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286) 2024.10.22 13:39:34.464439 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Initializing table shared ID with 06ab915c-d456-4833-bd24-11a0b51f3286 2024.10.22 13:39:34.469499 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Starting up table 2024.10.22 13:39:34.472697 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Became leader 2024.10.22 13:39:34.472712 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.10.22 13:39:34.472740 [ 221665 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.10.22 13:39:34.472763 [ 221665 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.10.22 13:39:34.479688 [ 221665 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Replica 01 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.10.22 13:39:34.479718 [ 221665 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Will mimic 01 2024.10.22 13:39:34.485857 [ 221665 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Queued 0 parts to be fetched, 0 parts ignored 2024.10.22 13:39:34.485871 [ 221665 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Copied 0 queue entries, 0 entries ignored 2024.10.22 13:39:34.485994 [ 221665 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Parts in ZooKeeper after mimic: 2024.10.22 13:39:34.486015 [ 221665 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Enqueued fetches after mimic: 2024.10.22 13:39:34.491701 [ 221665 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.10.22 13:39:34.491890 [ 221665 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.10.22 13:39:34.491902 [ 221665 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01/measurements_histogramf64_local/replicas/02/queue 2024.10.22 13:39:34.492024 [ 221665 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.10.22 13:39:34.492139 [ 221665 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.10.22 13:39:34.493074 [ 221665 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.10.22 13:39:34.493101 [ 221637 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 6414ms 2024.10.22 13:39:34.494034 [ 221779 ] {00f9cecb-7976-4bae-ac62-875094fbd120} DDLWorker: Executed query: /* ddl_entry=query-0000000122 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64_local UUID '06ab915c-d456-4833-bd24-11a0b51f3286' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_histogramf64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.10.22 13:39:34.498000 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:34.514101 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:34.514104 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:34.514343 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=124, queue_size=124, entries=query-0000000000..query-0000000123, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000122, last_skipped_entry_name=none 2024.10.22 13:39:34.514358 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000123 2024.10.22 13:39:34.514364 [ 221779 ] {} DDLWorker: Checking task query-0000000123 2024.10.22 13:39:34.518384 [ 221779 ] {} DDLWorker: Processing task query-0000000123 (CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64 UUID '593641fe-8976-49bf-9e87-cdcb0d1543e0' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.10.22 13:39:34.523780 [ 221779 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64 UUID '593641fe-8976-49bf-9e87-cdcb0d1543e0' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:34.524052 [ 221779 ] {0f7bd61c-7838-4cfb-8d42-71f065c498fb} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: a49eaed0-df5d-4ff2-a2b7-cb8734bdc59c) /* ddl_entry=query-0000000123 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64 UUID '593641fe-8976-49bf-9e87-cdcb0d1543e0' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.10.22 13:39:34.524670 [ 221779 ] {0f7bd61c-7838-4cfb-8d42-71f065c498fb} StorageDistributed (measurements_histogramf64): Auto-increment is 0 2024.10.22 13:39:34.528323 [ 221779 ] {0f7bd61c-7838-4cfb-8d42-71f065c498fb} DDLWorker: Executed query: /* ddl_entry=query-0000000123 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64 UUID '593641fe-8976-49bf-9e87-cdcb0d1543e0' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `bins` Array(Float64), `counts` Array(UInt64), `min` Float64, `max` Float64, `sum_of_samples` Float64, `squared_mean` Float64, `p50_marker_heights` Array(Float64), `p50_marker_positions` Array(UInt64), `p50_desired_marker_positions` Array(Float64), `p90_marker_heights` Array(Float64), `p90_marker_positions` Array(UInt64), `p90_desired_marker_positions` Array(Float64), `p99_marker_heights` Array(Float64), `p99_marker_positions` Array(UInt64), `p99_desired_marker_positions` Array(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_histogramf64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.10.22 13:39:34.532157 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:34.547275 [ 221595 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 9795ms 2024.10.22 13:39:34.643374 [ 221596 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000003 - log-0000000003 2024.10.22 13:39:34.653368 [ 221596 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000003 to queue with type GET_PART with virtual parts [all_3_3_0] 2024.10.22 13:39:34.653390 [ 221596 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:34.653935 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_3_3_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:34.654217 [ 221734 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_3_3_0&client_protocol_version=8&compress=false 2024.10.22 13:39:34.655127 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:34.655149 [ 221734 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.38 GiB. 2024.10.22 13:39:34.655164 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:39:34.655177 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_3_3_0 onto disk default. 2024.10.22 13:39:34.656088 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_3_3_0 onto disk default finished. 2024.10.22 13:39:34.656110 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_3_3_0 to all_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:34.656152 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_3_3_0 to zookeeper 2024.10.22 13:39:34.660279 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_3_3_0 committed to zookeeper 2024.10.22 13:39:34.660332 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_3_3_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:34.660398 [ 221531 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=88785160192, merge_with_ttl_allowedtrue) 2024.10.22 13:39:34.660431 [ 221531 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 20037ms 2024.10.22 13:39:34.687298 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:34.687302 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:34.690860 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=125, queue_size=125, entries=query-0000000000..query-0000000124, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000123, last_skipped_entry_name=none 2024.10.22 13:39:34.690876 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000124 2024.10.22 13:39:34.690880 [ 221779 ] {} DDLWorker: Checking task query-0000000124 2024.10.22 13:39:34.691280 [ 221779 ] {} DDLWorker: Processing task query-0000000124 (ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:34.697641 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:34.740341 [ 221599 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:34.740617 [ 221599 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:34.740691 [ 221616 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:34.740701 [ 221616 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:34.744509 [ 221779 ] {} DDLWorker: Task query-0000000124 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:34.744644 [ 221599 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 12732ms 2024.10.22 13:39:34.744650 [ 221779 ] {} DDLWorker: Task query-0000000124 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:34.752013 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:34.763518 [ 221616 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:34.784084 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1629 entries to flush up to offset 4996 2024.10.22 13:39:34.785231 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:34.785256 [ 221768 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.37 GiB. 2024.10.22 13:39:34.785797 [ 221768 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 13:39:34.786172 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:34.786308 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 4996 2024.10.22 13:39:34.806633 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:34.806643 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:34.810008 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=126, queue_size=126, entries=query-0000000000..query-0000000125, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000124, last_skipped_entry_name=none 2024.10.22 13:39:34.810019 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000125 2024.10.22 13:39:34.810023 [ 221779 ] {} DDLWorker: Checking task query-0000000125 2024.10.22 13:39:34.810418 [ 221779 ] {} DDLWorker: Processing task query-0000000125 (ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:34.814135 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:34.862714 [ 221548 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:34.866196 [ 221548 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:34.866242 [ 221537 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:34.866270 [ 221537 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:34.866915 [ 221548 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 10324ms 2024.10.22 13:39:34.870447 [ 221779 ] {} DDLWorker: Task query-0000000125 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:34.870599 [ 221779 ] {} DDLWorker: Task query-0000000125 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:34.877999 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:34.885146 [ 221537 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:34.930145 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:34.930145 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:34.936355 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=127, queue_size=127, entries=query-0000000000..query-0000000126, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000125, last_skipped_entry_name=none 2024.10.22 13:39:34.936376 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000126 2024.10.22 13:39:34.936383 [ 221779 ] {} DDLWorker: Checking task query-0000000126 2024.10.22 13:39:34.936959 [ 221779 ] {} DDLWorker: Processing task query-0000000126 (ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:34.942802 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:34.997888 [ 221779 ] {5574a072-ef45-4844-b0e8-7cd699a55699} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 66a2acc3-4657-4b06-a112-893bb9b426bd) /* ddl_entry=query-0000000126 */ ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:35.000975 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 403.99 MiB, peak 412.18 MiB, free memory in arenas 20.84 MiB, will set to 402.88 MiB (RSS), difference: -1.11 MiB 2024.10.22 13:39:35.006956 [ 221779 ] {5574a072-ef45-4844-b0e8-7cd699a55699} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:35.007003 [ 221577 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:35.007031 [ 221639 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 10013ms 2024.10.22 13:39:35.007086 [ 221779 ] {5574a072-ef45-4844-b0e8-7cd699a55699} DDLWorker: Executed query: /* ddl_entry=query-0000000126 */ ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.007102 [ 221779 ] {} DDLWorker: Task query-0000000126 executed by current replica 2024.10.22 13:39:35.007221 [ 221577 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:35.007266 [ 221576 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:35.007287 [ 221576 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:35.014175 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:35.023179 [ 221576 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:35.023207 [ 221577 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 13158ms 2024.10.22 13:39:35.047855 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:35.047865 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:35.048108 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=128, queue_size=128, entries=query-0000000000..query-0000000127, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000126, last_skipped_entry_name=none 2024.10.22 13:39:35.048125 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000127 2024.10.22 13:39:35.048132 [ 221779 ] {} DDLWorker: Checking task query-0000000127 2024.10.22 13:39:35.052026 [ 221779 ] {} DDLWorker: Processing task query-0000000127 (ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:35.055647 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.109708 [ 221779 ] {adf67171-9c6c-4147-bb51-ac2d9021a7d2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b8a0bd44-cd18-4a77-8fa4-0d97ee91309a) /* ddl_entry=query-0000000127 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:35.119469 [ 221779 ] {adf67171-9c6c-4147-bb51-ac2d9021a7d2} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:35.119535 [ 221571 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 12217ms 2024.10.22 13:39:35.119586 [ 221779 ] {adf67171-9c6c-4147-bb51-ac2d9021a7d2} DDLWorker: Executed query: /* ddl_entry=query-0000000127 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.119630 [ 221779 ] {} DDLWorker: Task query-0000000127 executed by current replica 2024.10.22 13:39:35.119636 [ 221631 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:35.125306 [ 221631 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:35.125368 [ 221631 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:35.125386 [ 221631 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:35.128798 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:35.131922 [ 221630 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 15480ms 2024.10.22 13:39:35.139150 [ 221631 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:35.166136 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:35.166145 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:35.169796 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=129, queue_size=129, entries=query-0000000000..query-0000000128, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000127, last_skipped_entry_name=none 2024.10.22 13:39:35.169816 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000128 2024.10.22 13:39:35.169823 [ 221779 ] {} DDLWorker: Checking task query-0000000128 2024.10.22 13:39:35.170255 [ 221779 ] {} DDLWorker: Processing task query-0000000128 (ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:35.174734 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.197794 [ 221632 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 9859ms 2024.10.22 13:39:35.221252 [ 221642 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:35.226472 [ 221779 ] {} DDLWorker: Task query-0000000128 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:35.226515 [ 221642 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:35.226553 [ 221642 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:35.226570 [ 221642 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:35.226674 [ 221779 ] {} DDLWorker: Task query-0000000128 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:35.233085 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:35.240780 [ 221642 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:35.241197 [ 221526 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 12467ms 2024.10.22 13:39:35.283289 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:35.283297 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:35.287187 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=130, queue_size=130, entries=query-0000000000..query-0000000129, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000128, last_skipped_entry_name=none 2024.10.22 13:39:35.287205 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000129 2024.10.22 13:39:35.287213 [ 221779 ] {} DDLWorker: Checking task query-0000000129 2024.10.22 13:39:35.287843 [ 221779 ] {} DDLWorker: Processing task query-0000000129 (ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:35.296248 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.345711 [ 221586 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:35.345987 [ 221586 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:35.346894 [ 221586 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:35.346914 [ 221586 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:35.351208 [ 221779 ] {} DDLWorker: Task query-0000000129 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:35.355722 [ 221779 ] {} DDLWorker: Task query-0000000129 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:35.359417 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:35.367418 [ 221586 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:35.367812 [ 221633 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 9972ms 2024.10.22 13:39:35.398006 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:35.398045 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:35.398228 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=131, queue_size=131, entries=query-0000000000..query-0000000130, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000129, last_skipped_entry_name=none 2024.10.22 13:39:35.398240 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000130 2024.10.22 13:39:35.398245 [ 221779 ] {} DDLWorker: Checking task query-0000000130 2024.10.22 13:39:35.402117 [ 221779 ] {} DDLWorker: Processing task query-0000000130 (ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:35.406541 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.411606 [ 221606 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 7917ms 2024.10.22 13:39:35.450884 [ 221779 ] {b9d2d497-b887-4123-a645-bb10d279009b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 10167e10-8c6c-4cfe-8a9d-23f2735ce274) /* ddl_entry=query-0000000130 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:35.461903 [ 221779 ] {b9d2d497-b887-4123-a645-bb10d279009b} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:35.461974 [ 221578 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 13189ms 2024.10.22 13:39:35.462011 [ 221779 ] {b9d2d497-b887-4123-a645-bb10d279009b} DDLWorker: Executed query: /* ddl_entry=query-0000000130 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.462031 [ 221779 ] {} DDLWorker: Task query-0000000130 executed by current replica 2024.10.22 13:39:35.462851 [ 221629 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:35.466747 [ 221629 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:35.466787 [ 221629 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:35.466800 [ 221629 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:35.470599 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:35.480375 [ 221629 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:35.480591 [ 221603 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 17290ms 2024.10.22 13:39:35.526634 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:35.526675 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:35.526896 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=132, queue_size=132, entries=query-0000000000..query-0000000131, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000130, last_skipped_entry_name=none 2024.10.22 13:39:35.526908 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000131 2024.10.22 13:39:35.526917 [ 221779 ] {} DDLWorker: Checking task query-0000000131 2024.10.22 13:39:35.530611 [ 221779 ] {} DDLWorker: Processing task query-0000000131 (ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:35.534386 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.579799 [ 221618 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:35.583710 [ 221618 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:35.583751 [ 221591 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:35.583773 [ 221591 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:35.583939 [ 221779 ] {} DDLWorker: Task query-0000000131 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:35.587552 [ 221779 ] {} DDLWorker: Task query-0000000131 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:35.591359 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:35.591788 [ 221618 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 12599ms 2024.10.22 13:39:35.598744 [ 221591 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:35.651769 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:35.651778 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:35.657729 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=133, queue_size=133, entries=query-0000000000..query-0000000132, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000131, last_skipped_entry_name=none 2024.10.22 13:39:35.657741 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000132 2024.10.22 13:39:35.657748 [ 221779 ] {} DDLWorker: Checking task query-0000000132 2024.10.22 13:39:35.658218 [ 221779 ] {} DDLWorker: Processing task query-0000000132 (ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:35.664914 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.700022 [ 221779 ] {687d77e3-f982-49ea-9c1a-dc1a82c8d4e5} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: a7c60729-44af-451c-806d-9c1f5696ad31) /* ddl_entry=query-0000000132 */ ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:35.706505 [ 221779 ] {687d77e3-f982-49ea-9c1a-dc1a82c8d4e5} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:35.706561 [ 221640 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 7660ms 2024.10.22 13:39:35.706606 [ 221779 ] {687d77e3-f982-49ea-9c1a-dc1a82c8d4e5} DDLWorker: Executed query: /* ddl_entry=query-0000000132 */ ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.706625 [ 221779 ] {} DDLWorker: Task query-0000000132 executed by current replica 2024.10.22 13:39:35.706646 [ 221622 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:35.711187 [ 221622 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:35.711239 [ 221622 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:35.711250 [ 221622 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:35.715681 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:35.726537 [ 221622 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:35.726836 [ 221664 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 9206ms 2024.10.22 13:39:35.772630 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:35.772634 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:35.776317 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=134, queue_size=134, entries=query-0000000000..query-0000000133, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000132, last_skipped_entry_name=none 2024.10.22 13:39:35.776335 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000133 2024.10.22 13:39:35.776339 [ 221779 ] {} DDLWorker: Checking task query-0000000133 2024.10.22 13:39:35.776756 [ 221779 ] {} DDLWorker: Processing task query-0000000133 (ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:35.783200 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.833140 [ 221666 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:35.838946 [ 221779 ] {} DDLWorker: Task query-0000000133 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:35.839014 [ 221666 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:35.839061 [ 221666 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:35.839068 [ 221666 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:35.842372 [ 221779 ] {} DDLWorker: Task query-0000000133 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:35.846161 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:35.853751 [ 221666 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:35.854386 [ 221527 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 8247ms 2024.10.22 13:39:35.887426 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:35.887430 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:35.887715 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=135, queue_size=135, entries=query-0000000000..query-0000000134, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000133, last_skipped_entry_name=none 2024.10.22 13:39:35.887733 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000134 2024.10.22 13:39:35.887741 [ 221779 ] {} DDLWorker: Checking task query-0000000134 2024.10.22 13:39:35.891420 [ 221779 ] {} DDLWorker: Processing task query-0000000134 (ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:35.894875 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.937676 [ 221779 ] {a8a0f569-83f4-4ce4-ad2b-b1619ff27241} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 495c99d2-efa3-493f-bf6b-82ed720711e6) /* ddl_entry=query-0000000134 */ ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:35.945521 [ 221779 ] {a8a0f569-83f4-4ce4-ad2b-b1619ff27241} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:35.945583 [ 221575 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 7793ms 2024.10.22 13:39:35.945621 [ 221779 ] {a8a0f569-83f4-4ce4-ad2b-b1619ff27241} DDLWorker: Executed query: /* ddl_entry=query-0000000134 */ ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:35.945636 [ 221779 ] {} DDLWorker: Task query-0000000134 executed by current replica 2024.10.22 13:39:35.945766 [ 221582 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:35.949197 [ 221582 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:35.949313 [ 221572 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:35.949328 [ 221572 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:35.952459 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:35.956200 [ 221597 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 10267ms 2024.10.22 13:39:35.964078 [ 221572 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:36.014113 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:36.014118 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:36.021171 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=136, queue_size=136, entries=query-0000000000..query-0000000135, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000134, last_skipped_entry_name=none 2024.10.22 13:39:36.021189 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000135 2024.10.22 13:39:36.021196 [ 221779 ] {} DDLWorker: Checking task query-0000000135 2024.10.22 13:39:36.021606 [ 221779 ] {} DDLWorker: Processing task query-0000000135 (ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:36.025485 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.075708 [ 221551 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:36.080952 [ 221779 ] {} DDLWorker: Task query-0000000135 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:36.080975 [ 221551 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:36.081024 [ 221551 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:36.081033 [ 221551 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:36.081141 [ 221779 ] {} DDLWorker: Task query-0000000135 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:36.088033 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:36.094927 [ 221551 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:36.099080 [ 221601 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 7719ms 2024.10.22 13:39:36.136384 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:36.136384 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:36.140048 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=137, queue_size=137, entries=query-0000000000..query-0000000136, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000135, last_skipped_entry_name=none 2024.10.22 13:39:36.140068 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000136 2024.10.22 13:39:36.140075 [ 221779 ] {} DDLWorker: Checking task query-0000000136 2024.10.22 13:39:36.140524 [ 221779 ] {} DDLWorker: Processing task query-0000000136 (ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:36.145680 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.161374 [ 221565 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 7646ms 2024.10.22 13:39:36.181768 [ 221779 ] {94688724-ccb3-4ad5-9df3-6a635a329d91} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8c03e257-799b-4c05-aac3-2d985f18cd72) /* ddl_entry=query-0000000136 */ ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:36.190409 [ 221779 ] {94688724-ccb3-4ad5-9df3-6a635a329d91} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:36.190473 [ 221570 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 8043ms 2024.10.22 13:39:36.190527 [ 221779 ] {94688724-ccb3-4ad5-9df3-6a635a329d91} DDLWorker: Executed query: /* ddl_entry=query-0000000136 */ ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.190544 [ 221779 ] {} DDLWorker: Task query-0000000136 executed by current replica 2024.10.22 13:39:36.190627 [ 221607 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:36.193518 [ 221607 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:36.193563 [ 221545 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:36.193581 [ 221545 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:36.196045 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:36.199869 [ 221607 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 9692ms 2024.10.22 13:39:36.207092 [ 221545 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:36.252170 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:36.252174 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:36.252403 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=138, queue_size=138, entries=query-0000000000..query-0000000137, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000136, last_skipped_entry_name=none 2024.10.22 13:39:36.252420 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000137 2024.10.22 13:39:36.252431 [ 221779 ] {} DDLWorker: Checking task query-0000000137 2024.10.22 13:39:36.255674 [ 221779 ] {} DDLWorker: Processing task query-0000000137 (ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:36.259122 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.282579 [ 221763 ] {} SystemLog (system.part_log): Flushing system log, 2 entries to flush up to offset 4 2024.10.22 13:39:36.283423 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:36.284139 [ 221763 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.37 GiB. 2024.10.22 13:39:36.284554 [ 221763 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 13:39:36.284693 [ 221771 ] {} SystemLog (system.trace_log): Flushing system log, 3 entries to flush up to offset 18 2024.10.22 13:39:36.284886 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:36.285054 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:36.286143 [ 221771 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.37 GiB. 2024.10.22 13:39:36.286286 [ 221763 ] {} SystemLog (system.part_log): Flushed system log up to offset 4 2024.10.22 13:39:36.286459 [ 221771 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 13:39:36.286705 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:36.286996 [ 221771 ] {} SystemLog (system.trace_log): Flushed system log up to offset 18 2024.10.22 13:39:36.293020 [ 221779 ] {fff1a9be-c4c0-4ade-9d2b-49527c44e628} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c8fa473b-f7b5-427b-aaad-475d68342ad8) /* ddl_entry=query-0000000137 */ ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:36.299239 [ 221770 ] {} SystemLog (system.query_log): Flushing system log, 92 entries to flush up to offset 260 2024.10.22 13:39:36.301507 [ 221779 ] {fff1a9be-c4c0-4ade-9d2b-49527c44e628} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:36.301610 [ 221608 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:36.301882 [ 221779 ] {fff1a9be-c4c0-4ade-9d2b-49527c44e628} DDLWorker: Executed query: /* ddl_entry=query-0000000137 */ ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.301906 [ 221779 ] {} DDLWorker: Task query-0000000137 executed by current replica 2024.10.22 13:39:36.301952 [ 221602 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 10224ms 2024.10.22 13:39:36.302035 [ 221608 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:36.302071 [ 221608 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:36.302079 [ 221608 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:36.304162 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:36.304189 [ 221770 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.37 GiB. 2024.10.22 13:39:36.305842 [ 221770 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 13:39:36.307836 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:36.308152 [ 221770 ] {} SystemLog (system.query_log): Flushed system log up to offset 260 2024.10.22 13:39:36.308345 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:36.316880 [ 221608 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:36.321723 [ 221549 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 13270ms 2024.10.22 13:39:36.343399 [ 221765 ] {} SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 23 2024.10.22 13:39:36.354869 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:36.354896 [ 221765 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.37 GiB. 2024.10.22 13:39:36.359997 [ 221765 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 13:39:36.366508 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:36.369838 [ 221765 ] {} SystemLog (system.metric_log): Flushed system log up to offset 23 2024.10.22 13:39:36.371511 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:36.371519 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:36.375211 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=139, queue_size=139, entries=query-0000000000..query-0000000138, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000137, last_skipped_entry_name=none 2024.10.22 13:39:36.375227 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000138 2024.10.22 13:39:36.375233 [ 221779 ] {} DDLWorker: Checking task query-0000000138 2024.10.22 13:39:36.375641 [ 221779 ] {} DDLWorker: Processing task query-0000000138 (ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:36.379135 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.424074 [ 221779 ] {53ae6cd5-ab2b-4ff1-a007-1b8777f54b17} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 3df8ade1-5807-43dc-87ef-e3fae7aaa997) /* ddl_entry=query-0000000138 */ ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:36.431754 [ 221779 ] {53ae6cd5-ab2b-4ff1-a007-1b8777f54b17} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:36.431821 [ 221630 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 8269ms 2024.10.22 13:39:36.431859 [ 221779 ] {53ae6cd5-ab2b-4ff1-a007-1b8777f54b17} DDLWorker: Executed query: /* ddl_entry=query-0000000138 */ ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.431886 [ 221779 ] {} DDLWorker: Task query-0000000138 executed by current replica 2024.10.22 13:39:36.431887 [ 221641 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:36.436490 [ 221641 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:36.436563 [ 221641 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:36.436575 [ 221641 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:36.442448 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:36.446548 [ 221631 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 10369ms 2024.10.22 13:39:36.451489 [ 221641 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:36.491500 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:36.491535 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:36.495090 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=140, queue_size=140, entries=query-0000000000..query-0000000139, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000138, last_skipped_entry_name=none 2024.10.22 13:39:36.495103 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000139 2024.10.22 13:39:36.495107 [ 221779 ] {} DDLWorker: Checking task query-0000000139 2024.10.22 13:39:36.496341 [ 221779 ] {} DDLWorker: Processing task query-0000000139 (ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:36.499778 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.533483 [ 221779 ] {e59dc0b1-2ac7-4f89-ac7a-15cbc34324ce} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f9962196-4209-444b-9596-8f53a636d648) /* ddl_entry=query-0000000139 */ ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:36.542882 [ 221779 ] {e59dc0b1-2ac7-4f89-ac7a-15cbc34324ce} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:36.542958 [ 221647 ] {} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Scheduling next merge selecting task after 8233ms 2024.10.22 13:39:36.542986 [ 221779 ] {e59dc0b1-2ac7-4f89-ac7a-15cbc34324ce} DDLWorker: Executed query: /* ddl_entry=query-0000000139 */ ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.543008 [ 221779 ] {} DDLWorker: Task query-0000000139 executed by current replica 2024.10.22 13:39:36.543046 [ 221530 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:36.546383 [ 221530 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:36.546442 [ 221627 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:36.546457 [ 221627 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:36.550652 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:36.554712 [ 221530 ] {} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Scheduling next merge selecting task after 10842ms 2024.10.22 13:39:36.564048 [ 221627 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:36.606117 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:36.606124 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:36.609503 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=141, queue_size=141, entries=query-0000000000..query-0000000140, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000139, last_skipped_entry_name=none 2024.10.22 13:39:36.609515 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000140 2024.10.22 13:39:36.609519 [ 221779 ] {} DDLWorker: Checking task query-0000000140 2024.10.22 13:39:36.609843 [ 221779 ] {} DDLWorker: Processing task query-0000000140 (ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:36.617105 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.656744 [ 221620 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:36.658452 [ 221620 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:36.658498 [ 221581 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:36.658520 [ 221581 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:36.661826 [ 221779 ] {} DDLWorker: Task query-0000000140 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:36.662010 [ 221779 ] {} DDLWorker: Task query-0000000140 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:36.669953 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:36.674390 [ 221581 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:36.674663 [ 221620 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 8291ms 2024.10.22 13:39:36.721134 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:36.721138 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:36.721385 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=142, queue_size=142, entries=query-0000000000..query-0000000141, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000140, last_skipped_entry_name=none 2024.10.22 13:39:36.721398 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000141 2024.10.22 13:39:36.721405 [ 221779 ] {} DDLWorker: Checking task query-0000000141 2024.10.22 13:39:36.726868 [ 221779 ] {} DDLWorker: Processing task query-0000000141 (ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:36.731838 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.783483 [ 221578 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:36.783672 [ 221578 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:36.783704 [ 221578 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:36.783709 [ 221578 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:36.786418 [ 221779 ] {} DDLWorker: Task query-0000000141 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:36.786661 [ 221779 ] {} DDLWorker: Task query-0000000141 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:36.796666 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:36.800445 [ 221578 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:36.800738 [ 221556 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 9994ms 2024.10.22 13:39:36.838025 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:36.838036 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:36.838234 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=143, queue_size=143, entries=query-0000000000..query-0000000142, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000141, last_skipped_entry_name=none 2024.10.22 13:39:36.838247 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000142 2024.10.22 13:39:36.838259 [ 221779 ] {} DDLWorker: Checking task query-0000000142 2024.10.22 13:39:36.841578 [ 221779 ] {} DDLWorker: Processing task query-0000000142 (ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:36.844830 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.882534 [ 221779 ] {cff286fd-cf27-4e8e-85cf-c9530a40eed6} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5503b94c-d571-4940-a5fc-a510319e3789) /* ddl_entry=query-0000000142 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:36.894407 [ 221779 ] {cff286fd-cf27-4e8e-85cf-c9530a40eed6} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:36.894479 [ 221654 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 12322ms 2024.10.22 13:39:36.894493 [ 221779 ] {cff286fd-cf27-4e8e-85cf-c9530a40eed6} DDLWorker: Executed query: /* ddl_entry=query-0000000142 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:36.894513 [ 221779 ] {} DDLWorker: Task query-0000000142 executed by current replica 2024.10.22 13:39:36.894517 [ 221539 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:36.897876 [ 221539 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:36.897919 [ 221539 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:36.897930 [ 221539 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:36.902222 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:36.906779 [ 221618 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 14896ms 2024.10.22 13:39:36.914296 [ 221539 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:36.955522 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:36.955528 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:36.958320 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=144, queue_size=144, entries=query-0000000000..query-0000000143, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000142, last_skipped_entry_name=none 2024.10.22 13:39:36.958346 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000143 2024.10.22 13:39:36.958354 [ 221779 ] {} DDLWorker: Checking task query-0000000143 2024.10.22 13:39:36.958727 [ 221779 ] {} DDLWorker: Processing task query-0000000143 (ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:36.963798 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.000393 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 404.42 MiB, peak 412.39 MiB, free memory in arenas 30.41 MiB, will set to 412.47 MiB (RSS), difference: 8.05 MiB 2024.10.22 13:39:37.002846 [ 221779 ] {3cbdd5c6-558f-48fc-900c-643bd7eb83b1} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 56a3363f-3e96-439c-8be0-74d1328b8c17) /* ddl_entry=query-0000000143 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:37.008884 [ 221779 ] {3cbdd5c6-558f-48fc-900c-643bd7eb83b1} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:37.008941 [ 221659 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 12271ms 2024.10.22 13:39:37.008965 [ 221779 ] {3cbdd5c6-558f-48fc-900c-643bd7eb83b1} DDLWorker: Executed query: /* ddl_entry=query-0000000143 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.008981 [ 221779 ] {} DDLWorker: Task query-0000000143 executed by current replica 2024.10.22 13:39:37.009016 [ 221558 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:37.012534 [ 221558 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:37.012578 [ 221622 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:37.012602 [ 221622 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:37.019256 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:37.023678 [ 221558 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 15254ms 2024.10.22 13:39:37.028623 [ 221622 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:37.072276 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:37.072281 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:37.072484 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=145, queue_size=145, entries=query-0000000000..query-0000000144, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000143, last_skipped_entry_name=none 2024.10.22 13:39:37.072500 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000144 2024.10.22 13:39:37.072505 [ 221779 ] {} DDLWorker: Checking task query-0000000144 2024.10.22 13:39:37.076004 [ 221779 ] {} DDLWorker: Processing task query-0000000144 (ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:37.080923 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.137239 [ 221665 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:37.137245 [ 221779 ] {} DDLWorker: Task query-0000000144 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:37.137472 [ 221665 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:37.137507 [ 221663 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:37.137526 [ 221663 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:37.146310 [ 221779 ] {} DDLWorker: Task query-0000000144 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:37.154681 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:37.160147 [ 221663 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:37.160435 [ 221665 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 12206ms 2024.10.22 13:39:37.187929 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:37.187936 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:37.188138 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=146, queue_size=146, entries=query-0000000000..query-0000000145, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000144, last_skipped_entry_name=none 2024.10.22 13:39:37.188156 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000145 2024.10.22 13:39:37.188161 [ 221779 ] {} DDLWorker: Checking task query-0000000145 2024.10.22 13:39:37.193162 [ 221779 ] {} DDLWorker: Processing task query-0000000145 (ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:37.198362 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.240907 [ 221779 ] {88fc88ff-ffe9-40f1-8d2d-ae80664f7100} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5c9d1a00-81da-4cdf-8767-6c8a5eb3240a) /* ddl_entry=query-0000000145 */ ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:37.250655 [ 221779 ] {88fc88ff-ffe9-40f1-8d2d-ae80664f7100} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:37.250712 [ 221555 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 11418ms 2024.10.22 13:39:37.250732 [ 221779 ] {88fc88ff-ffe9-40f1-8d2d-ae80664f7100} DDLWorker: Executed query: /* ddl_entry=query-0000000145 */ ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.250744 [ 221779 ] {} DDLWorker: Task query-0000000145 executed by current replica 2024.10.22 13:39:37.250818 [ 221597 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:37.255725 [ 221597 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:37.255772 [ 221597 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:37.255785 [ 221597 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:37.261386 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:37.264604 [ 221546 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 14454ms 2024.10.22 13:39:37.276003 [ 221597 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:37.317993 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:37.318000 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:37.321028 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=147, queue_size=147, entries=query-0000000000..query-0000000146, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000145, last_skipped_entry_name=none 2024.10.22 13:39:37.321041 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000146 2024.10.22 13:39:37.321045 [ 221779 ] {} DDLWorker: Checking task query-0000000146 2024.10.22 13:39:37.321514 [ 221779 ] {} DDLWorker: Processing task query-0000000146 (ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:37.326795 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.384827 [ 221613 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:37.388613 [ 221779 ] {} DDLWorker: Task query-0000000146 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:37.388646 [ 221613 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:37.388697 [ 221613 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:37.388707 [ 221613 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:37.388732 [ 221779 ] {} DDLWorker: Task query-0000000146 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:37.392288 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:37.396786 [ 221613 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:37.397174 [ 221653 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 11756ms 2024.10.22 13:39:37.432084 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:37.432088 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:37.432331 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=148, queue_size=148, entries=query-0000000000..query-0000000147, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000146, last_skipped_entry_name=none 2024.10.22 13:39:37.432959 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000147 2024.10.22 13:39:37.432966 [ 221779 ] {} DDLWorker: Checking task query-0000000147 2024.10.22 13:39:37.435852 [ 221779 ] {} DDLWorker: Processing task query-0000000147 (ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:37.441845 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.497566 [ 221565 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:37.500906 [ 221779 ] {} DDLWorker: Task query-0000000147 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:37.500935 [ 221565 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:37.500974 [ 221570 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:37.500988 [ 221570 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:37.501061 [ 221779 ] {} DDLWorker: Task query-0000000147 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:37.513443 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:37.517215 [ 221570 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:37.517429 [ 221565 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 14127ms 2024.10.22 13:39:37.556999 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:37.557003 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:37.560712 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=149, queue_size=149, entries=query-0000000000..query-0000000148, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000147, last_skipped_entry_name=none 2024.10.22 13:39:37.560727 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000148 2024.10.22 13:39:37.560731 [ 221779 ] {} DDLWorker: Checking task query-0000000148 2024.10.22 13:39:37.561129 [ 221779 ] {} DDLWorker: Processing task query-0000000148 (ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:37.565391 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.611563 [ 221602 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:37.615139 [ 221602 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:37.615173 [ 221602 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:37.615184 [ 221602 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:37.615326 [ 221779 ] {} DDLWorker: Task query-0000000148 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:37.621125 [ 221779 ] {} DDLWorker: Task query-0000000148 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:37.624292 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:37.627612 [ 221602 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:37.631210 [ 221535 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 12595ms 2024.10.22 13:39:37.671618 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:37.671625 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:37.675150 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=150, queue_size=150, entries=query-0000000000..query-0000000149, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000148, last_skipped_entry_name=none 2024.10.22 13:39:37.675167 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000149 2024.10.22 13:39:37.675174 [ 221779 ] {} DDLWorker: Checking task query-0000000149 2024.10.22 13:39:37.675533 [ 221779 ] {} DDLWorker: Processing task query-0000000149 (ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:37.681280 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.730102 [ 221576 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:37.736419 [ 221779 ] {} DDLWorker: Task query-0000000149 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:37.736481 [ 221576 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:37.736519 [ 221579 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:37.736541 [ 221579 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:37.736628 [ 221779 ] {} DDLWorker: Task query-0000000149 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:37.742388 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:37.748546 [ 221579 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:37.748833 [ 221576 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 12931ms 2024.10.22 13:39:37.783678 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:37.783686 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:37.787213 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=151, queue_size=151, entries=query-0000000000..query-0000000150, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000149, last_skipped_entry_name=none 2024.10.22 13:39:37.787229 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000150 2024.10.22 13:39:37.787234 [ 221779 ] {} DDLWorker: Checking task query-0000000150 2024.10.22 13:39:37.787609 [ 221779 ] {} DDLWorker: Processing task query-0000000150 (ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:37.791752 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.827276 [ 221779 ] {703c556e-47e4-4136-aabb-8ad50549c668} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 3d9b190b-e28b-4ed1-932a-a99562d0d9b8) /* ddl_entry=query-0000000150 */ ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:37.838712 [ 221779 ] {703c556e-47e4-4136-aabb-8ad50549c668} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:37.838771 [ 221634 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 11684ms 2024.10.22 13:39:37.838813 [ 221779 ] {703c556e-47e4-4136-aabb-8ad50549c668} DDLWorker: Executed query: /* ddl_entry=query-0000000150 */ ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.838830 [ 221779 ] {} DDLWorker: Task query-0000000150 executed by current replica 2024.10.22 13:39:37.838916 [ 221641 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:37.842546 [ 221641 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:37.842589 [ 221560 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:37.842612 [ 221560 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:37.845835 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:37.852814 [ 221560 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:37.853151 [ 221641 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 14495ms 2024.10.22 13:39:37.896774 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:37.896781 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:37.896955 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=152, queue_size=152, entries=query-0000000000..query-0000000151, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000150, last_skipped_entry_name=none 2024.10.22 13:39:37.896965 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000151 2024.10.22 13:39:37.896970 [ 221779 ] {} DDLWorker: Checking task query-0000000151 2024.10.22 13:39:37.900442 [ 221779 ] {} DDLWorker: Processing task query-0000000151 (ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage')) 2024.10.22 13:39:37.903707 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.949654 [ 221779 ] {48e0ef75-1727-4ac9-b14b-4d17d1a1c2c7} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e9ea9aa3-a2ca-4ee4-8ed0-183eb3511306) /* ddl_entry=query-0000000151 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') (stage: Complete) 2024.10.22 13:39:37.957657 [ 221779 ] {48e0ef75-1727-4ac9-b14b-4d17d1a1c2c7} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:37.957739 [ 221779 ] {48e0ef75-1727-4ac9-b14b-4d17d1a1c2c7} DDLWorker: Executed query: /* ddl_entry=query-0000000151 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('bfd_session:message_recieve_error', 'instance_uuid:pv_panic_guest_handled', 'instance_uuid:pv_panic_host_handled', 'instance_uuid:reset', 'virtual_machine:pv_panic_guest_handled', 'virtual_machine:pv_panic_host_handled', 'virtual_machine:reset', 'virtual_machine:vcpu_usage') 2024.10.22 13:39:37.957755 [ 221779 ] {} DDLWorker: Task query-0000000151 executed by current replica 2024.10.22 13:39:37.957794 [ 221645 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 12593ms 2024.10.22 13:39:37.957806 [ 221647 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:37.961361 [ 221647 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:37.961402 [ 221647 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:37.961412 [ 221647 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:37.964642 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:37.971884 [ 221647 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:37.975643 [ 221530 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 15492ms 2024.10.22 13:39:38.000440 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 412.54 MiB, peak 412.54 MiB, free memory in arenas 26.19 MiB, will set to 408.68 MiB (RSS), difference: -3.86 MiB 2024.10.22 13:39:38.016002 [ 221626 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000004 - log-0000000004 2024.10.22 13:39:38.020771 [ 221626 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000004 to queue with type GET_PART with virtual parts [all_4_4_0] 2024.10.22 13:39:38.020789 [ 221626 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:38.024517 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_4_4_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:38.029504 [ 221730 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_4_4_0&client_protocol_version=8&compress=false 2024.10.22 13:39:38.030998 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:38.031023 [ 221730 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.36 GiB. 2024.10.22 13:39:38.031032 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:39:38.031044 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_4_4_0 onto disk default. 2024.10.22 13:39:38.031958 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_4_4_0 onto disk default finished. 2024.10.22 13:39:38.032010 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_4_4_0 to all_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:38.032061 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_4_4_0 to zookeeper 2024.10.22 13:39:38.035807 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_4_4_0 committed to zookeeper 2024.10.22 13:39:38.035857 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_4_4_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:38.035901 [ 221638 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Selected 5 parts from all_0_0_0 to all_4_4_0 2024.10.22 13:39:38.035915 [ 221638 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 1 partitions with parts that may be merged: [all](max_total_size_to_merge=88779155456, merge_with_ttl_allowedtrue) 2024.10.22 13:39:38.042350 [ 221638 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Selected 5 parts from all_0_0_0 to all_4_4_0 2024.10.22 13:39:38.048986 [ 221638 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Created log entry /clickhouse/tables/01/version/log/log-0000000005 for merge all_0_4_1 2024.10.22 13:39:38.049037 [ 221638 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Selected 5 parts from all_0_0_0 to all_4_4_0 2024.10.22 13:39:38.049048 [ 221638 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 1 partitions with parts that may be merged: [all](max_total_size_to_merge=88779122688, merge_with_ttl_allowedtrue) 2024.10.22 13:39:38.049376 [ 221619 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000005 - log-0000000005 2024.10.22 13:39:38.053693 [ 221619 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000005 to queue with type MERGE_PARTS with virtual parts [all_0_4_1] 2024.10.22 13:39:38.053710 [ 221619 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:38.053835 [ 221721 ] {} 6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1 (MergeFromLogEntryTask): Executing log entry to merge parts all_0_0_0, all_1_1_0, all_2_2_0, all_3_3_0, all_4_4_0 to all_0_4_1 2024.10.22 13:39:38.053882 [ 221721 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:38.053908 [ 221721 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.36 GiB. 2024.10.22 13:39:38.054021 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} MergeTask::PrepareStage: Merging 5 parts: from all_0_0_0 to all_4_4_0 into Compact with storage Full 2024.10.22 13:39:38.054077 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 13:39:38.054094 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} MergeTreeSequentialSource: Reading 2 marks from part all_0_0_0, total 1 rows starting from the beginning of the part 2024.10.22 13:39:38.054156 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} MergeTreeSequentialSource: Reading 2 marks from part all_1_1_0, total 1 rows starting from the beginning of the part 2024.10.22 13:39:38.054209 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} MergeTreeSequentialSource: Reading 2 marks from part all_2_2_0, total 1 rows starting from the beginning of the part 2024.10.22 13:39:38.054296 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} MergeTreeSequentialSource: Reading 2 marks from part all_3_3_0, total 1 rows starting from the beginning of the part 2024.10.22 13:39:38.054349 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} MergeTreeSequentialSource: Reading 2 marks from part all_4_4_0, total 1 rows starting from the beginning of the part 2024.10.22 13:39:38.055017 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} MergeTask::MergeProjectionsStage: Merge sorted 5 rows, containing 2 columns (2 merged, 0 gathered) in 0.00107375 sec., 4656.577415599534 rows/sec., 72.76 KiB/sec. 2024.10.22 13:39:38.055111 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} MergedBlockOutputStream: filled checksums all_0_4_1 (state Temporary) 2024.10.22 13:39:38.055308 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp_merge_all_0_4_1 to all_0_4_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:38.055353 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Merged 5 parts: [all_0_0_0, all_4_4_0] -> all_0_4_1 2024.10.22 13:39:38.055396 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_0_4_1 to zookeeper 2024.10.22 13:39:38.064906 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:38.064947 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:38.065175 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=153, queue_size=153, entries=query-0000000000..query-0000000152, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000151, last_skipped_entry_name=none 2024.10.22 13:39:38.066468 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000152 2024.10.22 13:39:38.066475 [ 221779 ] {} DDLWorker: Checking task query-0000000152 2024.10.22 13:39:38.074009 [ 221721 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_4_1} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_0_4_1 committed to zookeeper 2024.10.22 13:39:38.074034 [ 221638 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 21292ms 2024.10.22 13:39:38.077469 [ 221721 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 3.26 MiB. 2024.10.22 13:39:38.077672 [ 221603 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=88779003904, merge_with_ttl_allowedtrue) 2024.10.22 13:39:38.077688 [ 221603 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 25994ms 2024.10.22 13:39:38.080089 [ 221779 ] {} DDLWorker: Processing task query-0000000152 (ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:38.088424 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.133501 [ 221654 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:38.136982 [ 221654 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:38.137020 [ 221654 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:38.137026 [ 221654 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:38.137109 [ 221779 ] {} DDLWorker: Task query-0000000152 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:38.137230 [ 221779 ] {} DDLWorker: Task query-0000000152 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:38.143917 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:38.144323 [ 221591 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 15329ms 2024.10.22 13:39:38.152108 [ 221654 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:38.190754 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:38.190767 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:38.191014 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=154, queue_size=154, entries=query-0000000000..query-0000000153, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000152, last_skipped_entry_name=none 2024.10.22 13:39:38.191026 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000153 2024.10.22 13:39:38.191035 [ 221779 ] {} DDLWorker: Checking task query-0000000153 2024.10.22 13:39:38.194462 [ 221779 ] {} DDLWorker: Processing task query-0000000153 (ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:38.199501 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.239724 [ 221779 ] {27f31a5f-5fa3-4395-9f42-f293c459b341} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 2128dfc8-ab34-4bef-ad93-938273f9160e) /* ddl_entry=query-0000000153 */ ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:38.246479 [ 221779 ] {27f31a5f-5fa3-4395-9f42-f293c459b341} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:38.246578 [ 221779 ] {27f31a5f-5fa3-4395-9f42-f293c459b341} DDLWorker: Executed query: /* ddl_entry=query-0000000153 */ ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.246597 [ 221779 ] {} DDLWorker: Task query-0000000153 executed by current replica 2024.10.22 13:39:38.246622 [ 221583 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:38.251692 [ 221583 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:38.251722 [ 221583 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:38.251729 [ 221583 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:38.256637 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:38.262853 [ 221660 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 12403ms 2024.10.22 13:39:38.267408 [ 221583 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:38.267636 [ 221660 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 15078ms 2024.10.22 13:39:38.311485 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:38.311490 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:38.317908 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=155, queue_size=155, entries=query-0000000000..query-0000000154, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000153, last_skipped_entry_name=none 2024.10.22 13:39:38.317924 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000154 2024.10.22 13:39:38.317931 [ 221779 ] {} DDLWorker: Checking task query-0000000154 2024.10.22 13:39:38.318372 [ 221779 ] {} DDLWorker: Processing task query-0000000154 (ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:38.322843 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.369517 [ 221540 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:38.369776 [ 221540 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:38.369827 [ 221625 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:38.369850 [ 221625 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:38.373295 [ 221779 ] {} DDLWorker: Task query-0000000154 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:38.373423 [ 221779 ] {} DDLWorker: Task query-0000000154 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:38.381027 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:38.386579 [ 221625 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:38.386880 [ 221540 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 16584ms 2024.10.22 13:39:38.427779 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:38.427785 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:38.427984 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=156, queue_size=156, entries=query-0000000000..query-0000000155, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000154, last_skipped_entry_name=none 2024.10.22 13:39:38.428002 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000155 2024.10.22 13:39:38.428008 [ 221779 ] {} DDLWorker: Checking task query-0000000155 2024.10.22 13:39:38.431641 [ 221779 ] {} DDLWorker: Processing task query-0000000155 (ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:38.434941 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.472750 [ 221779 ] {474a9029-fe1d-4841-a16a-f4357f998e47} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 9d26afac-31bf-476f-a4bc-3bc6df14f49e) /* ddl_entry=query-0000000155 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:38.481465 [ 221779 ] {474a9029-fe1d-4841-a16a-f4357f998e47} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:38.481557 [ 221779 ] {474a9029-fe1d-4841-a16a-f4357f998e47} DDLWorker: Executed query: /* ddl_entry=query-0000000155 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.481571 [ 221779 ] {} DDLWorker: Task query-0000000155 executed by current replica 2024.10.22 13:39:38.481601 [ 221525 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:38.485387 [ 221525 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:38.485415 [ 221525 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:38.485420 [ 221525 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:38.488926 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:38.488990 [ 221637 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 19097ms 2024.10.22 13:39:38.495679 [ 221525 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:38.496024 [ 221637 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 24552ms 2024.10.22 13:39:38.545771 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:38.545782 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:38.546150 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=157, queue_size=157, entries=query-0000000000..query-0000000156, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000155, last_skipped_entry_name=none 2024.10.22 13:39:38.546166 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000156 2024.10.22 13:39:38.546180 [ 221779 ] {} DDLWorker: Checking task query-0000000156 2024.10.22 13:39:38.549568 [ 221779 ] {} DDLWorker: Processing task query-0000000156 (ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:38.558086 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.591697 [ 221779 ] {e6390557-35ac-418b-ac18-46ac3665835c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: a81473ec-451a-4392-b7ba-ebb6c9588a91) /* ddl_entry=query-0000000156 */ ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:38.599236 [ 221779 ] {e6390557-35ac-418b-ac18-46ac3665835c} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:38.599326 [ 221779 ] {e6390557-35ac-418b-ac18-46ac3665835c} DDLWorker: Executed query: /* ddl_entry=query-0000000156 */ ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.599350 [ 221779 ] {} DDLWorker: Task query-0000000156 executed by current replica 2024.10.22 13:39:38.599405 [ 221597 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:38.602901 [ 221597 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:38.602929 [ 221597 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:38.602936 [ 221597 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:38.608047 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:38.611507 [ 221595 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 16134ms 2024.10.22 13:39:38.615925 [ 221597 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:38.621506 [ 221595 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 19927ms 2024.10.22 13:39:38.663698 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:38.663703 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:38.663916 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=158, queue_size=158, entries=query-0000000000..query-0000000157, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000156, last_skipped_entry_name=none 2024.10.22 13:39:38.663929 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000157 2024.10.22 13:39:38.663940 [ 221779 ] {} DDLWorker: Checking task query-0000000157 2024.10.22 13:39:38.667321 [ 221779 ] {} DDLWorker: Processing task query-0000000157 (ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:38.672132 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.714077 [ 221779 ] {21c70fde-1411-4207-88b9-12f5361df090} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 172a1f2f-fe15-46c0-bd8a-ed59e508f8bd) /* ddl_entry=query-0000000157 */ ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:38.720904 [ 221779 ] {21c70fde-1411-4207-88b9-12f5361df090} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:38.721012 [ 221779 ] {21c70fde-1411-4207-88b9-12f5361df090} DDLWorker: Executed query: /* ddl_entry=query-0000000157 */ ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.721031 [ 221779 ] {} DDLWorker: Task query-0000000157 executed by current replica 2024.10.22 13:39:38.721235 [ 221653 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:38.726288 [ 221653 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:38.726317 [ 221653 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:38.726327 [ 221653 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:38.726623 [ 221601 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 12520ms 2024.10.22 13:39:38.732348 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:38.739774 [ 221653 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:38.743405 [ 221601 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 15907ms 2024.10.22 13:39:38.789878 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:38.789885 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:38.795177 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=159, queue_size=159, entries=query-0000000000..query-0000000158, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000157, last_skipped_entry_name=none 2024.10.22 13:39:38.795197 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000158 2024.10.22 13:39:38.795204 [ 221779 ] {} DDLWorker: Checking task query-0000000158 2024.10.22 13:39:38.795627 [ 221779 ] {} DDLWorker: Processing task query-0000000158 (ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:38.799727 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.835663 [ 221779 ] {3c95f3b4-2e4e-41c2-b40c-fc84ecf297f8} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 40a3816a-df93-4a1a-9164-1dd24d4b8475) /* ddl_entry=query-0000000158 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:38.844841 [ 221779 ] {3c95f3b4-2e4e-41c2-b40c-fc84ecf297f8} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:38.844934 [ 221779 ] {3c95f3b4-2e4e-41c2-b40c-fc84ecf297f8} DDLWorker: Executed query: /* ddl_entry=query-0000000158 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.844949 [ 221779 ] {} DDLWorker: Task query-0000000158 executed by current replica 2024.10.22 13:39:38.845105 [ 221607 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:38.849197 [ 221607 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:38.849223 [ 221607 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:38.849230 [ 221607 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:38.853016 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:38.856663 [ 221552 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 21836ms 2024.10.22 13:39:38.865699 [ 221607 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:38.866237 [ 221552 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 26342ms 2024.10.22 13:39:38.904335 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:38.904345 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:38.904585 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=160, queue_size=160, entries=query-0000000000..query-0000000159, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000158, last_skipped_entry_name=none 2024.10.22 13:39:38.904600 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000159 2024.10.22 13:39:38.904606 [ 221779 ] {} DDLWorker: Checking task query-0000000159 2024.10.22 13:39:38.907997 [ 221779 ] {} DDLWorker: Processing task query-0000000159 (ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:38.915727 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:38.962287 [ 221608 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:38.962510 [ 221608 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:38.962567 [ 221608 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:38.962580 [ 221608 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:38.965794 [ 221779 ] {} DDLWorker: Task query-0000000159 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:38.965909 [ 221779 ] {} DDLWorker: Task query-0000000159 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:38.973487 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:38.977015 [ 221608 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:38.977474 [ 221549 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 16441ms 2024.10.22 13:39:39.025636 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:39.025643 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:39.025877 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=161, queue_size=161, entries=query-0000000000..query-0000000160, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000159, last_skipped_entry_name=none 2024.10.22 13:39:39.025887 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000160 2024.10.22 13:39:39.025892 [ 221779 ] {} DDLWorker: Checking task query-0000000160 2024.10.22 13:39:39.028672 [ 221779 ] {} DDLWorker: Processing task query-0000000160 (ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:39.031595 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.068107 [ 221779 ] {be4bdec1-0ba2-4ff2-ac3e-6dcc6d717dbb} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: fed6dc44-3b6d-43fb-b75f-7bdba546d32b) /* ddl_entry=query-0000000160 */ ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:39.078345 [ 221779 ] {be4bdec1-0ba2-4ff2-ac3e-6dcc6d717dbb} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:39.078443 [ 221779 ] {be4bdec1-0ba2-4ff2-ac3e-6dcc6d717dbb} DDLWorker: Executed query: /* ddl_entry=query-0000000160 */ ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.078462 [ 221779 ] {} DDLWorker: Task query-0000000160 executed by current replica 2024.10.22 13:39:39.078494 [ 221643 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:39.083157 [ 221643 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:39.083191 [ 221643 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:39.083200 [ 221643 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:39.086360 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:39.091629 [ 221631 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 11708ms 2024.10.22 13:39:39.098872 [ 221643 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:39.105519 [ 221631 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 14590ms 2024.10.22 13:39:39.143302 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:39.143334 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:39.143542 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=162, queue_size=162, entries=query-0000000000..query-0000000161, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000160, last_skipped_entry_name=none 2024.10.22 13:39:39.143556 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000161 2024.10.22 13:39:39.143562 [ 221779 ] {} DDLWorker: Checking task query-0000000161 2024.10.22 13:39:39.147124 [ 221779 ] {} DDLWorker: Processing task query-0000000161 (ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:39.153741 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.199098 [ 221645 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:39.199357 [ 221645 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:39.199401 [ 221623 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:39.199422 [ 221623 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:39.202728 [ 221779 ] {} DDLWorker: Task query-0000000161 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:39.205869 [ 221645 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 10448ms 2024.10.22 13:39:39.205960 [ 221779 ] {} DDLWorker: Task query-0000000161 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:39.209669 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:39.213075 [ 221623 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:39.263938 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:39.263947 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:39.267557 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=163, queue_size=163, entries=query-0000000000..query-0000000162, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000161, last_skipped_entry_name=none 2024.10.22 13:39:39.267572 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000162 2024.10.22 13:39:39.267578 [ 221779 ] {} DDLWorker: Checking task query-0000000162 2024.10.22 13:39:39.267998 [ 221779 ] {} DDLWorker: Processing task query-0000000162 (ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:39.274647 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.307589 [ 221779 ] {028b62e0-73e0-4a34-bc7f-9f7059433a0c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 9fc67dab-f76c-4f5e-b0fb-0f602dba763d) /* ddl_entry=query-0000000162 */ ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:39.316998 [ 221779 ] {028b62e0-73e0-4a34-bc7f-9f7059433a0c} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:39.317102 [ 221779 ] {028b62e0-73e0-4a34-bc7f-9f7059433a0c} DDLWorker: Executed query: /* ddl_entry=query-0000000162 */ ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.317123 [ 221779 ] {} DDLWorker: Task query-0000000162 executed by current replica 2024.10.22 13:39:39.317196 [ 221586 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:39.322661 [ 221586 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:39.322689 [ 221586 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:39.322696 [ 221586 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:39.328255 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:39.331592 [ 221633 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 12616ms 2024.10.22 13:39:39.340448 [ 221586 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:39.340949 [ 221633 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 16624ms 2024.10.22 13:39:39.379164 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:39.379193 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:39.382721 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=164, queue_size=164, entries=query-0000000000..query-0000000163, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000162, last_skipped_entry_name=none 2024.10.22 13:39:39.382733 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000163 2024.10.22 13:39:39.382738 [ 221779 ] {} DDLWorker: Checking task query-0000000163 2024.10.22 13:39:39.383123 [ 221779 ] {} DDLWorker: Processing task query-0000000163 (ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:39.386470 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.424971 [ 221779 ] {a49999bc-88b9-4f44-b7c5-98d181aae113} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 98abea8c-c7a4-415a-b2a9-7145d6963482) /* ddl_entry=query-0000000163 */ ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:39.434547 [ 221779 ] {a49999bc-88b9-4f44-b7c5-98d181aae113} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:39.434655 [ 221779 ] {a49999bc-88b9-4f44-b7c5-98d181aae113} DDLWorker: Executed query: /* ddl_entry=query-0000000163 */ ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.434670 [ 221779 ] {} DDLWorker: Task query-0000000163 executed by current replica 2024.10.22 13:39:39.434695 [ 221587 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:39.438166 [ 221587 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:39.438208 [ 221587 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:39.438219 [ 221587 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:39.441506 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:39.445478 [ 221578 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 10054ms 2024.10.22 13:39:39.456014 [ 221587 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:39.456292 [ 221578 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 13239ms 2024.10.22 13:39:39.493852 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:39.493858 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:39.497248 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=165, queue_size=165, entries=query-0000000000..query-0000000164, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000163, last_skipped_entry_name=none 2024.10.22 13:39:39.497264 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000164 2024.10.22 13:39:39.497271 [ 221779 ] {} DDLWorker: Checking task query-0000000164 2024.10.22 13:39:39.497773 [ 221779 ] {} DDLWorker: Processing task query-0000000164 (ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:39.504374 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.508584 [ 221603 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Scheduling next merge selecting task after 9987ms 2024.10.22 13:39:39.538822 [ 221779 ] {d7ed63f5-521e-423e-9e6a-fb7ed909ab65} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c4c6c4ee-ab93-48ef-bac0-c4e298c47ccf) /* ddl_entry=query-0000000164 */ ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:39.548077 [ 221779 ] {d7ed63f5-521e-423e-9e6a-fb7ed909ab65} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:39.548187 [ 221779 ] {d7ed63f5-521e-423e-9e6a-fb7ed909ab65} DDLWorker: Executed query: /* ddl_entry=query-0000000164 */ ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.548195 [ 221618 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:39.548211 [ 221779 ] {} DDLWorker: Task query-0000000164 executed by current replica 2024.10.22 13:39:39.548419 [ 221618 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:39.548446 [ 221618 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:39.548455 [ 221618 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:39.557194 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:39.560652 [ 221591 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 12549ms 2024.10.22 13:39:39.564453 [ 221618 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:39.569063 [ 221591 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 15167ms 2024.10.22 13:39:39.609114 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:39.609122 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:39.609340 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=166, queue_size=166, entries=query-0000000000..query-0000000165, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000164, last_skipped_entry_name=none 2024.10.22 13:39:39.609365 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000165 2024.10.22 13:39:39.609370 [ 221779 ] {} DDLWorker: Checking task query-0000000165 2024.10.22 13:39:39.612866 [ 221779 ] {} DDLWorker: Processing task query-0000000165 (ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:39.620740 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.666976 [ 221532 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:39.667208 [ 221532 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:39.667245 [ 221532 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:39.667253 [ 221532 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:39.669704 [ 221779 ] {} DDLWorker: Task query-0000000165 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:39.669832 [ 221779 ] {} DDLWorker: Task query-0000000165 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:39.677217 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:39.677372 [ 221558 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 17305ms 2024.10.22 13:39:39.681962 [ 221532 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:39.721765 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:39.721775 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:39.725127 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=167, queue_size=167, entries=query-0000000000..query-0000000166, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000165, last_skipped_entry_name=none 2024.10.22 13:39:39.725139 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000166 2024.10.22 13:39:39.725143 [ 221779 ] {} DDLWorker: Checking task query-0000000166 2024.10.22 13:39:39.725554 [ 221779 ] {} DDLWorker: Processing task query-0000000166 (ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:39.728215 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.774756 [ 221540 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:39.778387 [ 221540 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:39.778478 [ 221658 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:39.778492 [ 221658 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:39.778621 [ 221779 ] {} DDLWorker: Task query-0000000166 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:39.783773 [ 221779 ] {} DDLWorker: Task query-0000000166 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:39.788033 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:39.788059 [ 221527 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 13384ms 2024.10.22 13:39:39.795254 [ 221658 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:39.834448 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:39.834460 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:39.838004 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=168, queue_size=168, entries=query-0000000000..query-0000000167, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000166, last_skipped_entry_name=none 2024.10.22 13:39:39.838021 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000167 2024.10.22 13:39:39.838028 [ 221779 ] {} DDLWorker: Checking task query-0000000167 2024.10.22 13:39:39.843404 [ 221779 ] {} DDLWorker: Processing task query-0000000167 (ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:39.851195 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:39.878503 [ 221525 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Scheduling next merge selecting task after 10587ms 2024.10.22 13:39:39.883796 [ 221637 ] {} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Scheduling next merge selecting task after 12846ms 2024.10.22 13:39:39.902094 [ 221665 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:39.908901 [ 221665 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:39.908953 [ 221665 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:39.908971 [ 221665 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:39.909862 [ 221779 ] {} DDLWorker: Task query-0000000167 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:39.917385 [ 221779 ] {} DDLWorker: Task query-0000000167 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:39.917511 [ 221665 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:39.922790 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:39.923103 [ 221593 ] {} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Scheduling next merge selecting task after 13381ms 2024.10.22 13:39:39.949882 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:39.949886 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:39.953656 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=169, queue_size=169, entries=query-0000000000..query-0000000168, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000167, last_skipped_entry_name=none 2024.10.22 13:39:39.953672 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000168 2024.10.22 13:39:39.953678 [ 221779 ] {} DDLWorker: Checking task query-0000000168 2024.10.22 13:39:39.954068 [ 221779 ] {} DDLWorker: Processing task query-0000000168 (ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:39.960503 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.000441 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 408.10 MiB, peak 412.54 MiB, free memory in arenas 16.75 MiB, will set to 406.62 MiB (RSS), difference: -1.48 MiB 2024.10.22 13:39:40.002240 [ 221595 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Scheduling next merge selecting task after 9552ms 2024.10.22 13:39:40.005039 [ 221598 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:40.005281 [ 221598 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:40.005328 [ 221531 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:40.005357 [ 221531 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:40.008703 [ 221779 ] {} DDLWorker: Task query-0000000168 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:40.012383 [ 221779 ] {} DDLWorker: Task query-0000000168 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:40.012397 [ 221536 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 10229ms 2024.10.22 13:39:40.015523 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:40.023481 [ 221531 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:40.062692 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:40.062697 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:40.062898 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=170, queue_size=170, entries=query-0000000000..query-0000000169, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000168, last_skipped_entry_name=none 2024.10.22 13:39:40.062908 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000169 2024.10.22 13:39:40.062913 [ 221779 ] {} DDLWorker: Checking task query-0000000169 2024.10.22 13:39:40.066545 [ 221779 ] {} DDLWorker: Processing task query-0000000169 (ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:40.071600 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.107182 [ 221779 ] {137f553e-6b23-4a89-a7a3-dc2826309cd2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 830b1508-4a83-4230-b5d0-7013b0ceb5c7) /* ddl_entry=query-0000000169 */ ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:40.116547 [ 221779 ] {137f553e-6b23-4a89-a7a3-dc2826309cd2} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:40.116672 [ 221779 ] {137f553e-6b23-4a89-a7a3-dc2826309cd2} DDLWorker: Executed query: /* ddl_entry=query-0000000169 */ ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.116691 [ 221779 ] {} DDLWorker: Task query-0000000169 executed by current replica 2024.10.22 13:39:40.116719 [ 221550 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:40.124315 [ 221550 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:40.124351 [ 221550 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:40.124359 [ 221550 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:40.127518 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:40.127682 [ 221568 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 12189ms 2024.10.22 13:39:40.137114 [ 221550 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:40.137431 [ 221568 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 15686ms 2024.10.22 13:39:40.176078 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:40.176087 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:40.176279 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=171, queue_size=171, entries=query-0000000000..query-0000000170, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000169, last_skipped_entry_name=none 2024.10.22 13:39:40.176294 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000170 2024.10.22 13:39:40.176300 [ 221779 ] {} DDLWorker: Checking task query-0000000170 2024.10.22 13:39:40.179906 [ 221779 ] {} DDLWorker: Processing task query-0000000170 (ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:40.188182 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.220442 [ 221779 ] {dc15dd73-328c-4ab8-a665-08f70dbb39ce} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d09750d2-e1b1-4a22-bfc5-88cc95cb19e9) /* ddl_entry=query-0000000170 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:40.227529 [ 221779 ] {dc15dd73-328c-4ab8-a665-08f70dbb39ce} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:40.227628 [ 221779 ] {dc15dd73-328c-4ab8-a665-08f70dbb39ce} DDLWorker: Executed query: /* ddl_entry=query-0000000170 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.227644 [ 221779 ] {} DDLWorker: Task query-0000000170 executed by current replica 2024.10.22 13:39:40.227662 [ 221607 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:40.230958 [ 221607 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:40.230987 [ 221607 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:40.230994 [ 221607 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:40.234422 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:40.237620 [ 221552 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 19139ms 2024.10.22 13:39:40.245102 [ 221607 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:40.245456 [ 221552 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 23718ms 2024.10.22 13:39:40.288158 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:40.288166 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:40.288401 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=172, queue_size=172, entries=query-0000000000..query-0000000171, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000170, last_skipped_entry_name=none 2024.10.22 13:39:40.288410 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000171 2024.10.22 13:39:40.288413 [ 221779 ] {} DDLWorker: Checking task query-0000000171 2024.10.22 13:39:40.291737 [ 221779 ] {} DDLWorker: Processing task query-0000000171 (ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:40.294964 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.324627 [ 221779 ] {9ffd3d04-af33-46ce-aabf-ab9458ddff02} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ebb66cc4-50df-4a60-b984-1a75d7520b47) /* ddl_entry=query-0000000171 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:40.336075 [ 221779 ] {9ffd3d04-af33-46ce-aabf-ab9458ddff02} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:40.336157 [ 221779 ] {9ffd3d04-af33-46ce-aabf-ab9458ddff02} DDLWorker: Executed query: /* ddl_entry=query-0000000171 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.336174 [ 221779 ] {} DDLWorker: Task query-0000000171 executed by current replica 2024.10.22 13:39:40.336224 [ 221535 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:40.339694 [ 221535 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:40.339721 [ 221535 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:40.339728 [ 221535 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:40.343080 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:40.343255 [ 221585 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 18454ms 2024.10.22 13:39:40.350165 [ 221535 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:40.350471 [ 221585 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 23021ms 2024.10.22 13:39:40.404185 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:40.404191 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:40.407565 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=173, queue_size=173, entries=query-0000000000..query-0000000172, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000171, last_skipped_entry_name=none 2024.10.22 13:39:40.407580 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000172 2024.10.22 13:39:40.407585 [ 221779 ] {} DDLWorker: Checking task query-0000000172 2024.10.22 13:39:40.407951 [ 221779 ] {} DDLWorker: Processing task query-0000000172 (ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:40.411117 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.449713 [ 221571 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:40.449940 [ 221571 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:40.449978 [ 221630 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:40.449996 [ 221630 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:40.453090 [ 221779 ] {} DDLWorker: Task query-0000000172 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:40.453207 [ 221779 ] {} DDLWorker: Task query-0000000172 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:40.456451 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:40.459894 [ 221571 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 15903ms 2024.10.22 13:39:40.463633 [ 221630 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:40.516480 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:40.516488 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:40.521491 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=174, queue_size=174, entries=query-0000000000..query-0000000173, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000172, last_skipped_entry_name=none 2024.10.22 13:39:40.521505 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000173 2024.10.22 13:39:40.521510 [ 221779 ] {} DDLWorker: Checking task query-0000000173 2024.10.22 13:39:40.521877 [ 221779 ] {} DDLWorker: Processing task query-0000000173 (ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:40.525149 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.561864 [ 221611 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:40.562087 [ 221611 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:40.562126 [ 221611 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:40.562138 [ 221611 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:40.565168 [ 221779 ] {} DDLWorker: Task query-0000000173 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:40.565288 [ 221779 ] {} DDLWorker: Task query-0000000173 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:40.571511 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:40.571792 [ 221642 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 19035ms 2024.10.22 13:39:40.578542 [ 221611 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:40.630528 [ 221645 ] {} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Scheduling next merge selecting task after 10078ms 2024.10.22 13:39:40.630681 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:40.630695 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:40.634130 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=175, queue_size=175, entries=query-0000000000..query-0000000174, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000173, last_skipped_entry_name=none 2024.10.22 13:39:40.634143 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000174 2024.10.22 13:39:40.634151 [ 221779 ] {} DDLWorker: Checking task query-0000000174 2024.10.22 13:39:40.634625 [ 221779 ] {} DDLWorker: Processing task query-0000000174 (ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:40.640982 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.680034 [ 221779 ] {880a8548-f2ae-4f6e-9e52-0181ecf4fe33} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1795f40e-abea-4ddc-9ff6-d0beff8ae952) /* ddl_entry=query-0000000174 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:40.687293 [ 221779 ] {880a8548-f2ae-4f6e-9e52-0181ecf4fe33} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:40.687457 [ 221779 ] {880a8548-f2ae-4f6e-9e52-0181ecf4fe33} DDLWorker: Executed query: /* ddl_entry=query-0000000174 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.687482 [ 221779 ] {} DDLWorker: Task query-0000000174 executed by current replica 2024.10.22 13:39:40.687570 [ 221530 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:40.691034 [ 221530 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:40.691063 [ 221530 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:40.691071 [ 221530 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:40.694492 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:40.698805 [ 221646 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 15416ms 2024.10.22 13:39:40.702502 [ 221530 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:40.705956 [ 221646 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 19936ms 2024.10.22 13:39:40.743337 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:40.743344 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:40.743577 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=176, queue_size=176, entries=query-0000000000..query-0000000175, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000174, last_skipped_entry_name=none 2024.10.22 13:39:40.743590 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000175 2024.10.22 13:39:40.743598 [ 221779 ] {} DDLWorker: Checking task query-0000000175 2024.10.22 13:39:40.747278 [ 221779 ] {} DDLWorker: Processing task query-0000000175 (ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:40.753938 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.793331 [ 221533 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:40.793572 [ 221533 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:40.793604 [ 221533 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:40.793612 [ 221533 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:40.796937 [ 221779 ] {} DDLWorker: Task query-0000000175 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:40.800247 [ 221779 ] {} DDLWorker: Task query-0000000175 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:40.803670 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:40.803886 [ 221619 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 18014ms 2024.10.22 13:39:40.812714 [ 221533 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:40.822312 [ 221644 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Scheduling next merge selecting task after 13416ms 2024.10.22 13:39:40.859371 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:40.859402 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:40.859618 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=177, queue_size=177, entries=query-0000000000..query-0000000176, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000175, last_skipped_entry_name=none 2024.10.22 13:39:40.859631 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000176 2024.10.22 13:39:40.859635 [ 221779 ] {} DDLWorker: Checking task query-0000000176 2024.10.22 13:39:40.863199 [ 221779 ] {} DDLWorker: Processing task query-0000000176 (ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:40.866301 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.902229 [ 221779 ] {18df40cc-8393-48eb-b7c7-715d1723d603} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 35f36b0b-86fb-453b-a63f-854197e392ca) /* ddl_entry=query-0000000176 */ ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:40.911814 [ 221779 ] {18df40cc-8393-48eb-b7c7-715d1723d603} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:40.911923 [ 221779 ] {18df40cc-8393-48eb-b7c7-715d1723d603} DDLWorker: Executed query: /* ddl_entry=query-0000000176 */ ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:40.911935 [ 221628 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:40.911959 [ 221779 ] {} DDLWorker: Task query-0000000176 executed by current replica 2024.10.22 13:39:40.912201 [ 221628 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:40.912230 [ 221628 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:40.912236 [ 221628 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:40.920628 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:40.920796 [ 221589 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 15439ms 2024.10.22 13:39:40.930211 [ 221628 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:40.930761 [ 221589 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 18580ms 2024.10.22 13:39:40.978486 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:40.978497 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:40.981799 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=178, queue_size=178, entries=query-0000000000..query-0000000177, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000176, last_skipped_entry_name=none 2024.10.22 13:39:40.981815 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000177 2024.10.22 13:39:40.981822 [ 221779 ] {} DDLWorker: Checking task query-0000000177 2024.10.22 13:39:40.982283 [ 221779 ] {} DDLWorker: Processing task query-0000000177 (ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:40.985622 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:41.029150 [ 221779 ] {2631025b-1b3b-47a3-980a-85f1358a18ea} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ba7bb8b6-4e4c-4a1c-b4cd-1b48e48d44d7) /* ddl_entry=query-0000000177 */ ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:41.036451 [ 221779 ] {2631025b-1b3b-47a3-980a-85f1358a18ea} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:41.036544 [ 221779 ] {2631025b-1b3b-47a3-980a-85f1358a18ea} DDLWorker: Executed query: /* ddl_entry=query-0000000177 */ ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:41.036564 [ 221779 ] {} DDLWorker: Task query-0000000177 executed by current replica 2024.10.22 13:39:41.036776 [ 221553 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:41.040529 [ 221553 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:41.040566 [ 221553 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:41.040577 [ 221553 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:41.045823 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:41.046228 [ 221640 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 16994ms 2024.10.22 13:39:41.058036 [ 221553 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:41.058499 [ 221640 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 21542ms 2024.10.22 13:39:41.091630 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:41.091637 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:41.091821 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=179, queue_size=179, entries=query-0000000000..query-0000000178, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000177, last_skipped_entry_name=none 2024.10.22 13:39:41.091833 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000178 2024.10.22 13:39:41.091839 [ 221779 ] {} DDLWorker: Checking task query-0000000178 2024.10.22 13:39:41.095657 [ 221779 ] {} DDLWorker: Processing task query-0000000178 (ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:41.098829 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:41.137746 [ 221779 ] {41dab072-e001-4604-b235-69bc4dfc6e3d} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: bc6dce8b-dd58-4ce5-beb1-9481c1b57d7e) /* ddl_entry=query-0000000178 */ ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:41.145123 [ 221779 ] {41dab072-e001-4604-b235-69bc4dfc6e3d} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Created mutation with ID 0000000001 (data versions: ) 2024.10.22 13:39:41.145240 [ 221779 ] {41dab072-e001-4604-b235-69bc4dfc6e3d} DDLWorker: Executed query: /* ddl_entry=query-0000000178 */ ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:41.145265 [ 221558 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:41.145270 [ 221779 ] {} DDLWorker: Task query-0000000178 executed by current replica 2024.10.22 13:39:41.145492 [ 221558 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:41.145519 [ 221558 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:41.145527 [ 221558 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:41.152297 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:41.152357 [ 221532 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 19085ms 2024.10.22 13:39:41.159454 [ 221558 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:41.162950 [ 221532 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 24822ms 2024.10.22 13:39:41.204108 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:41.204113 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:41.204347 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=180, queue_size=180, entries=query-0000000000..query-0000000179, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000178, last_skipped_entry_name=none 2024.10.22 13:39:41.204363 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000179 2024.10.22 13:39:41.204371 [ 221779 ] {} DDLWorker: Checking task query-0000000179 2024.10.22 13:39:41.207894 [ 221779 ] {} DDLWorker: Processing task query-0000000179 (ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:41.211131 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:41.257836 [ 221637 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000001 - 0000000001 2024.10.22 13:39:41.258049 [ 221637 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 0 partitions (data versions: ) 2024.10.22 13:39:41.258081 [ 221637 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000001 is done 2024.10.22 13:39:41.258086 [ 221637 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:41.261472 [ 221779 ] {} DDLWorker: Task query-0000000179 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:41.261587 [ 221779 ] {} DDLWorker: Task query-0000000179 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:41.264828 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:41.265050 [ 221600 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 19367ms 2024.10.22 13:39:41.271812 [ 221637 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Mutation 0000000001 is done 2024.10.22 13:39:41.316780 [ 221572 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000006 - log-0000000006 2024.10.22 13:39:41.322933 [ 221572 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000006 to queue with type GET_PART with virtual parts [all_5_5_0] 2024.10.22 13:39:41.322953 [ 221572 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:41.332346 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_5_5_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:41.335317 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:41.335329 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:41.335406 [ 221745 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_5_5_0&client_protocol_version=8&compress=false 2024.10.22 13:39:41.335551 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=181, queue_size=181, entries=query-0000000000..query-0000000180, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000179, last_skipped_entry_name=none 2024.10.22 13:39:41.335564 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000180 2024.10.22 13:39:41.335569 [ 221779 ] {} DDLWorker: Checking task query-0000000180 2024.10.22 13:39:41.335983 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:41.336007 [ 221745 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.60 GiB. 2024.10.22 13:39:41.336013 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:39:41.336022 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_5_5_0 onto disk default. 2024.10.22 13:39:41.336608 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_5_5_0 onto disk default finished. 2024.10.22 13:39:41.337761 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_5_5_0 to all_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:41.337795 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_5_5_0 to zookeeper 2024.10.22 13:39:41.339208 [ 221779 ] {} DDLWorker: Processing task query-0000000180 (ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:41.342474 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_5_5_0 committed to zookeeper 2024.10.22 13:39:41.342516 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_5_5_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:41.342544 [ 221596 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=88905013248, merge_with_ttl_allowedtrue) 2024.10.22 13:39:41.342577 [ 221596 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 34237ms 2024.10.22 13:39:41.345777 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:41.388444 [ 221779 ] {a11f7b8b-5e65-436d-997d-58b04dd09287} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8c044947-5bd5-4f16-b0c0-3258dbd16b43) /* ddl_entry=query-0000000180 */ ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:41.397432 [ 221779 ] {a11f7b8b-5e65-436d-997d-58b04dd09287} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:41.397510 [ 221779 ] {a11f7b8b-5e65-436d-997d-58b04dd09287} DDLWorker: Executed query: /* ddl_entry=query-0000000180 */ ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:41.397523 [ 221779 ] {} DDLWorker: Task query-0000000180 executed by current replica 2024.10.22 13:39:41.397686 [ 221536 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:41.401093 [ 221536 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:41.401120 [ 221536 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:41.401127 [ 221536 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:41.404275 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:41.407803 [ 221604 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 18440ms 2024.10.22 13:39:41.414717 [ 221536 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:41.414985 [ 221604 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 22477ms 2024.10.22 13:39:41.456646 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:41.456653 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:41.460032 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=182, queue_size=182, entries=query-0000000000..query-0000000181, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000180, last_skipped_entry_name=none 2024.10.22 13:39:41.460046 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000181 2024.10.22 13:39:41.460052 [ 221779 ] {} DDLWorker: Checking task query-0000000181 2024.10.22 13:39:41.460387 [ 221779 ] {} DDLWorker: Processing task query-0000000181 (ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:41.460942 [ 221624 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Scheduling next merge selecting task after 10544ms 2024.10.22 13:39:41.466608 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:41.502158 [ 221779 ] {} DDLWorker: Task query-0000000181 still not executed, will try to wait for it or execute ourselves, tries count 1 2024.10.22 13:39:41.512132 [ 221570 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:41.512336 [ 221570 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:41.512375 [ 221565 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:41.512395 [ 221565 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:41.515758 [ 221779 ] {} DDLWorker: Task query-0000000181 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:41.519269 [ 221779 ] {} DDLWorker: Task query-0000000181 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:41.519302 [ 221570 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 19684ms 2024.10.22 13:39:41.522637 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:41.529234 [ 221565 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:41.572047 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:41.572056 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:41.572265 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=183, queue_size=183, entries=query-0000000000..query-0000000182, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000181, last_skipped_entry_name=none 2024.10.22 13:39:41.572275 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000182 2024.10.22 13:39:41.572280 [ 221779 ] {} DDLWorker: Checking task query-0000000182 2024.10.22 13:39:41.575608 [ 221779 ] {} DDLWorker: Processing task query-0000000182 (ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:41.579022 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:41.618490 [ 221779 ] {3e4d91ee-0f00-4841-971e-9e85f6ac98a8} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 085c2cee-2066-490d-8a6a-6fdf580e989e) /* ddl_entry=query-0000000182 */ ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:41.625766 [ 221779 ] {3e4d91ee-0f00-4841-971e-9e85f6ac98a8} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:41.625864 [ 221779 ] {3e4d91ee-0f00-4841-971e-9e85f6ac98a8} DDLWorker: Executed query: /* ddl_entry=query-0000000182 */ ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:41.625884 [ 221779 ] {} DDLWorker: Task query-0000000182 executed by current replica 2024.10.22 13:39:41.625904 [ 221537 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:41.629368 [ 221537 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:41.629404 [ 221537 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:41.629414 [ 221537 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:41.632621 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:41.636061 [ 221566 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 21232ms 2024.10.22 13:39:41.642998 [ 221537 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:41.643393 [ 221566 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 26479ms 2024.10.22 13:39:41.692875 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:41.692914 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:41.693106 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=184, queue_size=184, entries=query-0000000000..query-0000000183, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000182, last_skipped_entry_name=none 2024.10.22 13:39:41.693119 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000183 2024.10.22 13:39:41.693124 [ 221779 ] {} DDLWorker: Checking task query-0000000183 2024.10.22 13:39:41.696599 [ 221779 ] {} DDLWorker: Processing task query-0000000183 (ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:41.699819 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:41.736772 [ 221779 ] {37da8e26-8e16-4cb8-b1f6-c3c89d2ad0d6} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: cd84edc7-ceac-455c-972c-ee1b1354a278) /* ddl_entry=query-0000000183 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:41.744009 [ 221779 ] {37da8e26-8e16-4cb8-b1f6-c3c89d2ad0d6} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:41.744104 [ 221779 ] {37da8e26-8e16-4cb8-b1f6-c3c89d2ad0d6} DDLWorker: Executed query: /* ddl_entry=query-0000000183 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:41.744123 [ 221779 ] {} DDLWorker: Task query-0000000183 executed by current replica 2024.10.22 13:39:41.744127 [ 221635 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:41.747606 [ 221635 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:41.747638 [ 221635 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:41.747643 [ 221635 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:41.750767 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:41.754291 [ 221577 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 31338ms 2024.10.22 13:39:41.761413 [ 221635 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:41.761692 [ 221577 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 39431ms 2024.10.22 13:39:41.786784 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1623 entries to flush up to offset 6619 2024.10.22 13:39:41.787710 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:41.787728 [ 221768 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.60 GiB. 2024.10.22 13:39:41.788217 [ 221768 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 13:39:41.788415 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:41.788520 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 6619 2024.10.22 13:39:41.808847 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:41.808855 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:41.809035 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=185, queue_size=185, entries=query-0000000000..query-0000000184, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000183, last_skipped_entry_name=none 2024.10.22 13:39:41.809051 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000184 2024.10.22 13:39:41.809059 [ 221779 ] {} DDLWorker: Checking task query-0000000184 2024.10.22 13:39:41.812682 [ 221779 ] {} DDLWorker: Processing task query-0000000184 (ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:41.814423 [ 221569 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Scheduling next merge selecting task after 9991ms 2024.10.22 13:39:41.819263 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:41.864308 [ 221609 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:41.867678 [ 221609 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:41.867726 [ 221643 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:41.867738 [ 221779 ] {} DDLWorker: Task query-0000000184 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:41.867750 [ 221643 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:41.867870 [ 221779 ] {} DDLWorker: Task query-0000000184 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:41.874308 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:41.877983 [ 221643 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:41.881641 [ 221609 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 24433ms 2024.10.22 13:39:41.884199 [ 221632 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Scheduling next merge selecting task after 10704ms 2024.10.22 13:39:41.927784 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:41.927813 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:41.931291 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=186, queue_size=186, entries=query-0000000000..query-0000000185, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000184, last_skipped_entry_name=none 2024.10.22 13:39:41.931305 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000185 2024.10.22 13:39:41.931310 [ 221779 ] {} DDLWorker: Checking task query-0000000185 2024.10.22 13:39:41.934832 [ 221779 ] {} DDLWorker: Processing task query-0000000185 (ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:41.941223 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:41.978261 [ 221584 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:41.981682 [ 221584 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:41.981724 [ 221642 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:41.981743 [ 221642 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:41.981772 [ 221779 ] {} DDLWorker: Task query-0000000185 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:41.984996 [ 221779 ] {} DDLWorker: Task query-0000000185 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:41.988269 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:41.988665 [ 221584 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 20464ms 2024.10.22 13:39:41.995486 [ 221642 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:41.998480 [ 221528 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Scheduling next merge selecting task after 10164ms 2024.10.22 13:39:42.000437 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 406.83 MiB, peak 415.02 MiB, free memory in arenas 17.69 MiB, will set to 405.52 MiB (RSS), difference: -1.31 MiB 2024.10.22 13:39:42.047304 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:42.047314 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:42.047523 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=187, queue_size=187, entries=query-0000000000..query-0000000186, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000185, last_skipped_entry_name=none 2024.10.22 13:39:42.047532 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000186 2024.10.22 13:39:42.047538 [ 221779 ] {} DDLWorker: Checking task query-0000000186 2024.10.22 13:39:42.050977 [ 221779 ] {} DDLWorker: Processing task query-0000000186 (ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:42.054207 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.061688 [ 221646 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Scheduling next merge selecting task after 9677ms 2024.10.22 13:39:42.088878 [ 221779 ] {c390d90c-bbd0-4c31-a202-a5ea52bd0801} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1685a7ab-83f8-4a7e-9a37-7ab4e202b8c9) /* ddl_entry=query-0000000186 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:42.098662 [ 221779 ] {c390d90c-bbd0-4c31-a202-a5ea52bd0801} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:42.098736 [ 221779 ] {c390d90c-bbd0-4c31-a202-a5ea52bd0801} DDLWorker: Executed query: /* ddl_entry=query-0000000186 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.098751 [ 221779 ] {} DDLWorker: Task query-0000000186 executed by current replica 2024.10.22 13:39:42.098777 [ 221581 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:42.102364 [ 221581 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:42.102398 [ 221581 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:42.102404 [ 221581 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:42.105703 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:42.109040 [ 221586 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 33039ms 2024.10.22 13:39:42.116172 [ 221581 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:42.116539 [ 221586 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 41965ms 2024.10.22 13:39:42.162874 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:42.162886 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:42.163081 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=188, queue_size=188, entries=query-0000000000..query-0000000187, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000186, last_skipped_entry_name=none 2024.10.22 13:39:42.163090 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000187 2024.10.22 13:39:42.163094 [ 221779 ] {} DDLWorker: Checking task query-0000000187 2024.10.22 13:39:42.166672 [ 221779 ] {} DDLWorker: Processing task query-0000000187 (ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:42.170104 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.210414 [ 221587 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:42.210615 [ 221587 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:42.210655 [ 221587 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:42.210662 [ 221587 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:42.213863 [ 221779 ] {} DDLWorker: Task query-0000000187 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:42.214009 [ 221779 ] {} DDLWorker: Task query-0000000187 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:42.220477 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:42.223947 [ 221587 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:42.224305 [ 221578 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 20423ms 2024.10.22 13:39:42.278401 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:42.278411 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:42.278639 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=189, queue_size=189, entries=query-0000000000..query-0000000188, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000187, last_skipped_entry_name=none 2024.10.22 13:39:42.278647 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000188 2024.10.22 13:39:42.278652 [ 221779 ] {} DDLWorker: Checking task query-0000000188 2024.10.22 13:39:42.282127 [ 221779 ] {} DDLWorker: Processing task query-0000000188 (ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:42.288623 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.334078 [ 221628 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:42.337098 [ 221779 ] {} DDLWorker: Task query-0000000188 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:42.337118 [ 221628 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:42.337159 [ 221628 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:42.337169 [ 221628 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:42.340422 [ 221779 ] {} DDLWorker: Task query-0000000188 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:42.343686 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:42.347371 [ 221628 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:42.350866 [ 221589 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 18045ms 2024.10.22 13:39:42.351840 [ 221591 ] {} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Scheduling next merge selecting task after 10462ms 2024.10.22 13:39:42.390704 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:42.390711 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:42.390883 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=190, queue_size=190, entries=query-0000000000..query-0000000189, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000188, last_skipped_entry_name=none 2024.10.22 13:39:42.390896 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000189 2024.10.22 13:39:42.390902 [ 221779 ] {} DDLWorker: Checking task query-0000000189 2024.10.22 13:39:42.394442 [ 221779 ] {} DDLWorker: Processing task query-0000000189 (ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:42.397833 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.436576 [ 221779 ] {117ae42c-0319-4053-999c-d43c0546ec38} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: fafa23a5-cecf-4521-b09d-189f6be5e986) /* ddl_entry=query-0000000189 */ ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:42.444093 [ 221779 ] {117ae42c-0319-4053-999c-d43c0546ec38} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:42.444186 [ 221779 ] {117ae42c-0319-4053-999c-d43c0546ec38} DDLWorker: Executed query: /* ddl_entry=query-0000000189 */ ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.444233 [ 221583 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:42.444377 [ 221779 ] {} DDLWorker: Task query-0000000189 executed by current replica 2024.10.22 13:39:42.444440 [ 221583 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:42.444470 [ 221583 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:42.444482 [ 221583 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:42.451214 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:42.451280 [ 221660 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 13012ms 2024.10.22 13:39:42.458146 [ 221583 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:42.461601 [ 221660 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 15684ms 2024.10.22 13:39:42.506395 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:42.506401 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:42.509723 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=191, queue_size=191, entries=query-0000000000..query-0000000190, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000189, last_skipped_entry_name=none 2024.10.22 13:39:42.509735 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000190 2024.10.22 13:39:42.509740 [ 221779 ] {} DDLWorker: Checking task query-0000000190 2024.10.22 13:39:42.510074 [ 221779 ] {} DDLWorker: Processing task query-0000000190 (ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:42.516607 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.545805 [ 221779 ] {70e3b49e-7b29-480d-bb42-f53114c6962b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ff4931f7-b431-4c2c-8128-35b4c7699f39) /* ddl_entry=query-0000000190 */ ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:42.553173 [ 221779 ] {70e3b49e-7b29-480d-bb42-f53114c6962b} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:42.553265 [ 221779 ] {70e3b49e-7b29-480d-bb42-f53114c6962b} DDLWorker: Executed query: /* ddl_entry=query-0000000190 */ ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.553281 [ 221779 ] {} DDLWorker: Task query-0000000190 executed by current replica 2024.10.22 13:39:42.553493 [ 221661 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:42.557001 [ 221661 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:42.557033 [ 221661 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:42.557042 [ 221661 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:42.560471 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:42.563461 [ 221564 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 20497ms 2024.10.22 13:39:42.567339 [ 221661 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:42.570850 [ 221564 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 26256ms 2024.10.22 13:39:42.618396 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:42.618402 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:42.618586 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=192, queue_size=192, entries=query-0000000000..query-0000000191, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000190, last_skipped_entry_name=none 2024.10.22 13:39:42.618598 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000191 2024.10.22 13:39:42.618605 [ 221779 ] {} DDLWorker: Checking task query-0000000191 2024.10.22 13:39:42.622233 [ 221779 ] {} DDLWorker: Processing task query-0000000191 (ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:42.627838 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.676651 [ 221779 ] {ee3c8c97-fb4a-413c-8bc9-259445ce7bd3} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4faa7556-61de-4ce0-b840-8c3c7c223bc8) /* ddl_entry=query-0000000191 */ ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:42.682295 [ 221779 ] {ee3c8c97-fb4a-413c-8bc9-259445ce7bd3} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:42.682376 [ 221779 ] {ee3c8c97-fb4a-413c-8bc9-259445ce7bd3} DDLWorker: Executed query: /* ddl_entry=query-0000000191 */ ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.682390 [ 221779 ] {} DDLWorker: Task query-0000000191 executed by current replica 2024.10.22 13:39:42.682440 [ 221665 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:42.684695 [ 221665 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:42.684721 [ 221665 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:42.684726 [ 221665 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:42.686974 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:42.689062 [ 221582 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 15897ms 2024.10.22 13:39:42.691824 [ 221665 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:42.694411 [ 221582 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 19247ms 2024.10.22 13:39:42.729611 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:42.729639 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:42.729784 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=193, queue_size=193, entries=query-0000000000..query-0000000192, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000191, last_skipped_entry_name=none 2024.10.22 13:39:42.729793 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000192 2024.10.22 13:39:42.729797 [ 221779 ] {} DDLWorker: Checking task query-0000000192 2024.10.22 13:39:42.732210 [ 221779 ] {} DDLWorker: Processing task query-0000000192 (ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:42.734340 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.757848 [ 221779 ] {c5064af3-9b38-440d-8351-2c853af14daa} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8a55038c-c409-48f6-ab1d-b2eff6707d42) /* ddl_entry=query-0000000192 */ ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:42.764454 [ 221779 ] {c5064af3-9b38-440d-8351-2c853af14daa} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:42.764530 [ 221779 ] {c5064af3-9b38-440d-8351-2c853af14daa} DDLWorker: Executed query: /* ddl_entry=query-0000000192 */ ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.764541 [ 221779 ] {} DDLWorker: Task query-0000000192 executed by current replica 2024.10.22 13:39:42.764597 [ 221597 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:42.767126 [ 221597 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:42.767153 [ 221597 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:42.767159 [ 221597 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:42.769283 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:42.771590 [ 221595 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 19189ms 2024.10.22 13:39:42.774937 [ 221597 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:42.778022 [ 221595 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 24257ms 2024.10.22 13:39:42.840513 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:42.840522 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:42.840710 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=194, queue_size=194, entries=query-0000000000..query-0000000193, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000192, last_skipped_entry_name=none 2024.10.22 13:39:42.840719 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000193 2024.10.22 13:39:42.840724 [ 221779 ] {} DDLWorker: Checking task query-0000000193 2024.10.22 13:39:42.844050 [ 221779 ] {} DDLWorker: Processing task query-0000000193 (ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:42.846222 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.871966 [ 221779 ] {6cbb46cc-511d-4caa-bf47-8a95001c176a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: cbd32a06-8efc-4b19-a24b-834134a79b42) /* ddl_entry=query-0000000193 */ ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:42.877102 [ 221779 ] {6cbb46cc-511d-4caa-bf47-8a95001c176a} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:42.877166 [ 221779 ] {6cbb46cc-511d-4caa-bf47-8a95001c176a} DDLWorker: Executed query: /* ddl_entry=query-0000000193 */ ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.877178 [ 221779 ] {} DDLWorker: Task query-0000000193 executed by current replica 2024.10.22 13:39:42.877281 [ 221653 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:42.879454 [ 221653 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:42.879481 [ 221653 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:42.879488 [ 221653 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:42.881954 [ 221601 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 20820ms 2024.10.22 13:39:42.881955 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:42.886622 [ 221653 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:42.888893 [ 221601 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 26677ms 2024.10.22 13:39:42.952362 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:42.952368 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:42.952552 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=195, queue_size=195, entries=query-0000000000..query-0000000194, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000193, last_skipped_entry_name=none 2024.10.22 13:39:42.952564 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000194 2024.10.22 13:39:42.952571 [ 221779 ] {} DDLWorker: Checking task query-0000000194 2024.10.22 13:39:42.954791 [ 221779 ] {} DDLWorker: Processing task query-0000000194 (ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:42.956946 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:42.983347 [ 221605 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:42.983549 [ 221605 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:42.983587 [ 221605 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:42.983600 [ 221605 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:42.985781 [ 221779 ] {} DDLWorker: Task query-0000000194 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:42.988085 [ 221779 ] {} DDLWorker: Task query-0000000194 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:42.990108 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:42.992281 [ 221605 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:42.992675 [ 221545 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 16064ms 2024.10.22 13:39:43.063710 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:43.063716 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:43.066106 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=196, queue_size=196, entries=query-0000000000..query-0000000195, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000194, last_skipped_entry_name=none 2024.10.22 13:39:43.066116 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000195 2024.10.22 13:39:43.066120 [ 221779 ] {} DDLWorker: Checking task query-0000000195 2024.10.22 13:39:43.066497 [ 221779 ] {} DDLWorker: Processing task query-0000000195 (ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:43.070852 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.095358 [ 221602 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:43.095502 [ 221602 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:43.095537 [ 221602 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:43.095545 [ 221602 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:43.097536 [ 221779 ] {} DDLWorker: Task query-0000000195 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:43.099991 [ 221779 ] {} DDLWorker: Task query-0000000195 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:43.102154 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:43.104188 [ 221602 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:43.104471 [ 221608 ] {} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Scheduling next merge selecting task after 16701ms 2024.10.22 13:39:43.177194 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:43.177201 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:43.177403 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=197, queue_size=197, entries=query-0000000000..query-0000000196, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000195, last_skipped_entry_name=none 2024.10.22 13:39:43.177412 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000196 2024.10.22 13:39:43.177416 [ 221779 ] {} DDLWorker: Checking task query-0000000196 2024.10.22 13:39:43.179685 [ 221779 ] {} DDLWorker: Processing task query-0000000196 (ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:43.181670 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.206387 [ 221779 ] {9fabc085-2959-40a8-b267-6df34aef9282} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 23c83b6d-f440-4149-be24-4212a9cf9abf) /* ddl_entry=query-0000000196 */ ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:43.211792 [ 221779 ] {9fabc085-2959-40a8-b267-6df34aef9282} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:43.211884 [ 221779 ] {9fabc085-2959-40a8-b267-6df34aef9282} DDLWorker: Executed query: /* ddl_entry=query-0000000196 */ ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.211903 [ 221779 ] {} DDLWorker: Task query-0000000196 executed by current replica 2024.10.22 13:39:43.211932 [ 221538 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:43.214255 [ 221538 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:43.214287 [ 221538 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:43.214296 [ 221538 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:43.216371 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:43.218600 [ 221612 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 13040ms 2024.10.22 13:39:43.221105 [ 221538 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:43.221447 [ 221612 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 16688ms 2024.10.22 13:39:43.285731 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:43.285737 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:43.287928 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=198, queue_size=198, entries=query-0000000000..query-0000000197, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000196, last_skipped_entry_name=none 2024.10.22 13:39:43.287938 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000197 2024.10.22 13:39:43.287942 [ 221779 ] {} DDLWorker: Checking task query-0000000197 2024.10.22 13:39:43.288269 [ 221779 ] {} DDLWorker: Processing task query-0000000197 (ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:43.290385 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.316685 [ 221779 ] {5b8cc76a-85b0-4563-8bad-bde9c91e1a19} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 25a3fc6a-ecf3-4cec-baa6-35b8cebc7fae) /* ddl_entry=query-0000000197 */ ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:43.321969 [ 221779 ] {5b8cc76a-85b0-4563-8bad-bde9c91e1a19} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:43.322053 [ 221779 ] {5b8cc76a-85b0-4563-8bad-bde9c91e1a19} DDLWorker: Executed query: /* ddl_entry=query-0000000197 */ ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.322068 [ 221779 ] {} DDLWorker: Task query-0000000197 executed by current replica 2024.10.22 13:39:43.322113 [ 221609 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:43.324345 [ 221609 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:43.324380 [ 221609 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:43.324389 [ 221609 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:43.326854 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:43.326882 [ 221632 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 18875ms 2024.10.22 13:39:43.331355 [ 221609 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:43.333667 [ 221632 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 22696ms 2024.10.22 13:39:43.394712 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:43.394717 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:43.397102 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=199, queue_size=199, entries=query-0000000000..query-0000000198, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000197, last_skipped_entry_name=none 2024.10.22 13:39:43.397113 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000198 2024.10.22 13:39:43.397118 [ 221779 ] {} DDLWorker: Checking task query-0000000198 2024.10.22 13:39:43.397464 [ 221779 ] {} DDLWorker: Processing task query-0000000198 (ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:43.399682 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.422150 [ 221779 ] {aaa2c9e7-b8eb-4cd0-b54b-7935c4547d50} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d4d6e608-66af-4b68-b12e-71365e5ccece) /* ddl_entry=query-0000000198 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:43.427038 [ 221779 ] {aaa2c9e7-b8eb-4cd0-b54b-7935c4547d50} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:43.427129 [ 221779 ] {aaa2c9e7-b8eb-4cd0-b54b-7935c4547d50} DDLWorker: Executed query: /* ddl_entry=query-0000000198 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.427149 [ 221779 ] {} DDLWorker: Task query-0000000198 executed by current replica 2024.10.22 13:39:43.427177 [ 221584 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:43.429366 [ 221584 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:43.429392 [ 221584 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:43.429399 [ 221584 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:43.431575 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:43.434205 [ 221611 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 28700ms 2024.10.22 13:39:43.436796 [ 221584 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:43.439400 [ 221611 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 36019ms 2024.10.22 13:39:43.504417 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:43.504424 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:43.506778 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=200, queue_size=200, entries=query-0000000000..query-0000000199, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000198, last_skipped_entry_name=none 2024.10.22 13:39:43.506791 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000199 2024.10.22 13:39:43.506795 [ 221779 ] {} DDLWorker: Checking task query-0000000199 2024.10.22 13:39:43.507102 [ 221779 ] {} DDLWorker: Processing task query-0000000199 (ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:43.509201 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.538905 [ 221779 ] {6717d617-7357-4f45-8dac-ca0e6b1b8b65} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 3ad265c4-8c80-4fd6-8f29-86d4972128ba) /* ddl_entry=query-0000000199 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:43.545550 [ 221779 ] {6717d617-7357-4f45-8dac-ca0e6b1b8b65} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:43.545632 [ 221779 ] {6717d617-7357-4f45-8dac-ca0e6b1b8b65} DDLWorker: Executed query: /* ddl_entry=query-0000000199 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.545655 [ 221779 ] {} DDLWorker: Task query-0000000199 executed by current replica 2024.10.22 13:39:43.545685 [ 221530 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:43.549028 [ 221530 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:43.549063 [ 221530 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:43.549072 [ 221530 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:43.552097 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:43.555510 [ 221646 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 30104ms 2024.10.22 13:39:43.559051 [ 221530 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:43.562526 [ 221646 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 38885ms 2024.10.22 13:39:43.615393 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:43.615402 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:43.615612 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=201, queue_size=201, entries=query-0000000000..query-0000000200, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000199, last_skipped_entry_name=none 2024.10.22 13:39:43.615622 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000200 2024.10.22 13:39:43.615628 [ 221779 ] {} DDLWorker: Checking task query-0000000200 2024.10.22 13:39:43.619025 [ 221779 ] {} DDLWorker: Processing task query-0000000200 (ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:43.625317 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.665671 [ 221556 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:43.665824 [ 221556 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:43.665865 [ 221556 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:43.665879 [ 221556 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:43.669422 [ 221779 ] {} DDLWorker: Task query-0000000200 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:43.672717 [ 221779 ] {} DDLWorker: Task query-0000000200 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:43.676225 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:43.679393 [ 221556 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:43.682976 [ 221619 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 20420ms 2024.10.22 13:39:43.730659 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:43.730665 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:43.730858 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=202, queue_size=202, entries=query-0000000000..query-0000000201, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000200, last_skipped_entry_name=none 2024.10.22 13:39:43.730867 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000201 2024.10.22 13:39:43.730871 [ 221779 ] {} DDLWorker: Checking task query-0000000201 2024.10.22 13:39:43.734220 [ 221779 ] {} DDLWorker: Processing task query-0000000201 (ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:43.737545 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.743993 [ 221638 ] {} DNSResolver: Updating DNS cache 2024.10.22 13:39:43.744078 [ 221638 ] {} DNSResolver: Updated DNS cache 2024.10.22 13:39:43.777546 [ 221654 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:43.777722 [ 221654 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:43.777759 [ 221654 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:43.777766 [ 221654 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:43.782806 [ 221779 ] {} DDLWorker: Task query-0000000201 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:43.782915 [ 221779 ] {} DDLWorker: Task query-0000000201 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:43.786382 [ 221763 ] {} SystemLog (system.part_log): Flushing system log, 3 entries to flush up to offset 7 2024.10.22 13:39:43.786900 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:43.786918 [ 221763 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.59 GiB. 2024.10.22 13:39:43.788458 [ 221763 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 13:39:43.788828 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:43.788978 [ 221763 ] {} SystemLog (system.part_log): Flushed system log up to offset 7 2024.10.22 13:39:43.789618 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:43.793106 [ 221539 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 23933ms 2024.10.22 13:39:43.796999 [ 221654 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:43.808424 [ 221770 ] {} SystemLog (system.query_log): Flushing system log, 74 entries to flush up to offset 334 2024.10.22 13:39:43.811144 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:43.811163 [ 221770 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.59 GiB. 2024.10.22 13:39:43.812065 [ 221770 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 13:39:43.812500 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:43.812737 [ 221770 ] {} SystemLog (system.query_log): Flushed system log up to offset 334 2024.10.22 13:39:43.846498 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:43.846505 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:43.846685 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=203, queue_size=203, entries=query-0000000000..query-0000000202, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000201, last_skipped_entry_name=none 2024.10.22 13:39:43.846695 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000202 2024.10.22 13:39:43.846699 [ 221779 ] {} DDLWorker: Checking task query-0000000202 2024.10.22 13:39:43.850136 [ 221779 ] {} DDLWorker: Processing task query-0000000202 (ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:43.853497 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.869921 [ 221765 ] {} SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 31 2024.10.22 13:39:43.881747 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:43.881767 [ 221765 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.59 GiB. 2024.10.22 13:39:43.888066 [ 221765 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 13:39:43.892706 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:43.892823 [ 221779 ] {3db9c4f7-602c-4f3f-8cc7-3989dd848d6c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f75fbc98-e277-4729-ba18-3c42f28e0e9d) /* ddl_entry=query-0000000202 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:43.894107 [ 221765 ] {} SystemLog (system.metric_log): Flushed system log up to offset 31 2024.10.22 13:39:43.900396 [ 221779 ] {3db9c4f7-602c-4f3f-8cc7-3989dd848d6c} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:43.900451 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:43.900490 [ 221779 ] {3db9c4f7-602c-4f3f-8cc7-3989dd848d6c} DDLWorker: Executed query: /* ddl_entry=query-0000000202 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:43.900512 [ 221779 ] {} DDLWorker: Task query-0000000202 executed by current replica 2024.10.22 13:39:43.900665 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:43.900691 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:43.900695 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:43.907447 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:43.910828 [ 221640 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 25570ms 2024.10.22 13:39:43.914653 [ 221553 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:43.917821 [ 221640 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 32388ms 2024.10.22 13:39:43.968876 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:43.968886 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:43.969064 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=204, queue_size=204, entries=query-0000000000..query-0000000203, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000202, last_skipped_entry_name=none 2024.10.22 13:39:43.969074 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000203 2024.10.22 13:39:43.969077 [ 221779 ] {} DDLWorker: Checking task query-0000000203 2024.10.22 13:39:43.972504 [ 221779 ] {} DDLWorker: Processing task query-0000000203 (ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:43.975734 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:44.000440 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 406.05 MiB, peak 415.02 MiB, free memory in arenas 28.80 MiB, will set to 415.61 MiB (RSS), difference: 9.55 MiB 2024.10.22 13:39:44.011534 [ 221779 ] {c3c129a2-6165-4562-a703-1493b70e53b1} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 3a1bd8e8-47dc-4553-8b30-06243f4a3d02) /* ddl_entry=query-0000000203 */ ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:44.021239 [ 221779 ] {c3c129a2-6165-4562-a703-1493b70e53b1} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:44.021338 [ 221779 ] {c3c129a2-6165-4562-a703-1493b70e53b1} DDLWorker: Executed query: /* ddl_entry=query-0000000203 */ ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:44.021372 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:44.021381 [ 221779 ] {} DDLWorker: Task query-0000000203 executed by current replica 2024.10.22 13:39:44.021535 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:44.021563 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:44.021570 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:44.028285 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:44.031720 [ 221532 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 22941ms 2024.10.22 13:39:44.035192 [ 221558 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:44.038696 [ 221532 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 28670ms 2024.10.22 13:39:44.084438 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:44.084471 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:44.084697 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=205, queue_size=205, entries=query-0000000000..query-0000000204, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000203, last_skipped_entry_name=none 2024.10.22 13:39:44.084706 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000204 2024.10.22 13:39:44.084710 [ 221779 ] {} DDLWorker: Checking task query-0000000204 2024.10.22 13:39:44.088270 [ 221779 ] {} DDLWorker: Processing task query-0000000204 (ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:44.094706 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:44.137315 [ 221564 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:44.140605 [ 221564 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:44.140649 [ 221564 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:44.140659 [ 221564 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:44.140684 [ 221779 ] {} DDLWorker: Task query-0000000204 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:44.140897 [ 221779 ] {} DDLWorker: Task query-0000000204 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:44.147495 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:44.151152 [ 221564 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:44.154677 [ 221600 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 23800ms 2024.10.22 13:39:44.199702 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:44.199709 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:44.199888 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=206, queue_size=206, entries=query-0000000000..query-0000000205, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000204, last_skipped_entry_name=none 2024.10.22 13:39:44.199901 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000205 2024.10.22 13:39:44.199907 [ 221779 ] {} DDLWorker: Checking task query-0000000205 2024.10.22 13:39:44.203297 [ 221779 ] {} DDLWorker: Processing task query-0000000205 (ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:44.209815 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:44.245532 [ 221779 ] {033a3052-afc6-4e66-be37-d98df5f38414} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ce987db4-7d3a-49ce-a425-c7a2df7dce91) /* ddl_entry=query-0000000205 */ ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:44.252731 [ 221779 ] {033a3052-afc6-4e66-be37-d98df5f38414} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:44.252814 [ 221779 ] {033a3052-afc6-4e66-be37-d98df5f38414} DDLWorker: Executed query: /* ddl_entry=query-0000000205 */ ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:44.252828 [ 221779 ] {} DDLWorker: Task query-0000000205 executed by current replica 2024.10.22 13:39:44.252852 [ 221596 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:44.256257 [ 221596 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:44.256289 [ 221596 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:44.256299 [ 221596 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:44.259582 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:44.262778 [ 221563 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 25907ms 2024.10.22 13:39:44.266498 [ 221596 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:44.269903 [ 221563 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 34160ms 2024.10.22 13:39:44.320437 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:44.320443 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:44.320658 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=207, queue_size=207, entries=query-0000000000..query-0000000206, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000205, last_skipped_entry_name=none 2024.10.22 13:39:44.320669 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000206 2024.10.22 13:39:44.320674 [ 221779 ] {} DDLWorker: Checking task query-0000000206 2024.10.22 13:39:44.324102 [ 221779 ] {} DDLWorker: Processing task query-0000000206 (ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:44.327447 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:44.362449 [ 221779 ] {ab3b6960-eddf-48f9-b316-a1f358a5a41c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 2736aa4d-d932-4fa4-8f44-d8295be282c2) /* ddl_entry=query-0000000206 */ ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:44.369531 [ 221779 ] {ab3b6960-eddf-48f9-b316-a1f358a5a41c} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:44.369607 [ 221613 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:44.369619 [ 221779 ] {ab3b6960-eddf-48f9-b316-a1f358a5a41c} DDLWorker: Executed query: /* ddl_entry=query-0000000206 */ ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:44.369639 [ 221779 ] {} DDLWorker: Task query-0000000206 executed by current replica 2024.10.22 13:39:44.369799 [ 221613 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:44.369828 [ 221613 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:44.369836 [ 221613 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:44.376486 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:44.379923 [ 221624 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 31897ms 2024.10.22 13:39:44.386704 [ 221613 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:44.387036 [ 221624 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 41025ms 2024.10.22 13:39:44.435864 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:44.435873 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:44.436065 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=208, queue_size=208, entries=query-0000000000..query-0000000207, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000206, last_skipped_entry_name=none 2024.10.22 13:39:44.436078 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000207 2024.10.22 13:39:44.436083 [ 221779 ] {} DDLWorker: Checking task query-0000000207 2024.10.22 13:39:44.439678 [ 221779 ] {} DDLWorker: Processing task query-0000000207 (ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent')) 2024.10.22 13:39:44.443055 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:44.475507 [ 221779 ] {2f765102-b81e-4b0b-ba84-ed89152b325b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ff6033ac-eab3-402a-96b4-d684aabe0bf0) /* ddl_entry=query-0000000207 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') (stage: Complete) 2024.10.22 13:39:44.482626 [ 221779 ] {2f765102-b81e-4b0b-ba84-ed89152b325b} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Created mutation with ID 0000000002 (data versions: ) 2024.10.22 13:39:44.482713 [ 221779 ] {2f765102-b81e-4b0b-ba84-ed89152b325b} DDLWorker: Executed query: /* ddl_entry=query-0000000207 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('physical_data_link:bytes_received', 'physical_data_link:bytes_sent', 'physical_data_link:errors_received', 'physical_data_link:errors_sent', 'physical_data_link:packets_received', 'physical_data_link:packets_sent') 2024.10.22 13:39:44.482729 [ 221779 ] {} DDLWorker: Task query-0000000207 executed by current replica 2024.10.22 13:39:44.482753 [ 221601 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000002 - 0000000002 2024.10.22 13:39:44.486220 [ 221601 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Adding mutation 0000000002 for 0 partitions (data versions: ) 2024.10.22 13:39:44.486256 [ 221601 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000002 is done 2024.10.22 13:39:44.486263 [ 221601 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:44.489368 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:44.492742 [ 221565 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 25386ms 2024.10.22 13:39:44.499643 [ 221601 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Mutation 0000000002 is done 2024.10.22 13:39:44.500054 [ 221565 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 33118ms 2024.10.22 13:39:44.556749 [ 221542 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000007 - log-0000000007 2024.10.22 13:39:44.560644 [ 221542 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000007 to queue with type GET_PART with virtual parts [all_6_6_0] 2024.10.22 13:39:44.560672 [ 221542 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:44.564416 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_6_6_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:44.567798 [ 221731 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_6_6_0&client_protocol_version=8&compress=false 2024.10.22 13:39:44.568336 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:44.568355 [ 221731 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.59 GiB. 2024.10.22 13:39:44.568362 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:39:44.568371 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_6_6_0 onto disk default. 2024.10.22 13:39:44.568931 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_6_6_0 onto disk default finished. 2024.10.22 13:39:44.570107 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_6_6_0 to all_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:44.570135 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_6_6_0 to zookeeper 2024.10.22 13:39:44.574965 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_6_6_0 committed to zookeeper 2024.10.22 13:39:44.575010 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_6_6_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:44.575036 [ 221552 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=88899010560, merge_with_ttl_allowedtrue) 2024.10.22 13:39:44.575048 [ 221552 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 43811ms 2024.10.22 13:39:44.595752 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:44.595760 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:44.595986 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=209, queue_size=209, entries=query-0000000000..query-0000000208, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000207, last_skipped_entry_name=none 2024.10.22 13:39:44.595999 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000208 2024.10.22 13:39:44.596005 [ 221779 ] {} DDLWorker: Checking task query-0000000208 2024.10.22 13:39:44.599521 [ 221779 ] {} DDLWorker: Processing task query-0000000208 (ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:44.602853 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:44.635504 [ 221779 ] {33c166a6-de7a-4eba-a82c-f4492905fe83} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d82eaa08-f6a7-4f83-9d70-5bf8f323dee2) /* ddl_entry=query-0000000208 */ ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:44.645262 [ 221779 ] {33c166a6-de7a-4eba-a82c-f4492905fe83} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:44.645369 [ 221779 ] {33c166a6-de7a-4eba-a82c-f4492905fe83} DDLWorker: Executed query: /* ddl_entry=query-0000000208 */ ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:44.645398 [ 221779 ] {} DDLWorker: Task query-0000000208 executed by current replica 2024.10.22 13:39:44.645435 [ 221535 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:44.649025 [ 221535 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:44.649054 [ 221535 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:44.649060 [ 221535 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:44.652428 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:44.655701 [ 221635 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 27727ms 2024.10.22 13:39:44.662500 [ 221535 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:44.662894 [ 221635 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 33663ms 2024.10.22 13:39:44.714712 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:44.714743 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:44.714934 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=210, queue_size=210, entries=query-0000000000..query-0000000209, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000208, last_skipped_entry_name=none 2024.10.22 13:39:44.714946 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000209 2024.10.22 13:39:44.714951 [ 221779 ] {} DDLWorker: Checking task query-0000000209 2024.10.22 13:39:44.718442 [ 221779 ] {} DDLWorker: Processing task query-0000000209 (ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:44.721712 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:44.766301 [ 221779 ] {} DDLWorker: Task query-0000000209 still not executed, will try to wait for it or execute ourselves, tries count 1 2024.10.22 13:39:44.766327 [ 221643 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:44.766558 [ 221643 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:44.766606 [ 221643 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:44.766616 [ 221643 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:44.776387 [ 221779 ] {} DDLWorker: Task query-0000000209 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:44.776531 [ 221779 ] {} DDLWorker: Task query-0000000209 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:44.779759 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:44.779944 [ 221630 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 24768ms 2024.10.22 13:39:44.786790 [ 221643 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:44.830442 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:44.830449 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:44.830655 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=211, queue_size=211, entries=query-0000000000..query-0000000210, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000209, last_skipped_entry_name=none 2024.10.22 13:39:44.830667 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000210 2024.10.22 13:39:44.830672 [ 221779 ] {} DDLWorker: Checking task query-0000000210 2024.10.22 13:39:44.834367 [ 221779 ] {} DDLWorker: Processing task query-0000000210 (ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:44.837722 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:44.877467 [ 221642 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:44.880807 [ 221642 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:44.880856 [ 221528 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:44.880880 [ 221528 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:44.881041 [ 221779 ] {} DDLWorker: Task query-0000000210 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:44.884311 [ 221779 ] {} DDLWorker: Task query-0000000210 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:44.887656 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:44.891078 [ 221528 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:44.894510 [ 221627 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 34784ms 2024.10.22 13:39:44.943113 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:44.943122 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:44.943315 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=212, queue_size=212, entries=query-0000000000..query-0000000211, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000210, last_skipped_entry_name=none 2024.10.22 13:39:44.943326 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000211 2024.10.22 13:39:44.943333 [ 221779 ] {} DDLWorker: Checking task query-0000000211 2024.10.22 13:39:44.946718 [ 221779 ] {} DDLWorker: Processing task query-0000000211 (ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:44.949887 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:44.973562 [ 221779 ] {55dc2d2a-5e36-453c-8393-07f9f028366f} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: feb2f723-fdeb-4efb-9ed4-1d76e654082a) /* ddl_entry=query-0000000211 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:44.981311 [ 221779 ] {55dc2d2a-5e36-453c-8393-07f9f028366f} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:44.981415 [ 221779 ] {55dc2d2a-5e36-453c-8393-07f9f028366f} DDLWorker: Executed query: /* ddl_entry=query-0000000211 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:44.981436 [ 221779 ] {} DDLWorker: Task query-0000000211 executed by current replica 2024.10.22 13:39:44.981565 [ 221647 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:44.985057 [ 221647 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:44.985098 [ 221647 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:44.985108 [ 221647 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:44.988295 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:44.991610 [ 221534 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 51807ms 2024.10.22 13:39:44.998440 [ 221647 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:44.998765 [ 221534 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:45.000423 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 415.72 MiB, peak 415.72 MiB, free memory in arenas 23.82 MiB, will set to 410.73 MiB (RSS), difference: -4.98 MiB 2024.10.22 13:39:45.065718 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:45.065728 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:45.069084 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=213, queue_size=213, entries=query-0000000000..query-0000000212, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000211, last_skipped_entry_name=none 2024.10.22 13:39:45.069096 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000212 2024.10.22 13:39:45.069100 [ 221779 ] {} DDLWorker: Checking task query-0000000212 2024.10.22 13:39:45.069598 [ 221779 ] {} DDLWorker: Processing task query-0000000212 (ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:45.072844 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.111798 [ 221779 ] {79b86727-10a1-4e88-84e4-9208de608d2c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: faae22ed-ca28-4cf7-8f95-9b13faeb5376) /* ddl_entry=query-0000000212 */ ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:45.119114 [ 221779 ] {79b86727-10a1-4e88-84e4-9208de608d2c} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:45.119224 [ 221779 ] {79b86727-10a1-4e88-84e4-9208de608d2c} DDLWorker: Executed query: /* ddl_entry=query-0000000212 */ ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.119242 [ 221779 ] {} DDLWorker: Task query-0000000212 executed by current replica 2024.10.22 13:39:45.119364 [ 221533 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:45.122726 [ 221533 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:45.122755 [ 221533 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:45.122763 [ 221533 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:45.125974 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:45.129334 [ 221556 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 31235ms 2024.10.22 13:39:45.133130 [ 221533 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:45.136670 [ 221556 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 37545ms 2024.10.22 13:39:45.178126 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:45.178134 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:45.181595 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=214, queue_size=214, entries=query-0000000000..query-0000000213, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000212, last_skipped_entry_name=none 2024.10.22 13:39:45.181608 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000213 2024.10.22 13:39:45.181612 [ 221779 ] {} DDLWorker: Checking task query-0000000213 2024.10.22 13:39:45.181998 [ 221779 ] {} DDLWorker: Processing task query-0000000213 (ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:45.188490 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.228630 [ 221657 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:45.228864 [ 221657 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:45.228904 [ 221656 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:45.228930 [ 221656 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:45.232189 [ 221779 ] {} DDLWorker: Task query-0000000213 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:45.235406 [ 221779 ] {} DDLWorker: Task query-0000000213 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:45.238610 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:45.243882 [ 221656 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:45.244306 [ 221657 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 24872ms 2024.10.22 13:39:45.290566 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:45.290572 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:45.290758 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=215, queue_size=215, entries=query-0000000000..query-0000000214, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000213, last_skipped_entry_name=none 2024.10.22 13:39:45.290769 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000214 2024.10.22 13:39:45.290772 [ 221779 ] {} DDLWorker: Checking task query-0000000214 2024.10.22 13:39:45.294205 [ 221779 ] {} DDLWorker: Processing task query-0000000214 (ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:45.297469 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.333317 [ 221779 ] {e1e83ed0-1cdc-485f-9148-d9353af9cb7a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f134fb48-633b-4a91-8cf1-4798adf40506) /* ddl_entry=query-0000000214 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:45.340508 [ 221779 ] {e1e83ed0-1cdc-485f-9148-d9353af9cb7a} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:45.340590 [ 221621 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:45.340610 [ 221779 ] {e1e83ed0-1cdc-485f-9148-d9353af9cb7a} DDLWorker: Executed query: /* ddl_entry=query-0000000214 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.340626 [ 221779 ] {} DDLWorker: Task query-0000000214 executed by current replica 2024.10.22 13:39:45.340801 [ 221621 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:45.340833 [ 221621 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:45.340846 [ 221621 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:45.347310 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:45.350732 [ 221655 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 53949ms 2024.10.22 13:39:45.354512 [ 221621 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:45.357868 [ 221655 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:45.406060 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:45.406069 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:45.406282 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=216, queue_size=216, entries=query-0000000000..query-0000000215, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000214, last_skipped_entry_name=none 2024.10.22 13:39:45.406293 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000215 2024.10.22 13:39:45.406298 [ 221779 ] {} DDLWorker: Checking task query-0000000215 2024.10.22 13:39:45.409791 [ 221779 ] {} DDLWorker: Processing task query-0000000215 (ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:45.413053 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.442375 [ 221779 ] {88623c17-7701-4119-a1a0-d6ed88e61021} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b5c871e1-3e9a-4e90-8dd5-ac8e9024f6ce) /* ddl_entry=query-0000000215 */ ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:45.452287 [ 221779 ] {88623c17-7701-4119-a1a0-d6ed88e61021} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:45.452363 [ 221779 ] {88623c17-7701-4119-a1a0-d6ed88e61021} DDLWorker: Executed query: /* ddl_entry=query-0000000215 */ ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.452376 [ 221779 ] {} DDLWorker: Task query-0000000215 executed by current replica 2024.10.22 13:39:45.452425 [ 221553 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:45.455932 [ 221553 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:45.455969 [ 221553 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:45.455979 [ 221553 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:45.459265 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:45.459446 [ 221640 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 26504ms 2024.10.22 13:39:45.466718 [ 221553 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:45.467047 [ 221640 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 32705ms 2024.10.22 13:39:45.521833 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:45.521839 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:45.522021 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=217, queue_size=217, entries=query-0000000000..query-0000000216, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000215, last_skipped_entry_name=none 2024.10.22 13:39:45.522032 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000216 2024.10.22 13:39:45.522037 [ 221779 ] {} DDLWorker: Checking task query-0000000216 2024.10.22 13:39:45.525533 [ 221779 ] {} DDLWorker: Processing task query-0000000216 (ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:45.531953 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.575199 [ 221558 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:45.578552 [ 221779 ] {} DDLWorker: Task query-0000000216 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:45.578607 [ 221558 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:45.578652 [ 221558 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:45.578665 [ 221558 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:45.578704 [ 221779 ] {} DDLWorker: Task query-0000000216 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:45.585386 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:45.585789 [ 221532 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 22450ms 2024.10.22 13:39:45.592802 [ 221558 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:45.633553 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:45.633581 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:45.633891 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=218, queue_size=218, entries=query-0000000000..query-0000000217, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000216, last_skipped_entry_name=none 2024.10.22 13:39:45.633906 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000217 2024.10.22 13:39:45.633914 [ 221779 ] {} DDLWorker: Checking task query-0000000217 2024.10.22 13:39:45.640656 [ 221779 ] {} DDLWorker: Processing task query-0000000217 (ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:45.643697 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.683935 [ 221779 ] {4733a3ac-c789-4dac-876a-d3bdac02f601} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e47c92e6-22b0-4cdc-b99f-e60088170cee) /* ddl_entry=query-0000000217 */ ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:45.691946 [ 221779 ] {4733a3ac-c789-4dac-876a-d3bdac02f601} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:45.692038 [ 221779 ] {4733a3ac-c789-4dac-876a-d3bdac02f601} DDLWorker: Executed query: /* ddl_entry=query-0000000217 */ ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.692054 [ 221779 ] {} DDLWorker: Task query-0000000217 executed by current replica 2024.10.22 13:39:45.692124 [ 221575 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:45.698749 [ 221575 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:45.698788 [ 221575 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:45.698798 [ 221575 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:45.701977 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:45.702170 [ 221661 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 20689ms 2024.10.22 13:39:45.708973 [ 221575 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:45.712626 [ 221661 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 26408ms 2024.10.22 13:39:45.761892 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:45.761899 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:45.765500 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=219, queue_size=219, entries=query-0000000000..query-0000000218, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000217, last_skipped_entry_name=none 2024.10.22 13:39:45.765514 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000218 2024.10.22 13:39:45.765521 [ 221779 ] {} DDLWorker: Checking task query-0000000218 2024.10.22 13:39:45.769107 [ 221779 ] {} DDLWorker: Processing task query-0000000218 (ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:45.777199 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.818015 [ 221617 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:45.821489 [ 221779 ] {} DDLWorker: Task query-0000000218 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:45.821565 [ 221617 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:45.821605 [ 221572 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:45.821623 [ 221779 ] {} DDLWorker: Task query-0000000218 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:45.821626 [ 221572 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:45.828435 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:45.828922 [ 221617 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 33489ms 2024.10.22 13:39:45.835696 [ 221572 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:45.881205 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:45.881214 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:45.881422 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=220, queue_size=220, entries=query-0000000000..query-0000000219, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000218, last_skipped_entry_name=none 2024.10.22 13:39:45.881433 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000219 2024.10.22 13:39:45.881441 [ 221779 ] {} DDLWorker: Checking task query-0000000219 2024.10.22 13:39:45.884949 [ 221779 ] {} DDLWorker: Processing task query-0000000219 (ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:45.888387 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.925605 [ 221779 ] {e198794b-3d5f-4896-bd0b-6b9f5630afca} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 247266fc-be23-43eb-a816-975dd90c1a7b) /* ddl_entry=query-0000000219 */ ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:45.932865 [ 221779 ] {e198794b-3d5f-4896-bd0b-6b9f5630afca} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:45.932964 [ 221779 ] {e198794b-3d5f-4896-bd0b-6b9f5630afca} DDLWorker: Executed query: /* ddl_entry=query-0000000219 */ ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:45.932988 [ 221779 ] {} DDLWorker: Task query-0000000219 executed by current replica 2024.10.22 13:39:45.932990 [ 221595 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:45.937011 [ 221595 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:45.937043 [ 221595 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:45.937051 [ 221595 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:45.940199 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:45.943966 [ 221551 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 23463ms 2024.10.22 13:39:45.948010 [ 221595 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:45.951583 [ 221551 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 28706ms 2024.10.22 13:39:45.994028 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:45.994035 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:45.994269 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=221, queue_size=221, entries=query-0000000000..query-0000000220, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000219, last_skipped_entry_name=none 2024.10.22 13:39:45.994283 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000220 2024.10.22 13:39:45.994288 [ 221779 ] {} DDLWorker: Checking task query-0000000220 2024.10.22 13:39:45.997549 [ 221779 ] {} DDLWorker: Processing task query-0000000220 (ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:46.001153 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.038870 [ 221779 ] {a3536fe6-3be8-4f6b-af7d-292f56fa15c0} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4cd6f946-0c35-47e4-8712-889e71fcad6a) /* ddl_entry=query-0000000220 */ ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:46.046175 [ 221779 ] {a3536fe6-3be8-4f6b-af7d-292f56fa15c0} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:46.046278 [ 221779 ] {a3536fe6-3be8-4f6b-af7d-292f56fa15c0} DDLWorker: Executed query: /* ddl_entry=query-0000000220 */ ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.046304 [ 221779 ] {} DDLWorker: Task query-0000000220 executed by current replica 2024.10.22 13:39:46.046334 [ 221568 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:46.049881 [ 221568 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:46.049917 [ 221568 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:46.049926 [ 221568 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:46.053140 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:46.056932 [ 221601 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 30332ms 2024.10.22 13:39:46.060631 [ 221568 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:46.064409 [ 221601 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 36814ms 2024.10.22 13:39:46.111536 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:46.111551 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:46.111885 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=222, queue_size=222, entries=query-0000000000..query-0000000221, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000220, last_skipped_entry_name=none 2024.10.22 13:39:46.111894 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000221 2024.10.22 13:39:46.111897 [ 221779 ] {} DDLWorker: Checking task query-0000000221 2024.10.22 13:39:46.115347 [ 221779 ] {} DDLWorker: Processing task query-0000000221 (ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:46.118609 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.158556 [ 221779 ] {f7016845-71a5-4fc0-95cc-47cf97b0e3dd} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ea39a771-4ce1-4228-8438-373de8128bb7) /* ddl_entry=query-0000000221 */ ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:46.166338 [ 221779 ] {f7016845-71a5-4fc0-95cc-47cf97b0e3dd} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:46.166412 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:46.166414 [ 221779 ] {f7016845-71a5-4fc0-95cc-47cf97b0e3dd} DDLWorker: Executed query: /* ddl_entry=query-0000000221 */ ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.166454 [ 221779 ] {} DDLWorker: Task query-0000000221 executed by current replica 2024.10.22 13:39:46.166641 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:46.166672 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:46.166679 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:46.173131 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:46.176458 [ 221566 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 35064ms 2024.10.22 13:39:46.180558 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:46.184271 [ 221566 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 45145ms 2024.10.22 13:39:46.228450 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:46.228459 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:46.232919 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=223, queue_size=223, entries=query-0000000000..query-0000000222, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000221, last_skipped_entry_name=none 2024.10.22 13:39:46.232934 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000222 2024.10.22 13:39:46.232940 [ 221779 ] {} DDLWorker: Checking task query-0000000222 2024.10.22 13:39:46.236492 [ 221779 ] {} DDLWorker: Processing task query-0000000222 (ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:46.242723 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.285820 [ 221612 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:46.286009 [ 221612 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:46.286055 [ 221636 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:46.286073 [ 221636 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:46.289172 [ 221779 ] {} DDLWorker: Task query-0000000222 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:46.292477 [ 221779 ] {} DDLWorker: Task query-0000000222 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:46.296744 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:46.296893 [ 221634 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 19681ms 2024.10.22 13:39:46.303532 [ 221636 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:46.348614 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:46.348621 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:46.348827 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=224, queue_size=224, entries=query-0000000000..query-0000000223, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000222, last_skipped_entry_name=none 2024.10.22 13:39:46.348837 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000223 2024.10.22 13:39:46.348841 [ 221779 ] {} DDLWorker: Checking task query-0000000223 2024.10.22 13:39:46.352618 [ 221779 ] {} DDLWorker: Processing task query-0000000223 (ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:46.356124 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.395954 [ 221779 ] {39c3c8b2-0077-45b2-a759-542ea3cc9c04} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e9be21ef-92cf-43dc-8fac-96ff23843cf2) /* ddl_entry=query-0000000223 */ ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:46.404197 [ 221779 ] {39c3c8b2-0077-45b2-a759-542ea3cc9c04} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:46.404277 [ 221615 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:46.404290 [ 221779 ] {39c3c8b2-0077-45b2-a759-542ea3cc9c04} DDLWorker: Executed query: /* ddl_entry=query-0000000223 */ ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.404316 [ 221779 ] {} DDLWorker: Task query-0000000223 executed by current replica 2024.10.22 13:39:46.404476 [ 221615 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:46.404504 [ 221615 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:46.404510 [ 221615 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:46.408133 [ 221526 ] {} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Scheduling next merge selecting task after 21706ms 2024.10.22 13:39:46.411351 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:46.421313 [ 221615 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:46.421767 [ 221526 ] {} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Scheduling next merge selecting task after 28183ms 2024.10.22 13:39:46.465301 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:46.465366 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:46.468913 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=225, queue_size=225, entries=query-0000000000..query-0000000224, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000223, last_skipped_entry_name=none 2024.10.22 13:39:46.468932 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000224 2024.10.22 13:39:46.468940 [ 221779 ] {} DDLWorker: Checking task query-0000000224 2024.10.22 13:39:46.469312 [ 221779 ] {} DDLWorker: Processing task query-0000000224 (ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:46.475883 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.520429 [ 221779 ] {} DDLWorker: Task query-0000000224 still not executed, will try to wait for it or execute ourselves, tries count 1 2024.10.22 13:39:46.520510 [ 221590 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:46.520832 [ 221590 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:46.520879 [ 221590 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:46.520885 [ 221590 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:46.530872 [ 221779 ] {} DDLWorker: Task query-0000000224 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:46.531078 [ 221779 ] {} DDLWorker: Task query-0000000224 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:46.534395 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:46.537659 [ 221590 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:46.537949 [ 221606 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 21374ms 2024.10.22 13:39:46.579871 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:46.579876 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:46.580062 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=226, queue_size=226, entries=query-0000000000..query-0000000225, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000224, last_skipped_entry_name=none 2024.10.22 13:39:46.580073 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000225 2024.10.22 13:39:46.580086 [ 221779 ] {} DDLWorker: Checking task query-0000000225 2024.10.22 13:39:46.583677 [ 221779 ] {} DDLWorker: Processing task query-0000000225 (ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:46.590022 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.634010 [ 221646 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:46.637431 [ 221646 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:46.637453 [ 221779 ] {} DDLWorker: Task query-0000000225 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:46.637473 [ 221646 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:46.637483 [ 221646 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:46.637570 [ 221779 ] {} DDLWorker: Task query-0000000225 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:46.640953 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:46.641363 [ 221633 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 28993ms 2024.10.22 13:39:46.648311 [ 221646 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:46.692280 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:46.692311 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:46.695643 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=227, queue_size=227, entries=query-0000000000..query-0000000226, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000225, last_skipped_entry_name=none 2024.10.22 13:39:46.695654 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000226 2024.10.22 13:39:46.695657 [ 221779 ] {} DDLWorker: Checking task query-0000000226 2024.10.22 13:39:46.696030 [ 221779 ] {} DDLWorker: Processing task query-0000000226 (ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:46.699421 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.740797 [ 221779 ] {adaeef58-899b-4ca2-ad1b-795179f9af77} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c8c8d04d-bfbc-4b66-a5b3-550bf2c400c4) /* ddl_entry=query-0000000226 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:46.748482 [ 221779 ] {adaeef58-899b-4ca2-ad1b-795179f9af77} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:46.748669 [ 221779 ] {adaeef58-899b-4ca2-ad1b-795179f9af77} DDLWorker: Executed query: /* ddl_entry=query-0000000226 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.748703 [ 221779 ] {} DDLWorker: Task query-0000000226 executed by current replica 2024.10.22 13:39:46.748862 [ 221619 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:46.753037 [ 221619 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:46.753076 [ 221619 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:46.753084 [ 221619 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:46.756154 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:46.756466 [ 221644 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 45043ms 2024.10.22 13:39:46.763570 [ 221619 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:46.767216 [ 221644 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 59444ms 2024.10.22 13:39:46.804982 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:46.805017 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:46.805295 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=228, queue_size=228, entries=query-0000000000..query-0000000227, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000226, last_skipped_entry_name=none 2024.10.22 13:39:46.805310 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000227 2024.10.22 13:39:46.805314 [ 221779 ] {} DDLWorker: Checking task query-0000000227 2024.10.22 13:39:46.808832 [ 221779 ] {} DDLWorker: Processing task query-0000000227 (ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:46.815973 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.860738 [ 221618 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:46.860938 [ 221618 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:46.860976 [ 221656 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:46.860992 [ 221656 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:46.864450 [ 221779 ] {} DDLWorker: Task query-0000000227 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:46.864637 [ 221779 ] {} DDLWorker: Task query-0000000227 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:46.871238 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:46.871450 [ 221618 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 51314ms 2024.10.22 13:39:46.878232 [ 221656 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:46.917624 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:46.917630 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:46.917860 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=229, queue_size=229, entries=query-0000000000..query-0000000228, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000227, last_skipped_entry_name=none 2024.10.22 13:39:46.917874 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000228 2024.10.22 13:39:46.917880 [ 221779 ] {} DDLWorker: Checking task query-0000000228 2024.10.22 13:39:46.921364 [ 221779 ] {} DDLWorker: Processing task query-0000000228 (ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:46.924591 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.964413 [ 221779 ] {e3047285-74e4-46fb-8325-a797a5412bb7} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 9d4f3f89-7944-4e5c-9cef-df9dcf41834f) /* ddl_entry=query-0000000228 */ ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:46.971469 [ 221779 ] {e3047285-74e4-46fb-8325-a797a5412bb7} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:46.971591 [ 221779 ] {e3047285-74e4-46fb-8325-a797a5412bb7} DDLWorker: Executed query: /* ddl_entry=query-0000000228 */ ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:46.971612 [ 221779 ] {} DDLWorker: Task query-0000000228 executed by current replica 2024.10.22 13:39:46.971622 [ 221591 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:46.974951 [ 221591 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:46.974988 [ 221591 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:46.974997 [ 221591 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:46.978156 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:46.981627 [ 221588 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 26325ms 2024.10.22 13:39:46.988404 [ 221591 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:46.988733 [ 221588 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 33554ms 2024.10.22 13:39:47.033993 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:47.033998 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:47.034266 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=230, queue_size=230, entries=query-0000000000..query-0000000229, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000228, last_skipped_entry_name=none 2024.10.22 13:39:47.034279 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000229 2024.10.22 13:39:47.034284 [ 221779 ] {} DDLWorker: Checking task query-0000000229 2024.10.22 13:39:47.037838 [ 221779 ] {} DDLWorker: Processing task query-0000000229 (ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:47.041087 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:47.073864 [ 221779 ] {86290911-62ed-4c6b-b428-c1f229cfaa39} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: dd875f20-f7b2-4840-829b-954dc2a96fd3) /* ddl_entry=query-0000000229 */ ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:47.080994 [ 221779 ] {86290911-62ed-4c6b-b428-c1f229cfaa39} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:47.081085 [ 221779 ] {86290911-62ed-4c6b-b428-c1f229cfaa39} DDLWorker: Executed query: /* ddl_entry=query-0000000229 */ ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:47.081101 [ 221779 ] {} DDLWorker: Task query-0000000229 executed by current replica 2024.10.22 13:39:47.081143 [ 221670 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:47.084574 [ 221670 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:47.084613 [ 221670 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:47.084622 [ 221670 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:47.087924 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:47.091035 [ 221622 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 29832ms 2024.10.22 13:39:47.094627 [ 221670 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:47.094980 [ 221622 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 35949ms 2024.10.22 13:39:47.156864 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:47.156873 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:47.157064 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=231, queue_size=231, entries=query-0000000000..query-0000000230, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000229, last_skipped_entry_name=none 2024.10.22 13:39:47.157071 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000230 2024.10.22 13:39:47.157077 [ 221779 ] {} DDLWorker: Checking task query-0000000230 2024.10.22 13:39:47.160753 [ 221779 ] {} DDLWorker: Processing task query-0000000230 (ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:47.164022 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:47.208128 [ 221779 ] {98ebd958-8783-41ca-836f-8262785ed844} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 796234b9-6959-433c-8514-60194a9b0cc7) /* ddl_entry=query-0000000230 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:47.214932 [ 221779 ] {98ebd958-8783-41ca-836f-8262785ed844} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:47.215032 [ 221779 ] {98ebd958-8783-41ca-836f-8262785ed844} DDLWorker: Executed query: /* ddl_entry=query-0000000230 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:47.215049 [ 221779 ] {} DDLWorker: Task query-0000000230 executed by current replica 2024.10.22 13:39:47.215059 [ 221658 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:47.218510 [ 221658 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:47.218542 [ 221658 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:47.218551 [ 221658 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:47.221791 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:47.225402 [ 221558 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 41327ms 2024.10.22 13:39:47.229062 [ 221658 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:47.233077 [ 221558 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 52699ms 2024.10.22 13:39:47.273096 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:47.273104 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:47.273416 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=232, queue_size=232, entries=query-0000000000..query-0000000231, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000230, last_skipped_entry_name=none 2024.10.22 13:39:47.273428 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000231 2024.10.22 13:39:47.273432 [ 221779 ] {} DDLWorker: Checking task query-0000000231 2024.10.22 13:39:47.276927 [ 221779 ] {} DDLWorker: Processing task query-0000000231 (ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:47.280206 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:47.317855 [ 221600 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:47.318067 [ 221600 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:47.318108 [ 221600 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:47.318118 [ 221600 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:47.321680 [ 221779 ] {} DDLWorker: Task query-0000000231 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:47.321904 [ 221779 ] {} DDLWorker: Task query-0000000231 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:47.328644 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:47.332558 [ 221600 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:47.336387 [ 221593 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 34534ms 2024.10.22 13:39:47.390560 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:47.390565 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:47.393454 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=233, queue_size=233, entries=query-0000000000..query-0000000232, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000231, last_skipped_entry_name=none 2024.10.22 13:39:47.393466 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000232 2024.10.22 13:39:47.393472 [ 221779 ] {} DDLWorker: Checking task query-0000000232 2024.10.22 13:39:47.396967 [ 221779 ] {} DDLWorker: Processing task query-0000000232 (ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:47.403737 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:47.454330 [ 221598 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:47.454541 [ 221598 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:47.454609 [ 221598 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:47.454618 [ 221598 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:47.457852 [ 221779 ] {} DDLWorker: Task query-0000000232 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:47.460657 [ 221779 ] {} DDLWorker: Task query-0000000232 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:47.460673 [ 221617 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 30034ms 2024.10.22 13:39:47.469134 [ 221598 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:47.473247 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:47.510926 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:47.510934 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:47.511181 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=234, queue_size=234, entries=query-0000000000..query-0000000233, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000232, last_skipped_entry_name=none 2024.10.22 13:39:47.511197 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000233 2024.10.22 13:39:47.511204 [ 221779 ] {} DDLWorker: Checking task query-0000000233 2024.10.22 13:39:47.514662 [ 221779 ] {} DDLWorker: Processing task query-0000000233 (ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:47.518016 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:47.573060 [ 221613 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:47.573285 [ 221613 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:47.573324 [ 221613 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:47.573330 [ 221613 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:47.576587 [ 221779 ] {} DDLWorker: Task query-0000000233 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:47.579976 [ 221779 ] {} DDLWorker: Task query-0000000233 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:47.583416 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:47.583492 [ 221624 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 41388ms 2024.10.22 13:39:47.587266 [ 221613 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:47.623767 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:47.623801 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:47.624001 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=235, queue_size=235, entries=query-0000000000..query-0000000234, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000233, last_skipped_entry_name=none 2024.10.22 13:39:47.624014 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000234 2024.10.22 13:39:47.624021 [ 221779 ] {} DDLWorker: Checking task query-0000000234 2024.10.22 13:39:47.627618 [ 221779 ] {} DDLWorker: Processing task query-0000000234 (ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:47.634155 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:47.677648 [ 221605 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:47.681202 [ 221605 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:47.681227 [ 221779 ] {} DDLWorker: Task query-0000000234 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:47.681243 [ 221605 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:47.681252 [ 221605 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:47.681420 [ 221779 ] {} DDLWorker: Task query-0000000234 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:47.687961 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:47.691817 [ 221605 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:47.695658 [ 221568 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 53126ms 2024.10.22 13:39:47.751951 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:47.751956 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:47.752208 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=236, queue_size=236, entries=query-0000000000..query-0000000235, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000234, last_skipped_entry_name=none 2024.10.22 13:39:47.752224 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000235 2024.10.22 13:39:47.752230 [ 221779 ] {} DDLWorker: Checking task query-0000000235 2024.10.22 13:39:47.754806 [ 221779 ] {} DDLWorker: Processing task query-0000000235 (ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time')) 2024.10.22 13:39:47.757266 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:47.790477 [ 221779 ] {9b1de838-2bb6-49ea-97e3-67e5fc513de0} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 56c805c5-a4ba-4c91-8d3b-549764afb8c1) /* ddl_entry=query-0000000235 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') (stage: Complete) 2024.10.22 13:39:47.797941 [ 221779 ] {9b1de838-2bb6-49ea-97e3-67e5fc513de0} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Created mutation with ID 0000000003 (data versions: ) 2024.10.22 13:39:47.798040 [ 221779 ] {9b1de838-2bb6-49ea-97e3-67e5fc513de0} DDLWorker: Executed query: /* ddl_entry=query-0000000235 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('data_link:abort', 'data_link:b_e_r_check_done', 'data_link:b_e_r_check_start', 'data_link:bad_sync_headers', 'data_link:disabled', 'data_link:enabled', 'data_link:end', 'data_link:errored_blocks', 'data_link:fec_align', 'data_link:fec_corr_cnt', 'data_link:fec_hi_ser', 'data_link:fec_ser_lane0', 'data_link:fec_ser_lane1', 'data_link:fec_ser_lane2', 'data_link:fec_ser_lane3', 'data_link:fec_ser_lane4', 'data_link:fec_ser_lane5', 'data_link:fec_ser_lane6', 'data_link:fec_ser_lane7', 'data_link:fec_uncorr_cnt', 'data_link:idle', 'data_link:link_down', 'data_link:link_up', 'data_link:monitor_p_r_b_s_errors', 'data_link:pci_hi_ber', 'data_link:pcs_block_lock_loss', 'data_link:pcs_invalid_errors', 'data_link:pcs_sync_loss', 'data_link:pcs_unknown_errors', 'data_link:pcs_valid_errors', 'data_link:remote_fault', 'data_link:rx_buf_full', 'data_link:rx_bytes', 'data_link:rx_crc_errs', 'data_link:rx_errs', 'data_link:rx_pkts', 'data_link:tofino3_states', 'data_link:tx_bytes', 'data_link:tx_errs', 'data_link:tx_pkts', 'data_link:wait_auto_neg_done', 'data_link:wait_auto_neg_link_training_done', 'data_link:wait_d_f_e_done', 'data_link:wait_p_l_l_ready', 'data_link:wait_signal_o_k', 'data_link:wait_test_done', 'sidecar:sample_time') 2024.10.22 13:39:47.798057 [ 221779 ] {} DDLWorker: Task query-0000000235 executed by current replica 2024.10.22 13:39:47.798113 [ 221602 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000003 - 0000000003 2024.10.22 13:39:47.801770 [ 221602 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Adding mutation 0000000003 for 0 partitions (data versions: ) 2024.10.22 13:39:47.801808 [ 221602 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000003 is done 2024.10.22 13:39:47.801814 [ 221602 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:47.805116 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:47.805288 [ 221608 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 40318ms 2024.10.22 13:39:47.812165 [ 221602 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Mutation 0000000003 is done 2024.10.22 13:39:47.812602 [ 221608 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 53071ms 2024.10.22 13:39:47.865415 [ 221635 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000008 - log-0000000008 2024.10.22 13:39:47.872630 [ 221635 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000008 to queue with type GET_PART with virtual parts [all_7_7_0] 2024.10.22 13:39:47.872645 [ 221635 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:47.882514 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:47.882545 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:47.882710 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_7_7_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:47.882781 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=237, queue_size=237, entries=query-0000000000..query-0000000236, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000235, last_skipped_entry_name=none 2024.10.22 13:39:47.882801 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000236 2024.10.22 13:39:47.882805 [ 221779 ] {} DDLWorker: Checking task query-0000000236 2024.10.22 13:39:47.885954 [ 221734 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_7_7_0&client_protocol_version=8&compress=false 2024.10.22 13:39:47.886240 [ 221779 ] {} DDLWorker: Processing task query-0000000236 (ALTER TABLE oximeter.fields_i64_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:47.886699 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:47.886715 [ 221734 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.58 GiB. 2024.10.22 13:39:47.886721 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:39:47.886730 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_7_7_0 onto disk default. 2024.10.22 13:39:47.887260 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_7_7_0 onto disk default finished. 2024.10.22 13:39:47.887275 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_7_7_0 to all_7_7_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:47.887302 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_7_7_0 to zookeeper 2024.10.22 13:39:47.892901 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i64_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:47.912228 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_7_7_0 committed to zookeeper 2024.10.22 13:39:47.912277 [ 221734 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_7_7_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:47.912307 [ 221571 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=88892497920, merge_with_ttl_allowedtrue) 2024.10.22 13:39:47.912325 [ 221571 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 54573ms 2024.10.22 13:39:47.932007 [ 221634 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 31268ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:47.942999 [ 221631 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:47.949410 [ 221631 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:47.949424 [ 221631 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:47.949431 [ 221631 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:47.956388 [ 221733 ] {} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:47.961584 [ 221733 ] {} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:47.967470 [ 221733 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:47.974049 [ 221779 ] {} DDLWorker: Task query-0000000236 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:47.974160 [ 221779 ] {} DDLWorker: Task query-0000000236 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:47.980589 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:48.001713 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:48.001721 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:48.005262 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=238, queue_size=238, entries=query-0000000000..query-0000000237, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000236, last_skipped_entry_name=none 2024.10.22 13:39:48.005286 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000237 2024.10.22 13:39:48.005297 [ 221779 ] {} DDLWorker: Checking task query-0000000237 2024.10.22 13:39:48.005849 [ 221779 ] {} DDLWorker: Processing task query-0000000237 (ALTER TABLE oximeter.fields_i64_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:48.012259 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i64_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:48.044573 [ 221779 ] {c8a4b548-16f7-400f-9e5b-c1a94822b46a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0d90fc36-848b-4ac6-b515-9af42c48b667) /* ddl_entry=query-0000000237 */ ALTER TABLE oximeter.fields_i64_local MATERIALIZE COLUMN last_updated_at (stage: Complete) 2024.10.22 13:39:48.051957 [ 221779 ] {c8a4b548-16f7-400f-9e5b-c1a94822b46a} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:48.052017 [ 221567 ] {} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Scheduling next merge selecting task after 15569ms 2024.10.22 13:39:48.052061 [ 221779 ] {c8a4b548-16f7-400f-9e5b-c1a94822b46a} DDLWorker: Executed query: /* ddl_entry=query-0000000237 */ ALTER TABLE oximeter.fields_i64_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:48.052078 [ 221779 ] {} DDLWorker: Task query-0000000237 executed by current replica 2024.10.22 13:39:48.052085 [ 221641 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:48.055437 [ 221641 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:48.055471 [ 221641 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:48.055482 [ 221641 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:48.058893 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:48.065616 [ 221641 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:48.068986 [ 221642 ] {} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Scheduling next merge selecting task after 19171ms 2024.10.22 13:39:48.120052 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:48.120066 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:48.123936 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=239, queue_size=239, entries=query-0000000000..query-0000000238, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000237, last_skipped_entry_name=none 2024.10.22 13:39:48.123948 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000238 2024.10.22 13:39:48.123954 [ 221779 ] {} DDLWorker: Checking task query-0000000238 2024.10.22 13:39:48.124311 [ 221779 ] {} DDLWorker: Processing task query-0000000238 (ALTER TABLE oximeter.fields_i64_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:48.127526 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i64_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:48.167247 [ 221779 ] {920b6f9a-9fcc-4add-bdd1-b7901d7f14fd} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d3d65f6c-72e5-48b1-a3cb-bdf3b011b05e) /* ddl_entry=query-0000000238 */ ALTER TABLE oximeter.fields_i64_local MODIFY TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:48.171045 [ 221779 ] {920b6f9a-9fcc-4add-bdd1-b7901d7f14fd} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Created log entry log-0000000001 to update table metadata to version 2 2024.10.22 13:39:48.171070 [ 221779 ] {920b6f9a-9fcc-4add-bdd1-b7901d7f14fd} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:48.171078 [ 221779 ] {920b6f9a-9fcc-4add-bdd1-b7901d7f14fd} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Waiting for 02 to process log entry 2024.10.22 13:39:48.171082 [ 221779 ] {920b6f9a-9fcc-4add-bdd1-b7901d7f14fd} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Waiting for 02 to pull log-0000000001 to queue 2024.10.22 13:39:48.171456 [ 221645 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:48.178263 [ 221645 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:48.178272 [ 221645 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:48.178278 [ 221645 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:48.181589 [ 221779 ] {920b6f9a-9fcc-4add-bdd1-b7901d7f14fd} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Looking for node corresponding to log-0000000001 in 02 queue 2024.10.22 13:39:48.184885 [ 221740 ] {} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:48.185044 [ 221779 ] {920b6f9a-9fcc-4add-bdd1-b7901d7f14fd} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Waiting for queue-0000000001 to disappear from 02 queue 2024.10.22 13:39:48.188324 [ 221740 ] {} oximeter.fields_i64_local (85193f68-c224-4070-9c99-4d92fbc502b6): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:48.194062 [ 221740 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:48.200863 [ 221779 ] {920b6f9a-9fcc-4add-bdd1-b7901d7f14fd} DDLWorker: Executed query: /* ddl_entry=query-0000000238 */ ALTER TABLE oximeter.fields_i64_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:48.200878 [ 221779 ] {} DDLWorker: Task query-0000000238 executed by current replica 2024.10.22 13:39:48.208338 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:48.233437 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:48.233447 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:48.233662 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=240, queue_size=240, entries=query-0000000000..query-0000000239, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000238, last_skipped_entry_name=none 2024.10.22 13:39:48.233671 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000239 2024.10.22 13:39:48.233679 [ 221779 ] {} DDLWorker: Checking task query-0000000239 2024.10.22 13:39:48.237046 [ 221779 ] {} DDLWorker: Processing task query-0000000239 (ALTER TABLE oximeter.fields_uuid_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:48.240234 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_uuid_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:48.275613 [ 221779 ] {c34855b8-3837-4108-8197-a9018e37e9e5} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: de72da04-b2d1-49f0-8ea8-a77a978ed563) /* ddl_entry=query-0000000239 */ ALTER TABLE oximeter.fields_uuid_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() (stage: Complete) 2024.10.22 13:39:48.279868 [ 221779 ] {c34855b8-3837-4108-8197-a9018e37e9e5} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Created log entry log-0000000000 to update table metadata to version 1 2024.10.22 13:39:48.279903 [ 221779 ] {c34855b8-3837-4108-8197-a9018e37e9e5} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:48.279915 [ 221779 ] {c34855b8-3837-4108-8197-a9018e37e9e5} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Waiting for 02 to process log entry 2024.10.22 13:39:48.279921 [ 221779 ] {c34855b8-3837-4108-8197-a9018e37e9e5} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Waiting for 02 to pull log-0000000000 to queue 2024.10.22 13:39:48.280268 [ 221530 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:48.283787 [ 221530 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:48.283801 [ 221530 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:48.283808 [ 221530 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:48.283909 [ 221779 ] {c34855b8-3837-4108-8197-a9018e37e9e5} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Looking for node corresponding to log-0000000000 in 02 queue 2024.10.22 13:39:48.290645 [ 221741 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:48.290828 [ 221779 ] {c34855b8-3837-4108-8197-a9018e37e9e5} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Waiting for queue-0000000000 to disappear from 02 queue 2024.10.22 13:39:48.293947 [ 221741 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:48.300161 [ 221741 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:48.306477 [ 221779 ] {c34855b8-3837-4108-8197-a9018e37e9e5} DDLWorker: Executed query: /* ddl_entry=query-0000000239 */ ALTER TABLE oximeter.fields_uuid_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:48.306495 [ 221779 ] {} DDLWorker: Task query-0000000239 executed by current replica 2024.10.22 13:39:48.310071 [ 221581 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Checking 8 blocks (8 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/01/version/blocks 2024.10.22 13:39:48.313161 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:48.316803 [ 221581 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 33869ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:48.358761 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:48.358775 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:48.359064 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=241, queue_size=241, entries=query-0000000000..query-0000000240, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000239, last_skipped_entry_name=none 2024.10.22 13:39:48.359076 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000240 2024.10.22 13:39:48.359083 [ 221779 ] {} DDLWorker: Checking task query-0000000240 2024.10.22 13:39:48.362445 [ 221779 ] {} DDLWorker: Processing task query-0000000240 (ALTER TABLE oximeter.fields_uuid_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:48.365747 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_uuid_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:48.372929 [ 221629 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32559ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:48.409225 [ 221644 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:48.412622 [ 221644 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:48.412665 [ 221556 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:48.412692 [ 221556 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:48.412766 [ 221779 ] {} DDLWorker: Task query-0000000240 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:48.416048 [ 221779 ] {} DDLWorker: Task query-0000000240 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:48.419211 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:48.419572 [ 221644 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Scheduling next merge selecting task after 16449ms 2024.10.22 13:39:48.426163 [ 221556 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:48.475179 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:48.475187 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:48.475405 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=242, queue_size=242, entries=query-0000000000..query-0000000241, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000240, last_skipped_entry_name=none 2024.10.22 13:39:48.475417 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000241 2024.10.22 13:39:48.475424 [ 221779 ] {} DDLWorker: Checking task query-0000000241 2024.10.22 13:39:48.478701 [ 221779 ] {} DDLWorker: Processing task query-0000000241 (ALTER TABLE oximeter.fields_uuid_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:48.481965 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_uuid_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:48.514859 [ 221779 ] {da9446f6-8cfe-48e1-9d76-6a352e9089cc} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b64081bf-fbce-4c02-8d30-0c48a9c9087b) /* ddl_entry=query-0000000241 */ ALTER TABLE oximeter.fields_uuid_local MODIFY TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:48.520979 [ 221779 ] {da9446f6-8cfe-48e1-9d76-6a352e9089cc} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Created log entry log-0000000001 to update table metadata to version 2 2024.10.22 13:39:48.521018 [ 221779 ] {da9446f6-8cfe-48e1-9d76-6a352e9089cc} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:48.521029 [ 221779 ] {da9446f6-8cfe-48e1-9d76-6a352e9089cc} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Waiting for 02 to process log entry 2024.10.22 13:39:48.521036 [ 221779 ] {da9446f6-8cfe-48e1-9d76-6a352e9089cc} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Waiting for 02 to pull log-0000000001 to queue 2024.10.22 13:39:48.521367 [ 221539 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:48.527972 [ 221539 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:48.527986 [ 221539 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:48.527994 [ 221539 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:48.531373 [ 221779 ] {da9446f6-8cfe-48e1-9d76-6a352e9089cc} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Looking for node corresponding to log-0000000001 in 02 queue 2024.10.22 13:39:48.535717 [ 221735 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:48.539932 [ 221779 ] {da9446f6-8cfe-48e1-9d76-6a352e9089cc} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Waiting for queue-0000000001 to disappear from 02 queue 2024.10.22 13:39:48.540641 [ 221735 ] {} oximeter.fields_uuid_local (198e3567-b79b-4c9c-aa9b-4ef312cc40f0): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:48.546939 [ 221735 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:48.550210 [ 221779 ] {da9446f6-8cfe-48e1-9d76-6a352e9089cc} DDLWorker: Executed query: /* ddl_entry=query-0000000241 */ ALTER TABLE oximeter.fields_uuid_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:48.550227 [ 221779 ] {} DDLWorker: Task query-0000000241 executed by current replica 2024.10.22 13:39:48.556979 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:48.590860 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:48.590868 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:48.591086 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=243, queue_size=243, entries=query-0000000000..query-0000000242, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000241, last_skipped_entry_name=none 2024.10.22 13:39:48.591096 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000242 2024.10.22 13:39:48.591099 [ 221779 ] {} DDLWorker: Checking task query-0000000242 2024.10.22 13:39:48.594408 [ 221779 ] {} DDLWorker: Processing task query-0000000242 (ALTER TABLE oximeter.fields_bool_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:48.600945 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_bool_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:48.641366 [ 221591 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:48.644766 [ 221591 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:48.644788 [ 221591 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:48.644796 [ 221591 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:48.652184 [ 221740 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:48.656904 [ 221740 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:48.661906 [ 221740 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:48.675981 [ 221779 ] {} DDLWorker: Task query-0000000242 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:48.679656 [ 221779 ] {} DDLWorker: Task query-0000000242 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:48.683134 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:48.710128 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:48.710136 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:48.710365 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=244, queue_size=244, entries=query-0000000000..query-0000000243, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000242, last_skipped_entry_name=none 2024.10.22 13:39:48.710383 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000243 2024.10.22 13:39:48.710408 [ 221779 ] {} DDLWorker: Checking task query-0000000243 2024.10.22 13:39:48.713579 [ 221779 ] {} DDLWorker: Processing task query-0000000243 (ALTER TABLE oximeter.fields_bool_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:48.716702 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_bool_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:48.750715 [ 221779 ] {35b64960-db53-47b3-b12a-1a299a6714d2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 90ed4153-7241-4962-bb4d-3fa7bde29e95) /* ddl_entry=query-0000000243 */ ALTER TABLE oximeter.fields_bool_local MATERIALIZE COLUMN last_updated_at (stage: Complete) 2024.10.22 13:39:48.757693 [ 221779 ] {35b64960-db53-47b3-b12a-1a299a6714d2} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:48.757753 [ 221662 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:48.757755 [ 221666 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Scheduling next merge selecting task after 13604ms 2024.10.22 13:39:48.757782 [ 221779 ] {35b64960-db53-47b3-b12a-1a299a6714d2} DDLWorker: Executed query: /* ddl_entry=query-0000000243 */ ALTER TABLE oximeter.fields_bool_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:48.757799 [ 221779 ] {} DDLWorker: Task query-0000000243 executed by current replica 2024.10.22 13:39:48.757896 [ 221662 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:48.757931 [ 221540 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:48.757948 [ 221540 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:48.764486 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:48.776001 [ 221540 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:48.776178 [ 221662 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Scheduling next merge selecting task after 17016ms 2024.10.22 13:39:48.788667 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1621 entries to flush up to offset 8240 2024.10.22 13:39:48.790019 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:48.790041 [ 221768 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.57 GiB. 2024.10.22 13:39:48.790487 [ 221768 ] {} MergedBlockOutputStream: filled checksums 202410_5_5_0 (state Temporary) 2024.10.22 13:39:48.790815 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Renaming temporary part tmp_insert_202410_5_5_0 to 202410_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:48.790909 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 8240 2024.10.22 13:39:48.830068 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:48.830076 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:48.830290 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=245, queue_size=245, entries=query-0000000000..query-0000000244, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000243, last_skipped_entry_name=none 2024.10.22 13:39:48.830301 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000244 2024.10.22 13:39:48.830305 [ 221779 ] {} DDLWorker: Checking task query-0000000244 2024.10.22 13:39:48.833747 [ 221779 ] {} DDLWorker: Processing task query-0000000244 (ALTER TABLE oximeter.fields_bool_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:48.836983 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_bool_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:48.873838 [ 221779 ] {4d3867df-baea-4089-8c91-f0a9054472ed} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5e21337c-9cc5-4c97-87b9-893b0255cbfd) /* ddl_entry=query-0000000244 */ ALTER TABLE oximeter.fields_bool_local MODIFY TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:48.877835 [ 221779 ] {4d3867df-baea-4089-8c91-f0a9054472ed} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Created log entry log-0000000001 to update table metadata to version 2 2024.10.22 13:39:48.877868 [ 221779 ] {4d3867df-baea-4089-8c91-f0a9054472ed} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:48.877875 [ 221779 ] {4d3867df-baea-4089-8c91-f0a9054472ed} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Waiting for 02 to process log entry 2024.10.22 13:39:48.877880 [ 221779 ] {4d3867df-baea-4089-8c91-f0a9054472ed} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Waiting for 02 to pull log-0000000001 to queue 2024.10.22 13:39:48.878195 [ 221575 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:48.881591 [ 221575 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:48.881605 [ 221575 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:48.881610 [ 221575 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:48.881698 [ 221779 ] {4d3867df-baea-4089-8c91-f0a9054472ed} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Looking for node corresponding to log-0000000001 in 02 queue 2024.10.22 13:39:48.884875 [ 221740 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:48.888624 [ 221779 ] {4d3867df-baea-4089-8c91-f0a9054472ed} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Waiting for queue-0000000001 to disappear from 02 queue 2024.10.22 13:39:48.889670 [ 221740 ] {} oximeter.fields_bool_local (f3796524-2fef-4b07-932a-d46687e0a9e2): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:48.892449 [ 221740 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:48.900349 [ 221779 ] {4d3867df-baea-4089-8c91-f0a9054472ed} DDLWorker: Executed query: /* ddl_entry=query-0000000244 */ ALTER TABLE oximeter.fields_bool_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:48.900367 [ 221779 ] {} DDLWorker: Task query-0000000244 executed by current replica 2024.10.22 13:39:48.909775 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:48.946078 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:48.946104 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:48.946327 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=246, queue_size=246, entries=query-0000000000..query-0000000245, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000244, last_skipped_entry_name=none 2024.10.22 13:39:48.946340 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000245 2024.10.22 13:39:48.946345 [ 221779 ] {} DDLWorker: Checking task query-0000000245 2024.10.22 13:39:48.949743 [ 221779 ] {} DDLWorker: Processing task query-0000000245 (ALTER TABLE oximeter.fields_ipaddr_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:48.953041 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_ipaddr_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:48.993312 [ 221779 ] {509ef05f-237d-4e1d-8aca-25f3f8e18ae2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 7fe94aab-accd-4b78-babb-fc0693b143ef) /* ddl_entry=query-0000000245 */ ALTER TABLE oximeter.fields_ipaddr_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() (stage: Complete) 2024.10.22 13:39:48.997276 [ 221779 ] {509ef05f-237d-4e1d-8aca-25f3f8e18ae2} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Created log entry log-0000000000 to update table metadata to version 1 2024.10.22 13:39:48.997314 [ 221779 ] {509ef05f-237d-4e1d-8aca-25f3f8e18ae2} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:48.997325 [ 221779 ] {509ef05f-237d-4e1d-8aca-25f3f8e18ae2} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Waiting for 02 to process log entry 2024.10.22 13:39:48.997333 [ 221779 ] {509ef05f-237d-4e1d-8aca-25f3f8e18ae2} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Waiting for 02 to pull log-0000000000 to queue 2024.10.22 13:39:48.997711 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:49.000419 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 409.96 MiB, peak 418.16 MiB, free memory in arenas 12.73 MiB, will set to 408.04 MiB (RSS), difference: -1.92 MiB 2024.10.22 13:39:49.001554 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:49.001564 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:49.001574 [ 221546 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:49.004750 [ 221779 ] {509ef05f-237d-4e1d-8aca-25f3f8e18ae2} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Looking for node corresponding to log-0000000000 in 02 queue 2024.10.22 13:39:49.008142 [ 221741 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:49.011694 [ 221779 ] {509ef05f-237d-4e1d-8aca-25f3f8e18ae2} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Waiting for queue-0000000000 to disappear from 02 queue 2024.10.22 13:39:49.014046 [ 221741 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:49.017602 [ 221741 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:49.024320 [ 221779 ] {509ef05f-237d-4e1d-8aca-25f3f8e18ae2} DDLWorker: Executed query: /* ddl_entry=query-0000000245 */ ALTER TABLE oximeter.fields_ipaddr_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:49.024336 [ 221779 ] {} DDLWorker: Task query-0000000245 executed by current replica 2024.10.22 13:39:49.033961 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:49.061837 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:49.061872 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:49.062049 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=247, queue_size=247, entries=query-0000000000..query-0000000246, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000245, last_skipped_entry_name=none 2024.10.22 13:39:49.062060 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000246 2024.10.22 13:39:49.062066 [ 221779 ] {} DDLWorker: Checking task query-0000000246 2024.10.22 13:39:49.065598 [ 221779 ] {} DDLWorker: Processing task query-0000000246 (ALTER TABLE oximeter.fields_ipaddr_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:49.068757 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_ipaddr_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:49.105154 [ 221779 ] {60db68f3-e34b-4285-b8a6-f5f8cbe85129} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ad09b3cc-f726-4535-b36b-5387c372fe55) /* ddl_entry=query-0000000246 */ ALTER TABLE oximeter.fields_ipaddr_local MATERIALIZE COLUMN last_updated_at (stage: Complete) 2024.10.22 13:39:49.112196 [ 221779 ] {60db68f3-e34b-4285-b8a6-f5f8cbe85129} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:49.112255 [ 221595 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Scheduling next merge selecting task after 12538ms 2024.10.22 13:39:49.112266 [ 221779 ] {60db68f3-e34b-4285-b8a6-f5f8cbe85129} DDLWorker: Executed query: /* ddl_entry=query-0000000246 */ ALTER TABLE oximeter.fields_ipaddr_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:49.112280 [ 221779 ] {} DDLWorker: Task query-0000000246 executed by current replica 2024.10.22 13:39:49.112333 [ 221604 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:49.115694 [ 221604 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:49.115744 [ 221616 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:49.115773 [ 221616 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:49.118930 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:49.125991 [ 221616 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:49.126355 [ 221604 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Scheduling next merge selecting task after 16276ms 2024.10.22 13:39:49.180998 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:49.181009 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:49.184669 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=248, queue_size=248, entries=query-0000000000..query-0000000247, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000246, last_skipped_entry_name=none 2024.10.22 13:39:49.184688 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000247 2024.10.22 13:39:49.184696 [ 221779 ] {} DDLWorker: Checking task query-0000000247 2024.10.22 13:39:49.185021 [ 221779 ] {} DDLWorker: Processing task query-0000000247 (ALTER TABLE oximeter.fields_ipaddr_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:49.188493 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_ipaddr_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:49.226483 [ 221653 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:49.229792 [ 221653 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:49.229804 [ 221653 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:49.229811 [ 221653 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:49.236234 [ 221733 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:49.240929 [ 221733 ] {} oximeter.fields_ipaddr_local (5a6a1f25-8d1d-4c62-a62a-afbdf7311061): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:49.243782 [ 221733 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:49.256904 [ 221779 ] {} DDLWorker: Task query-0000000247 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:49.257019 [ 221779 ] {} DDLWorker: Task query-0000000247 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:49.263540 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:49.293695 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:49.293702 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:49.293889 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=249, queue_size=249, entries=query-0000000000..query-0000000248, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000247, last_skipped_entry_name=none 2024.10.22 13:39:49.293898 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000248 2024.10.22 13:39:49.293904 [ 221779 ] {} DDLWorker: Checking task query-0000000248 2024.10.22 13:39:49.297351 [ 221779 ] {} DDLWorker: Processing task query-0000000248 (ALTER TABLE oximeter.fields_string_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:49.300841 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_string_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:49.341115 [ 221605 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:49.344798 [ 221605 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:49.344823 [ 221605 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:49.344837 [ 221605 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:49.348370 [ 221735 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:49.355146 [ 221735 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:49.360632 [ 221735 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:49.372454 [ 221779 ] {} DDLWorker: Task query-0000000248 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:49.375678 [ 221779 ] {} DDLWorker: Task query-0000000248 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:49.378913 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:49.409553 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:49.409560 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:49.409792 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=250, queue_size=250, entries=query-0000000000..query-0000000249, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000248, last_skipped_entry_name=none 2024.10.22 13:39:49.409804 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000249 2024.10.22 13:39:49.409811 [ 221779 ] {} DDLWorker: Checking task query-0000000249 2024.10.22 13:39:49.413159 [ 221779 ] {} DDLWorker: Processing task query-0000000249 (ALTER TABLE oximeter.fields_string_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:49.416537 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_string_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:49.460924 [ 221537 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:49.464426 [ 221537 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:49.464491 [ 221566 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:49.464528 [ 221566 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:49.464610 [ 221779 ] {} DDLWorker: Task query-0000000249 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:49.464804 [ 221779 ] {} DDLWorker: Task query-0000000249 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:49.471237 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:49.476960 [ 221566 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:49.482128 [ 221537 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Scheduling next merge selecting task after 11653ms 2024.10.22 13:39:49.508682 [ 221608 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 31655ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:49.525500 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:49.525535 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:49.525723 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=251, queue_size=251, entries=query-0000000000..query-0000000250, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000249, last_skipped_entry_name=none 2024.10.22 13:39:49.525734 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000250 2024.10.22 13:39:49.525739 [ 221779 ] {} DDLWorker: Checking task query-0000000250 2024.10.22 13:39:49.528983 [ 221779 ] {} DDLWorker: Processing task query-0000000250 (ALTER TABLE oximeter.fields_string_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:49.532287 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_string_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:49.567798 [ 221538 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:49.571210 [ 221538 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:49.571220 [ 221538 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:49.571225 [ 221538 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:49.575087 [ 221741 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:49.578840 [ 221571 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 34856ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:49.581218 [ 221741 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:49.584814 [ 221741 ] {} oximeter.fields_string_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:49.598819 [ 221779 ] {} DDLWorker: Task query-0000000250 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:49.601963 [ 221779 ] {} DDLWorker: Task query-0000000250 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:49.605261 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:49.641252 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:49.641277 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:49.641551 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=252, queue_size=252, entries=query-0000000000..query-0000000251, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000250, last_skipped_entry_name=none 2024.10.22 13:39:49.641561 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000251 2024.10.22 13:39:49.641565 [ 221779 ] {} DDLWorker: Checking task query-0000000251 2024.10.22 13:39:49.644757 [ 221779 ] {} DDLWorker: Processing task query-0000000251 (ALTER TABLE oximeter.fields_i8_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:49.651332 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i8_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:49.684176 [ 221779 ] {b2c6316d-e7e7-41b1-beea-76ce99a6c508} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d354cc1c-6d10-40f7-a31c-bcec9a2073f9) /* ddl_entry=query-0000000251 */ ALTER TABLE oximeter.fields_i8_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() (stage: Complete) 2024.10.22 13:39:49.687970 [ 221779 ] {b2c6316d-e7e7-41b1-beea-76ce99a6c508} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Created log entry log-0000000000 to update table metadata to version 1 2024.10.22 13:39:49.688010 [ 221779 ] {b2c6316d-e7e7-41b1-beea-76ce99a6c508} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:49.688023 [ 221779 ] {b2c6316d-e7e7-41b1-beea-76ce99a6c508} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Waiting for 02 to process log entry 2024.10.22 13:39:49.688032 [ 221779 ] {b2c6316d-e7e7-41b1-beea-76ce99a6c508} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Waiting for 02 to pull log-0000000000 to queue 2024.10.22 13:39:49.688350 [ 221609 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:49.691675 [ 221609 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:49.691688 [ 221609 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:49.691695 [ 221609 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:49.695629 [ 221779 ] {b2c6316d-e7e7-41b1-beea-76ce99a6c508} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Looking for node corresponding to log-0000000000 in 02 queue 2024.10.22 13:39:49.698815 [ 221733 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:49.702247 [ 221779 ] {b2c6316d-e7e7-41b1-beea-76ce99a6c508} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Waiting for queue-0000000000 to disappear from 02 queue 2024.10.22 13:39:49.703460 [ 221733 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:49.708877 [ 221733 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:49.715886 [ 221779 ] {b2c6316d-e7e7-41b1-beea-76ce99a6c508} DDLWorker: Executed query: /* ddl_entry=query-0000000251 */ ALTER TABLE oximeter.fields_i8_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:49.715900 [ 221779 ] {} DDLWorker: Task query-0000000251 executed by current replica 2024.10.22 13:39:49.725703 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:49.766248 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:49.766254 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:49.766491 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=253, queue_size=253, entries=query-0000000000..query-0000000252, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000251, last_skipped_entry_name=none 2024.10.22 13:39:49.766503 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000252 2024.10.22 13:39:49.766508 [ 221779 ] {} DDLWorker: Checking task query-0000000252 2024.10.22 13:39:49.769828 [ 221779 ] {} DDLWorker: Processing task query-0000000252 (ALTER TABLE oximeter.fields_i8_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:49.773057 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i8_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:49.794767 [ 221779 ] {acf51ebe-c3fd-4eee-af8d-b910fc97ce09} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 3d16ff1a-51a8-4671-baf0-ae455090bcc5) /* ddl_entry=query-0000000252 */ ALTER TABLE oximeter.fields_i8_local MATERIALIZE COLUMN last_updated_at (stage: Complete) 2024.10.22 13:39:49.801464 [ 221779 ] {acf51ebe-c3fd-4eee-af8d-b910fc97ce09} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:49.801525 [ 221627 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Scheduling next merge selecting task after 13177ms 2024.10.22 13:39:49.801548 [ 221779 ] {acf51ebe-c3fd-4eee-af8d-b910fc97ce09} DDLWorker: Executed query: /* ddl_entry=query-0000000252 */ ALTER TABLE oximeter.fields_i8_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:49.801563 [ 221779 ] {} DDLWorker: Task query-0000000252 executed by current replica 2024.10.22 13:39:49.801659 [ 221528 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:49.804852 [ 221528 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:49.804890 [ 221528 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:49.804897 [ 221528 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:49.808316 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:49.815284 [ 221528 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:49.818919 [ 221611 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Scheduling next merge selecting task after 16642ms 2024.10.22 13:39:49.888638 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:49.888646 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:49.888856 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=254, queue_size=254, entries=query-0000000000..query-0000000253, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000252, last_skipped_entry_name=none 2024.10.22 13:39:49.888864 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000253 2024.10.22 13:39:49.888868 [ 221779 ] {} DDLWorker: Checking task query-0000000253 2024.10.22 13:39:49.892481 [ 221779 ] {} DDLWorker: Processing task query-0000000253 (ALTER TABLE oximeter.fields_i8_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:49.896035 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i8_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:49.935921 [ 221779 ] {508ccb20-6317-4317-b107-9893ff6b7cdd} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4b8203b2-d9c0-4ac5-a1e0-1b8ba30df4fc) /* ddl_entry=query-0000000253 */ ALTER TABLE oximeter.fields_i8_local MODIFY TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:49.939818 [ 221779 ] {508ccb20-6317-4317-b107-9893ff6b7cdd} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Created log entry log-0000000001 to update table metadata to version 2 2024.10.22 13:39:49.939858 [ 221779 ] {508ccb20-6317-4317-b107-9893ff6b7cdd} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:49.939871 [ 221779 ] {508ccb20-6317-4317-b107-9893ff6b7cdd} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Waiting for 02 to process log entry 2024.10.22 13:39:49.939878 [ 221779 ] {508ccb20-6317-4317-b107-9893ff6b7cdd} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Waiting for 02 to pull log-0000000001 to queue 2024.10.22 13:39:49.940195 [ 221590 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:49.946751 [ 221590 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:49.946764 [ 221590 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:49.946771 [ 221590 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:49.949906 [ 221779 ] {508ccb20-6317-4317-b107-9893ff6b7cdd} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Looking for node corresponding to log-0000000001 in 02 queue 2024.10.22 13:39:49.953162 [ 221779 ] {508ccb20-6317-4317-b107-9893ff6b7cdd} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Waiting for queue-0000000001 to disappear from 02 queue 2024.10.22 13:39:49.953885 [ 221740 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:49.957428 [ 221740 ] {} oximeter.fields_i8_local (2e7c271c-ed1c-4a43-8d27-2b86d32f6d73): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:49.961119 [ 221740 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:49.967977 [ 221779 ] {508ccb20-6317-4317-b107-9893ff6b7cdd} DDLWorker: Executed query: /* ddl_entry=query-0000000253 */ ALTER TABLE oximeter.fields_i8_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:49.967997 [ 221779 ] {} DDLWorker: Task query-0000000253 executed by current replica 2024.10.22 13:39:49.975221 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:50.002859 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:50.002864 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:50.003134 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=255, queue_size=255, entries=query-0000000000..query-0000000254, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000253, last_skipped_entry_name=none 2024.10.22 13:39:50.003148 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000254 2024.10.22 13:39:50.003154 [ 221779 ] {} DDLWorker: Checking task query-0000000254 2024.10.22 13:39:50.006913 [ 221779 ] {} DDLWorker: Processing task query-0000000254 (ALTER TABLE oximeter.fields_u8_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:50.010427 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u8_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:50.042674 [ 221587 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:50.046123 [ 221587 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:50.046136 [ 221587 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:50.046142 [ 221587 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:50.052750 [ 221733 ] {} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:50.057634 [ 221733 ] {} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:50.062409 [ 221733 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:50.076248 [ 221779 ] {} DDLWorker: Task query-0000000254 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:50.076364 [ 221779 ] {} DDLWorker: Task query-0000000254 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:50.082811 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:50.119843 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:50.119838 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:50.124974 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=256, queue_size=256, entries=query-0000000000..query-0000000255, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000254, last_skipped_entry_name=none 2024.10.22 13:39:50.124992 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000255 2024.10.22 13:39:50.125000 [ 221779 ] {} DDLWorker: Checking task query-0000000255 2024.10.22 13:39:50.125333 [ 221779 ] {} DDLWorker: Processing task query-0000000255 (ALTER TABLE oximeter.fields_u8_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:50.131897 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u8_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:50.175364 [ 221618 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:50.178846 [ 221618 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:50.178892 [ 221618 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:50.178904 [ 221618 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:50.178992 [ 221779 ] {} DDLWorker: Task query-0000000255 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:50.182303 [ 221779 ] {} DDLWorker: Task query-0000000255 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:50.185792 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:50.189260 [ 221618 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:50.189608 [ 221628 ] {} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Scheduling next merge selecting task after 13027ms 2024.10.22 13:39:50.234777 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:50.234783 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:50.238264 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=257, queue_size=257, entries=query-0000000000..query-0000000256, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000255, last_skipped_entry_name=none 2024.10.22 13:39:50.238279 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000256 2024.10.22 13:39:50.238283 [ 221779 ] {} DDLWorker: Checking task query-0000000256 2024.10.22 13:39:50.238676 [ 221779 ] {} DDLWorker: Processing task query-0000000256 (ALTER TABLE oximeter.fields_u8_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:50.246885 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u8_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:50.289865 [ 221655 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:50.293399 [ 221655 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:50.293428 [ 221655 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:50.293437 [ 221655 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:50.296790 [ 221740 ] {} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:50.300413 [ 221740 ] {} oximeter.fields_u8_local (ccf4513e-49f9-4b42-ab8d-4d79efe2d01f): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:50.304380 [ 221740 ] {} oximeter.fields_u8_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:50.318246 [ 221779 ] {} DDLWorker: Task query-0000000256 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:50.321592 [ 221779 ] {} DDLWorker: Task query-0000000256 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:50.324934 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:50.348431 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:50.348438 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:50.351978 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=258, queue_size=258, entries=query-0000000000..query-0000000257, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000256, last_skipped_entry_name=none 2024.10.22 13:39:50.351995 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000257 2024.10.22 13:39:50.352003 [ 221779 ] {} DDLWorker: Checking task query-0000000257 2024.10.22 13:39:50.352452 [ 221779 ] {} DDLWorker: Processing task query-0000000257 (ALTER TABLE oximeter.fields_i16_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:50.355759 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i16_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:50.388604 [ 221779 ] {18a47666-e5cf-4ed6-9bdc-e7a312a24c0c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 193dc8bf-8d6a-4569-9c83-4e04ddf157bf) /* ddl_entry=query-0000000257 */ ALTER TABLE oximeter.fields_i16_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() (stage: Complete) 2024.10.22 13:39:50.392959 [ 221779 ] {18a47666-e5cf-4ed6-9bdc-e7a312a24c0c} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Created log entry log-0000000000 to update table metadata to version 1 2024.10.22 13:39:50.392997 [ 221779 ] {18a47666-e5cf-4ed6-9bdc-e7a312a24c0c} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:50.393009 [ 221779 ] {18a47666-e5cf-4ed6-9bdc-e7a312a24c0c} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Waiting for 02 to process log entry 2024.10.22 13:39:50.393016 [ 221779 ] {18a47666-e5cf-4ed6-9bdc-e7a312a24c0c} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Waiting for 02 to pull log-0000000000 to queue 2024.10.22 13:39:50.393368 [ 221553 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:50.400119 [ 221553 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:50.400134 [ 221553 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:50.400142 [ 221553 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:50.403628 [ 221779 ] {18a47666-e5cf-4ed6-9bdc-e7a312a24c0c} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Looking for node corresponding to log-0000000000 in 02 queue 2024.10.22 13:39:50.407194 [ 221779 ] {18a47666-e5cf-4ed6-9bdc-e7a312a24c0c} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Waiting for queue-0000000000 to disappear from 02 queue 2024.10.22 13:39:50.407676 [ 221733 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:50.411334 [ 221733 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:50.415141 [ 221733 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:50.421831 [ 221779 ] {18a47666-e5cf-4ed6-9bdc-e7a312a24c0c} DDLWorker: Executed query: /* ddl_entry=query-0000000257 */ ALTER TABLE oximeter.fields_i16_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:50.421853 [ 221779 ] {} DDLWorker: Task query-0000000257 executed by current replica 2024.10.22 13:39:50.428681 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:50.465292 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:50.465347 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:50.465606 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=259, queue_size=259, entries=query-0000000000..query-0000000258, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000257, last_skipped_entry_name=none 2024.10.22 13:39:50.465622 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000258 2024.10.22 13:39:50.465629 [ 221779 ] {} DDLWorker: Checking task query-0000000258 2024.10.22 13:39:50.469088 [ 221779 ] {} DDLWorker: Processing task query-0000000258 (ALTER TABLE oximeter.fields_i16_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:50.472528 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i16_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:50.513739 [ 221779 ] {8becd270-a063-4c5e-b0ad-831d239f8c9b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 24c033e6-8a8f-47e8-af6f-cf7060046539) /* ddl_entry=query-0000000258 */ ALTER TABLE oximeter.fields_i16_local MATERIALIZE COLUMN last_updated_at (stage: Complete) 2024.10.22 13:39:50.520959 [ 221779 ] {8becd270-a063-4c5e-b0ad-831d239f8c9b} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:50.521030 [ 221662 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Scheduling next merge selecting task after 12900ms 2024.10.22 13:39:50.521064 [ 221540 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:50.521065 [ 221779 ] {8becd270-a063-4c5e-b0ad-831d239f8c9b} DDLWorker: Executed query: /* ddl_entry=query-0000000258 */ ALTER TABLE oximeter.fields_i16_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:50.521100 [ 221779 ] {} DDLWorker: Task query-0000000258 executed by current replica 2024.10.22 13:39:50.521218 [ 221540 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:50.521257 [ 221540 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:50.521263 [ 221540 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:50.527977 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:50.531573 [ 221532 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Scheduling next merge selecting task after 15996ms 2024.10.22 13:39:50.538523 [ 221540 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:50.585654 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:50.585663 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:50.589097 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=260, queue_size=260, entries=query-0000000000..query-0000000259, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000258, last_skipped_entry_name=none 2024.10.22 13:39:50.589116 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000259 2024.10.22 13:39:50.589122 [ 221779 ] {} DDLWorker: Checking task query-0000000259 2024.10.22 13:39:50.589547 [ 221779 ] {} DDLWorker: Processing task query-0000000259 (ALTER TABLE oximeter.fields_i16_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:50.596628 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i16_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:50.628397 [ 221779 ] {d537c9ea-b007-4ce7-8f5c-7a7dbbfe6169} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e399e050-193b-48c3-8c2d-025b9a07ce6b) /* ddl_entry=query-0000000259 */ ALTER TABLE oximeter.fields_i16_local MODIFY TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:50.632800 [ 221779 ] {d537c9ea-b007-4ce7-8f5c-7a7dbbfe6169} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Created log entry log-0000000001 to update table metadata to version 2 2024.10.22 13:39:50.632840 [ 221779 ] {d537c9ea-b007-4ce7-8f5c-7a7dbbfe6169} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:50.632850 [ 221779 ] {d537c9ea-b007-4ce7-8f5c-7a7dbbfe6169} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Waiting for 02 to process log entry 2024.10.22 13:39:50.632858 [ 221779 ] {d537c9ea-b007-4ce7-8f5c-7a7dbbfe6169} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Waiting for 02 to pull log-0000000001 to queue 2024.10.22 13:39:50.633204 [ 221661 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:50.636642 [ 221661 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:50.636658 [ 221661 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:50.636663 [ 221661 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:50.640121 [ 221779 ] {d537c9ea-b007-4ce7-8f5c-7a7dbbfe6169} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Looking for node corresponding to log-0000000001 in 02 queue 2024.10.22 13:39:50.643221 [ 221735 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:50.646763 [ 221779 ] {d537c9ea-b007-4ce7-8f5c-7a7dbbfe6169} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Waiting for queue-0000000001 to disappear from 02 queue 2024.10.22 13:39:50.647921 [ 221735 ] {} oximeter.fields_i16_local (d5ad83cf-9687-4724-a859-e5b8dfc5eef0): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:50.652521 [ 221735 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:50.659336 [ 221779 ] {d537c9ea-b007-4ce7-8f5c-7a7dbbfe6169} DDLWorker: Executed query: /* ddl_entry=query-0000000259 */ ALTER TABLE oximeter.fields_i16_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:50.659363 [ 221779 ] {} DDLWorker: Task query-0000000259 executed by current replica 2024.10.22 13:39:50.669333 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:50.701477 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:50.701485 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:50.704988 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=261, queue_size=261, entries=query-0000000000..query-0000000260, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000259, last_skipped_entry_name=none 2024.10.22 13:39:50.705002 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000260 2024.10.22 13:39:50.705008 [ 221779 ] {} DDLWorker: Checking task query-0000000260 2024.10.22 13:39:50.705382 [ 221779 ] {} DDLWorker: Processing task query-0000000260 (ALTER TABLE oximeter.fields_u16_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:50.708777 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u16_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:50.749184 [ 221617 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:50.752602 [ 221617 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:50.752616 [ 221617 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:50.752621 [ 221617 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:50.759015 [ 221740 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:50.763791 [ 221740 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:50.768427 [ 221740 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:50.781717 [ 221779 ] {} DDLWorker: Task query-0000000260 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:50.785251 [ 221779 ] {} DDLWorker: Task query-0000000260 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:50.788736 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:50.815056 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:50.815060 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:50.818682 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=262, queue_size=262, entries=query-0000000000..query-0000000261, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000260, last_skipped_entry_name=none 2024.10.22 13:39:50.818696 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000261 2024.10.22 13:39:50.818703 [ 221779 ] {} DDLWorker: Checking task query-0000000261 2024.10.22 13:39:50.819048 [ 221779 ] {} DDLWorker: Processing task query-0000000261 (ALTER TABLE oximeter.fields_u16_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:50.825678 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u16_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:50.855992 [ 221779 ] {c97d8c3b-6340-494e-92a4-4522669b9dea} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: a5a2c9b2-c4e8-4d69-9098-87fd3c3202ec) /* ddl_entry=query-0000000261 */ ALTER TABLE oximeter.fields_u16_local MATERIALIZE COLUMN last_updated_at (stage: Complete) 2024.10.22 13:39:50.863159 [ 221779 ] {c97d8c3b-6340-494e-92a4-4522669b9dea} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:50.863223 [ 221551 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Scheduling next merge selecting task after 12106ms 2024.10.22 13:39:50.863276 [ 221779 ] {c97d8c3b-6340-494e-92a4-4522669b9dea} DDLWorker: Executed query: /* ddl_entry=query-0000000261 */ ALTER TABLE oximeter.fields_u16_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:50.863292 [ 221779 ] {} DDLWorker: Task query-0000000261 executed by current replica 2024.10.22 13:39:50.863373 [ 221595 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:50.866737 [ 221595 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:50.866779 [ 221595 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:50.866788 [ 221595 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:50.870020 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:50.877272 [ 221595 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:50.881256 [ 221543 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Scheduling next merge selecting task after 15468ms 2024.10.22 13:39:50.928905 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:50.928913 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:50.932528 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=263, queue_size=263, entries=query-0000000000..query-0000000262, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000261, last_skipped_entry_name=none 2024.10.22 13:39:50.932548 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000262 2024.10.22 13:39:50.932560 [ 221779 ] {} DDLWorker: Checking task query-0000000262 2024.10.22 13:39:50.932952 [ 221779 ] {} DDLWorker: Processing task query-0000000262 (ALTER TABLE oximeter.fields_u16_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:50.939430 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u16_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:50.975253 [ 221570 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:50.982101 [ 221570 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:50.982117 [ 221570 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:50.982125 [ 221570 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:50.988770 [ 221733 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:50.992488 [ 221733 ] {} oximeter.fields_u16_local (9ec340f3-de4a-48f9-bba4-d8da6cc7212a): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:50.998146 [ 221733 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:51.008180 [ 221779 ] {} DDLWorker: Task query-0000000262 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:51.011714 [ 221779 ] {} DDLWorker: Task query-0000000262 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:51.015089 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:51.043316 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:51.043322 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:51.046781 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=264, queue_size=264, entries=query-0000000000..query-0000000263, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000262, last_skipped_entry_name=none 2024.10.22 13:39:51.046800 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000263 2024.10.22 13:39:51.046807 [ 221779 ] {} DDLWorker: Checking task query-0000000263 2024.10.22 13:39:51.047186 [ 221779 ] {} DDLWorker: Processing task query-0000000263 (ALTER TABLE oximeter.fields_i32_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:51.050662 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i32_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:51.078361 [ 221605 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 33605ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:51.093997 [ 221607 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:51.101099 [ 221607 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:51.101117 [ 221607 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:51.101123 [ 221607 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:51.108748 [ 221740 ] {} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:51.114361 [ 221740 ] {} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:51.119091 [ 221740 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:51.129015 [ 221779 ] {} DDLWorker: Task query-0000000263 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:51.129148 [ 221779 ] {} DDLWorker: Task query-0000000263 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:51.135654 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:51.156841 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:51.156854 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:51.157099 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=265, queue_size=265, entries=query-0000000000..query-0000000264, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000263, last_skipped_entry_name=none 2024.10.22 13:39:51.157113 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000264 2024.10.22 13:39:51.157119 [ 221779 ] {} DDLWorker: Checking task query-0000000264 2024.10.22 13:39:51.160384 [ 221779 ] {} DDLWorker: Processing task query-0000000264 (ALTER TABLE oximeter.fields_i32_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:51.163898 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i32_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:51.209846 [ 221779 ] {d58fbbaf-fe22-448b-8f02-8534a58d4d92} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f5460858-02df-481b-989f-f76d60cd54ac) /* ddl_entry=query-0000000264 */ ALTER TABLE oximeter.fields_i32_local MATERIALIZE COLUMN last_updated_at (stage: Complete) 2024.10.22 13:39:51.221822 [ 221779 ] {d58fbbaf-fe22-448b-8f02-8534a58d4d92} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Created mutation with ID 0000000000 (data versions: ) 2024.10.22 13:39:51.221886 [ 221576 ] {} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Scheduling next merge selecting task after 13139ms 2024.10.22 13:39:51.221915 [ 221779 ] {d58fbbaf-fe22-448b-8f02-8534a58d4d92} DDLWorker: Executed query: /* ddl_entry=query-0000000264 */ ALTER TABLE oximeter.fields_i32_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:51.221929 [ 221779 ] {} DDLWorker: Task query-0000000264 executed by current replica 2024.10.22 13:39:51.222002 [ 221535 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:51.225963 [ 221535 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:51.226014 [ 221535 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:51.226029 [ 221535 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:51.230178 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:51.234453 [ 221569 ] {} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Scheduling next merge selecting task after 16144ms 2024.10.22 13:39:51.242260 [ 221535 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:51.272598 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:51.272607 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:51.272937 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=266, queue_size=266, entries=query-0000000000..query-0000000265, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000264, last_skipped_entry_name=none 2024.10.22 13:39:51.272948 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000265 2024.10.22 13:39:51.272951 [ 221779 ] {} DDLWorker: Checking task query-0000000265 2024.10.22 13:39:51.276104 [ 221779 ] {} DDLWorker: Processing task query-0000000265 (ALTER TABLE oximeter.fields_i32_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:51.279125 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_i32_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:51.288893 [ 221771 ] {} SystemLog (system.trace_log): Flushing system log, 2 entries to flush up to offset 20 2024.10.22 13:39:51.289072 [ 221763 ] {} SystemLog (system.part_log): Flushing system log, 2 entries to flush up to offset 9 2024.10.22 13:39:51.289364 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:51.289386 [ 221771 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.56 GiB. 2024.10.22 13:39:51.289829 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:51.289849 [ 221763 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.56 GiB. 2024.10.22 13:39:51.289866 [ 221771 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 13:39:51.290260 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:51.290339 [ 221763 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 13:39:51.290434 [ 221771 ] {} SystemLog (system.trace_log): Flushed system log up to offset 20 2024.10.22 13:39:51.290698 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:51.290835 [ 221763 ] {} SystemLog (system.part_log): Flushed system log up to offset 9 2024.10.22 13:39:51.312938 [ 221770 ] {} SystemLog (system.query_log): Flushing system log, 72 entries to flush up to offset 406 2024.10.22 13:39:51.314678 [ 221779 ] {23693c3e-8cbe-4721-8426-691c9f132b3c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4981e904-98ca-42c1-b488-e39b0e415661) /* ddl_entry=query-0000000265 */ ALTER TABLE oximeter.fields_i32_local MODIFY TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:51.316203 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:51.316219 [ 221770 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.56 GiB. 2024.10.22 13:39:51.318063 [ 221770 ] {} MergedBlockOutputStream: filled checksums 202410_5_5_0 (state Temporary) 2024.10.22 13:39:51.318537 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Renaming temporary part tmp_insert_202410_5_5_0 to 202410_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:51.318738 [ 221770 ] {} SystemLog (system.query_log): Flushed system log up to offset 406 2024.10.22 13:39:51.319243 [ 221779 ] {23693c3e-8cbe-4721-8426-691c9f132b3c} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Created log entry log-0000000001 to update table metadata to version 2 2024.10.22 13:39:51.319277 [ 221779 ] {23693c3e-8cbe-4721-8426-691c9f132b3c} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:51.319288 [ 221779 ] {23693c3e-8cbe-4721-8426-691c9f132b3c} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Waiting for 02 to process log entry 2024.10.22 13:39:51.319295 [ 221779 ] {23693c3e-8cbe-4721-8426-691c9f132b3c} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Waiting for 02 to pull log-0000000001 to queue 2024.10.22 13:39:51.319680 [ 221643 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:51.323418 [ 221643 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:51.323434 [ 221643 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:51.323441 [ 221643 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:51.326932 [ 221779 ] {23693c3e-8cbe-4721-8426-691c9f132b3c} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Looking for node corresponding to log-0000000001 in 02 queue 2024.10.22 13:39:51.329993 [ 221733 ] {} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:51.333637 [ 221779 ] {23693c3e-8cbe-4721-8426-691c9f132b3c} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Waiting for queue-0000000001 to disappear from 02 queue 2024.10.22 13:39:51.334891 [ 221733 ] {} oximeter.fields_i32_local (7e213126-cb76-4dd1-a57e-bc790b9ffc46): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:51.339453 [ 221733 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:51.346330 [ 221779 ] {23693c3e-8cbe-4721-8426-691c9f132b3c} DDLWorker: Executed query: /* ddl_entry=query-0000000265 */ ALTER TABLE oximeter.fields_i32_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:51.346352 [ 221779 ] {} DDLWorker: Task query-0000000265 executed by current replica 2024.10.22 13:39:51.356138 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:51.384922 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:51.384946 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:51.385134 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=267, queue_size=267, entries=query-0000000000..query-0000000266, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000265, last_skipped_entry_name=none 2024.10.22 13:39:51.385145 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000266 2024.10.22 13:39:51.385149 [ 221779 ] {} DDLWorker: Checking task query-0000000266 2024.10.22 13:39:51.388680 [ 221779 ] {} DDLWorker: Processing task query-0000000266 (ALTER TABLE oximeter.fields_u32_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:51.392005 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u32_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:51.394217 [ 221765 ] {} SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 38 2024.10.22 13:39:51.406052 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:51.406073 [ 221765 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.56 GiB. 2024.10.22 13:39:51.411281 [ 221765 ] {} MergedBlockOutputStream: filled checksums 202410_5_5_0 (state Temporary) 2024.10.22 13:39:51.416054 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Renaming temporary part tmp_insert_202410_5_5_0 to 202410_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:51.417167 [ 221765 ] {} SystemLog (system.metric_log): Flushed system log up to offset 38 2024.10.22 13:39:51.432435 [ 221779 ] {8fbc2e23-2673-4e38-a859-015b04aa8d42} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 51815cc3-9e81-4c51-84e3-c685d911c63b) /* ddl_entry=query-0000000266 */ ALTER TABLE oximeter.fields_u32_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() (stage: Complete) 2024.10.22 13:39:51.439326 [ 221779 ] {8fbc2e23-2673-4e38-a859-015b04aa8d42} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Created log entry log-0000000000 to update table metadata to version 1 2024.10.22 13:39:51.439360 [ 221779 ] {8fbc2e23-2673-4e38-a859-015b04aa8d42} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:51.439367 [ 221779 ] {8fbc2e23-2673-4e38-a859-015b04aa8d42} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Waiting for 02 to process log entry 2024.10.22 13:39:51.439371 [ 221779 ] {8fbc2e23-2673-4e38-a859-015b04aa8d42} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Waiting for 02 to pull log-0000000000 to queue 2024.10.22 13:39:51.439752 [ 221623 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:51.443355 [ 221623 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:51.443370 [ 221623 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:51.443377 [ 221623 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:51.443480 [ 221779 ] {8fbc2e23-2673-4e38-a859-015b04aa8d42} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Looking for node corresponding to log-0000000000 in 02 queue 2024.10.22 13:39:51.446828 [ 221740 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:51.450403 [ 221779 ] {8fbc2e23-2673-4e38-a859-015b04aa8d42} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Waiting for queue-0000000000 to disappear from 02 queue 2024.10.22 13:39:51.451597 [ 221740 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:51.454793 [ 221740 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:51.461733 [ 221779 ] {8fbc2e23-2673-4e38-a859-015b04aa8d42} DDLWorker: Executed query: /* ddl_entry=query-0000000266 */ ALTER TABLE oximeter.fields_u32_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:51.461751 [ 221779 ] {} DDLWorker: Task query-0000000266 executed by current replica 2024.10.22 13:39:51.471580 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:51.501073 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:51.501081 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:51.501315 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=268, queue_size=268, entries=query-0000000000..query-0000000267, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000266, last_skipped_entry_name=none 2024.10.22 13:39:51.501330 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000267 2024.10.22 13:39:51.501338 [ 221779 ] {} DDLWorker: Checking task query-0000000267 2024.10.22 13:39:51.504804 [ 221779 ] {} DDLWorker: Processing task query-0000000267 (ALTER TABLE oximeter.fields_u32_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:51.508120 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u32_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:51.544986 [ 221646 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:51.545117 [ 221646 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:51.545152 [ 221646 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:51.545163 [ 221646 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:51.548570 [ 221779 ] {} DDLWorker: Task query-0000000267 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:51.552020 [ 221779 ] {} DDLWorker: Task query-0000000267 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:51.555388 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:51.559045 [ 221646 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:51.562541 [ 221581 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Scheduling next merge selecting task after 12186ms 2024.10.22 13:39:51.617164 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:51.617169 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:51.617384 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=269, queue_size=269, entries=query-0000000000..query-0000000268, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000267, last_skipped_entry_name=none 2024.10.22 13:39:51.617397 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000268 2024.10.22 13:39:51.617401 [ 221779 ] {} DDLWorker: Checking task query-0000000268 2024.10.22 13:39:51.620836 [ 221779 ] {} DDLWorker: Processing task query-0000000268 (ALTER TABLE oximeter.fields_u32_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:51.624169 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u32_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:51.660859 [ 221779 ] {33033c2a-5224-4206-946e-7addb2b8af5f} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4701db47-c1b9-4fae-928d-b32084fcc804) /* ddl_entry=query-0000000268 */ ALTER TABLE oximeter.fields_u32_local MODIFY TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.10.22 13:39:51.665082 [ 221779 ] {33033c2a-5224-4206-946e-7addb2b8af5f} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Created log entry log-0000000001 to update table metadata to version 2 2024.10.22 13:39:51.665126 [ 221779 ] {33033c2a-5224-4206-946e-7addb2b8af5f} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:51.665135 [ 221779 ] {33033c2a-5224-4206-946e-7addb2b8af5f} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Waiting for 02 to process log entry 2024.10.22 13:39:51.665141 [ 221779 ] {33033c2a-5224-4206-946e-7addb2b8af5f} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Waiting for 02 to pull log-0000000001 to queue 2024.10.22 13:39:51.665443 [ 221619 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:51.668819 [ 221619 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:51.668834 [ 221619 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:51.668845 [ 221619 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:51.669003 [ 221779 ] {33033c2a-5224-4206-946e-7addb2b8af5f} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Looking for node corresponding to log-0000000001 in 02 queue 2024.10.22 13:39:51.672552 [ 221741 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:51.672813 [ 221779 ] {33033c2a-5224-4206-946e-7addb2b8af5f} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Waiting for queue-0000000001 to disappear from 02 queue 2024.10.22 13:39:51.676305 [ 221741 ] {} oximeter.fields_u32_local (987eb66a-c14b-4b5d-a6c7-af473fe2ee3c): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:51.680145 [ 221741 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:51.683509 [ 221779 ] {33033c2a-5224-4206-946e-7addb2b8af5f} DDLWorker: Executed query: /* ddl_entry=query-0000000268 */ ALTER TABLE oximeter.fields_u32_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:51.683527 [ 221779 ] {} DDLWorker: Task query-0000000268 executed by current replica 2024.10.22 13:39:51.693413 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:51.733095 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:51.733102 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:51.733288 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=270, queue_size=270, entries=query-0000000000..query-0000000269, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000268, last_skipped_entry_name=none 2024.10.22 13:39:51.733299 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000269 2024.10.22 13:39:51.733304 [ 221779 ] {} DDLWorker: Checking task query-0000000269 2024.10.22 13:39:51.736725 [ 221779 ] {} DDLWorker: Processing task query-0000000269 (ALTER TABLE oximeter.fields_u64_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now()) 2024.10.22 13:39:51.740003 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u64_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:51.781111 [ 221779 ] {7aace5d6-777a-4265-a6be-4e53256745d4} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1e283f73-61fd-4f45-a98a-bde73efab8c2) /* ddl_entry=query-0000000269 */ ALTER TABLE oximeter.fields_u64_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() (stage: Complete) 2024.10.22 13:39:51.785042 [ 221779 ] {7aace5d6-777a-4265-a6be-4e53256745d4} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Created log entry log-0000000000 to update table metadata to version 1 2024.10.22 13:39:51.785074 [ 221779 ] {7aace5d6-777a-4265-a6be-4e53256745d4} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Updated shared metadata nodes in ZooKeeper. Waiting for replicas to apply changes. 2024.10.22 13:39:51.785086 [ 221779 ] {7aace5d6-777a-4265-a6be-4e53256745d4} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Waiting for 02 to process log entry 2024.10.22 13:39:51.785093 [ 221779 ] {7aace5d6-777a-4265-a6be-4e53256745d4} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Waiting for 02 to pull log-0000000000 to queue 2024.10.22 13:39:51.785442 [ 221589 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.10.22 13:39:51.788904 [ 221589 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:51.788919 [ 221589 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Adding alter metadata version 1 to the queue 2024.10.22 13:39:51.788927 [ 221589 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:51.789034 [ 221779 ] {7aace5d6-777a-4265-a6be-4e53256745d4} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Looking for node corresponding to log-0000000000 in 02 queue 2024.10.22 13:39:51.792334 [ 221733 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:51.795990 [ 221779 ] {7aace5d6-777a-4265-a6be-4e53256745d4} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Waiting for queue-0000000000 to disappear from 02 queue 2024.10.22 13:39:51.797143 [ 221733 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Applied changes to the metadata of the table. Current metadata version: 1 2024.10.22 13:39:51.801798 [ 221733 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 1 2024.10.22 13:39:51.808669 [ 221779 ] {7aace5d6-777a-4265-a6be-4e53256745d4} DDLWorker: Executed query: /* ddl_entry=query-0000000269 */ ALTER TABLE oximeter.fields_u64_local ADD COLUMN IF NOT EXISTS `last_updated_at` DateTime MATERIALIZED now() 2024.10.22 13:39:51.808696 [ 221779 ] {} DDLWorker: Task query-0000000269 executed by current replica 2024.10.22 13:39:51.818917 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:51.848838 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:51.848845 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:51.852354 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=271, queue_size=271, entries=query-0000000000..query-0000000270, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000269, last_skipped_entry_name=none 2024.10.22 13:39:51.852372 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000270 2024.10.22 13:39:51.852379 [ 221779 ] {} DDLWorker: Checking task query-0000000270 2024.10.22 13:39:51.856226 [ 221779 ] {} DDLWorker: Processing task query-0000000270 (ALTER TABLE oximeter.fields_u64_local MATERIALIZE COLUMN last_updated_at) 2024.10.22 13:39:51.862815 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u64_local MATERIALIZE COLUMN last_updated_at 2024.10.22 13:39:51.895455 [ 221655 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 33655ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:51.902205 [ 221583 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2024.10.22 13:39:51.905548 [ 221779 ] {} DDLWorker: Task query-0000000270 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:51.905558 [ 221583 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 0 partitions (data versions: ) 2024.10.22 13:39:51.905617 [ 221583 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000000 is done 2024.10.22 13:39:51.905628 [ 221583 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:51.908843 [ 221779 ] {} DDLWorker: Task query-0000000270 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:51.912241 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:51.912517 [ 221660 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Scheduling next merge selecting task after 13074ms 2024.10.22 13:39:51.916042 [ 221583 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Mutation 0000000000 is done 2024.10.22 13:39:51.964893 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:51.964906 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:51.965126 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=272, queue_size=272, entries=query-0000000000..query-0000000271, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000270, last_skipped_entry_name=none 2024.10.22 13:39:51.965134 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000271 2024.10.22 13:39:51.965139 [ 221779 ] {} DDLWorker: Checking task query-0000000271 2024.10.22 13:39:51.968808 [ 221779 ] {} DDLWorker: Processing task query-0000000271 (ALTER TABLE oximeter.fields_u64_local MODIFY TTL last_updated_at + toIntervalDay(30)) 2024.10.22 13:39:51.975750 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.fields_u64_local MODIFY TTL last_updated_at + toIntervalDay(30) 2024.10.22 13:39:52.000460 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 408.90 MiB, peak 418.16 MiB, free memory in arenas 40.43 MiB, will set to 416.23 MiB (RSS), difference: 7.33 MiB 2024.10.22 13:39:52.005350 [ 221640 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 35653ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:52.019285 [ 221666 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.10.22 13:39:52.023713 [ 221666 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type ALTER_METADATA with virtual parts [] 2024.10.22 13:39:52.023740 [ 221666 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Adding alter metadata version 2 to the queue 2024.10.22 13:39:52.023750 [ 221666 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:52.030051 [ 221735 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Metadata changed in ZooKeeper. Applying changes locally. 2024.10.22 13:39:52.034805 [ 221735 ] {} oximeter.fields_u64_local (f58d15d2-b41b-4822-8e1d-b1a332acd282): Applied changes to the metadata of the table. Current metadata version: 2 2024.10.22 13:39:52.039101 [ 221735 ] {} oximeter.fields_u64_local (ReplicatedMergeTreeQueue): Finishing metadata alter with version 2 2024.10.22 13:39:52.052254 [ 221779 ] {} DDLWorker: Task query-0000000271 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:52.055450 [ 221779 ] {} DDLWorker: Task query-0000000271 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:52.058629 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:52.088916 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:52.088926 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:52.089153 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=273, queue_size=273, entries=query-0000000000..query-0000000272, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000271, last_skipped_entry_name=none 2024.10.22 13:39:52.089164 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000272 2024.10.22 13:39:52.089168 [ 221779 ] {} DDLWorker: Checking task query-0000000272 2024.10.22 13:39:52.092468 [ 221779 ] {} DDLWorker: Processing task query-0000000272 (ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:52.096046 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.129005 [ 221779 ] {6a66e407-92ef-4c12-9249-08633f3cbdd6} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: fcb6fcd9-5834-4808-bd23-bd6773024b04) /* ddl_entry=query-0000000272 */ ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:52.136093 [ 221779 ] {6a66e407-92ef-4c12-9249-08633f3cbdd6} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:52.136160 [ 221779 ] {6a66e407-92ef-4c12-9249-08633f3cbdd6} DDLWorker: Executed query: /* ddl_entry=query-0000000272 */ ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.136174 [ 221779 ] {} DDLWorker: Task query-0000000272 executed by current replica 2024.10.22 13:39:52.136178 [ 221558 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:52.140172 [ 221558 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:52.140205 [ 221558 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:52.140210 [ 221558 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:52.143589 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:52.143828 [ 221555 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 41589ms 2024.10.22 13:39:52.153880 [ 221558 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:52.154223 [ 221555 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 50028ms 2024.10.22 13:39:52.208276 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:52.208285 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:52.208487 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=274, queue_size=274, entries=query-0000000000..query-0000000273, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000272, last_skipped_entry_name=none 2024.10.22 13:39:52.208501 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000273 2024.10.22 13:39:52.208506 [ 221779 ] {} DDLWorker: Checking task query-0000000273 2024.10.22 13:39:52.211658 [ 221600 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32667ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:52.211871 [ 221779 ] {} DDLWorker: Processing task query-0000000273 (ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:52.214966 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.253996 [ 221779 ] {b82fe531-f32d-422d-b65f-d8d4cacde81c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1533065a-52d9-4a59-8564-83f866c1ed7b) /* ddl_entry=query-0000000273 */ ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:52.260972 [ 221779 ] {b82fe531-f32d-422d-b65f-d8d4cacde81c} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:52.261066 [ 221779 ] {b82fe531-f32d-422d-b65f-d8d4cacde81c} DDLWorker: Executed query: /* ddl_entry=query-0000000273 */ ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.261083 [ 221617 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:52.261086 [ 221779 ] {} DDLWorker: Task query-0000000273 executed by current replica 2024.10.22 13:39:52.261333 [ 221617 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:52.261371 [ 221617 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:52.261379 [ 221617 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:52.268110 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:52.272059 [ 221546 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 31437ms 2024.10.22 13:39:52.278934 [ 221617 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:52.279228 [ 221546 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 39488ms 2024.10.22 13:39:52.324477 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:52.324481 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:52.324701 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=275, queue_size=275, entries=query-0000000000..query-0000000274, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000273, last_skipped_entry_name=none 2024.10.22 13:39:52.324710 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000274 2024.10.22 13:39:52.324715 [ 221779 ] {} DDLWorker: Checking task query-0000000274 2024.10.22 13:39:52.328550 [ 221779 ] {} DDLWorker: Processing task query-0000000274 (ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:52.335146 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.371789 [ 221779 ] {2d5e703c-3a56-4807-add2-4b13f9103741} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: cee4c1c9-628a-4327-b1fa-852b24e9d434) /* ddl_entry=query-0000000274 */ ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:52.378575 [ 221779 ] {2d5e703c-3a56-4807-add2-4b13f9103741} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:52.378684 [ 221779 ] {2d5e703c-3a56-4807-add2-4b13f9103741} DDLWorker: Executed query: /* ddl_entry=query-0000000274 */ ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.378702 [ 221779 ] {} DDLWorker: Task query-0000000274 executed by current replica 2024.10.22 13:39:52.378865 [ 221604 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:52.382099 [ 221604 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:52.382130 [ 221604 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:52.382139 [ 221604 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:52.385389 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:52.385594 [ 221595 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 43000ms 2024.10.22 13:39:52.392229 [ 221604 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:52.396113 [ 221595 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 55598ms 2024.10.22 13:39:52.439002 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:52.439008 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:52.439241 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=276, queue_size=276, entries=query-0000000000..query-0000000275, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000274, last_skipped_entry_name=none 2024.10.22 13:39:52.439253 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000275 2024.10.22 13:39:52.439263 [ 221779 ] {} DDLWorker: Checking task query-0000000275 2024.10.22 13:39:52.442711 [ 221779 ] {} DDLWorker: Processing task query-0000000275 (ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:52.445991 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.484800 [ 221779 ] {1dc71a60-9314-4345-9513-fd49c544154a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4216133a-0ddd-48e5-b426-58648e625363) /* ddl_entry=query-0000000275 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:52.491814 [ 221779 ] {1dc71a60-9314-4345-9513-fd49c544154a} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:52.491896 [ 221779 ] {1dc71a60-9314-4345-9513-fd49c544154a} DDLWorker: Executed query: /* ddl_entry=query-0000000275 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.491911 [ 221779 ] {} DDLWorker: Task query-0000000275 executed by current replica 2024.10.22 13:39:52.491945 [ 221601 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:52.495224 [ 221601 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:52.495259 [ 221601 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:52.495268 [ 221601 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:52.498485 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:52.501823 [ 221568 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:52.505521 [ 221601 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:52.508937 [ 221568 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:52.551976 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:52.551982 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:52.552196 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=277, queue_size=277, entries=query-0000000000..query-0000000276, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000275, last_skipped_entry_name=none 2024.10.22 13:39:52.552207 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000276 2024.10.22 13:39:52.552211 [ 221779 ] {} DDLWorker: Checking task query-0000000276 2024.10.22 13:39:52.555721 [ 221779 ] {} DDLWorker: Processing task query-0000000276 (ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:52.558939 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.596097 [ 221779 ] {a6e14444-0b7a-40cf-93c7-d80cb0a21821} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 953ad006-2912-429c-8b6a-197aae7d0c57) /* ddl_entry=query-0000000276 */ ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:52.605973 [ 221779 ] {a6e14444-0b7a-40cf-93c7-d80cb0a21821} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:52.606053 [ 221779 ] {a6e14444-0b7a-40cf-93c7-d80cb0a21821} DDLWorker: Executed query: /* ddl_entry=query-0000000276 */ ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.606071 [ 221779 ] {} DDLWorker: Task query-0000000276 executed by current replica 2024.10.22 13:39:52.606136 [ 221639 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:52.609537 [ 221639 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:52.609576 [ 221639 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:52.609585 [ 221639 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:52.612830 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:52.613058 [ 221549 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 49290ms 2024.10.22 13:39:52.620236 [ 221639 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:52.624142 [ 221549 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:52.671029 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:52.671036 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:52.674410 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=278, queue_size=278, entries=query-0000000000..query-0000000277, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000276, last_skipped_entry_name=none 2024.10.22 13:39:52.674424 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000277 2024.10.22 13:39:52.674431 [ 221779 ] {} DDLWorker: Checking task query-0000000277 2024.10.22 13:39:52.674761 [ 221779 ] {} DDLWorker: Processing task query-0000000277 (ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:52.677900 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.719118 [ 221779 ] {add0254e-0981-441d-8e3e-5ecd0a6b9a0b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b2d4c742-4c8d-46bf-8607-1388d84def8f) /* ddl_entry=query-0000000277 */ ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:52.726539 [ 221779 ] {add0254e-0981-441d-8e3e-5ecd0a6b9a0b} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:52.726600 [ 221779 ] {add0254e-0981-441d-8e3e-5ecd0a6b9a0b} DDLWorker: Executed query: /* ddl_entry=query-0000000277 */ ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.726610 [ 221779 ] {} DDLWorker: Task query-0000000277 executed by current replica 2024.10.22 13:39:52.726678 [ 221635 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:52.730118 [ 221635 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:52.730149 [ 221635 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:52.730156 [ 221635 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:52.736736 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:52.736891 [ 221569 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 31229ms 2024.10.22 13:39:52.740951 [ 221635 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:52.744395 [ 221569 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 41010ms 2024.10.22 13:39:52.784210 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:52.784216 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:52.787541 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=279, queue_size=279, entries=query-0000000000..query-0000000278, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000277, last_skipped_entry_name=none 2024.10.22 13:39:52.787553 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000278 2024.10.22 13:39:52.787558 [ 221779 ] {} DDLWorker: Checking task query-0000000278 2024.10.22 13:39:52.787896 [ 221779 ] {} DDLWorker: Processing task query-0000000278 (ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:52.791160 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.821059 [ 221779 ] {75316a7e-18db-4fdc-9380-0ab39d6dd213} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f6ff4ca6-8386-4ea4-b85f-2ff32a4973fc) /* ddl_entry=query-0000000278 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:52.821257 [ 221643 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 37787ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:52.828236 [ 221779 ] {75316a7e-18db-4fdc-9380-0ab39d6dd213} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:52.828337 [ 221779 ] {75316a7e-18db-4fdc-9380-0ab39d6dd213} DDLWorker: Executed query: /* ddl_entry=query-0000000278 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.828362 [ 221779 ] {} DDLWorker: Task query-0000000278 executed by current replica 2024.10.22 13:39:52.828490 [ 221609 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:52.832353 [ 221609 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:52.832387 [ 221609 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:52.832395 [ 221609 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:52.835966 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:52.839477 [ 221615 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:52.843164 [ 221609 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:52.843462 [ 221615 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:52.901546 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:52.901560 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:52.901798 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=280, queue_size=280, entries=query-0000000000..query-0000000279, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000278, last_skipped_entry_name=none 2024.10.22 13:39:52.901813 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000279 2024.10.22 13:39:52.901818 [ 221779 ] {} DDLWorker: Checking task query-0000000279 2024.10.22 13:39:52.905291 [ 221779 ] {} DDLWorker: Processing task query-0000000279 (ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:52.908810 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.947110 [ 221645 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 33995ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:52.950178 [ 221779 ] {346d633e-afe9-4231-b60f-fd9098e571a9} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ae0f92e6-6288-49a7-ade8-c241a623d458) /* ddl_entry=query-0000000279 */ ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:52.957165 [ 221779 ] {346d633e-afe9-4231-b60f-fd9098e571a9} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:52.957246 [ 221779 ] {346d633e-afe9-4231-b60f-fd9098e571a9} DDLWorker: Executed query: /* ddl_entry=query-0000000279 */ ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:52.957262 [ 221779 ] {} DDLWorker: Task query-0000000279 executed by current replica 2024.10.22 13:39:52.957351 [ 221647 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:52.960767 [ 221647 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:52.960797 [ 221647 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:52.960805 [ 221647 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:52.964041 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:52.967453 [ 221606 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 42571ms 2024.10.22 13:39:52.974047 [ 221647 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:52.974462 [ 221606 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 55735ms 2024.10.22 13:39:53.000650 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 416.34 MiB, peak 418.16 MiB, free memory in arenas 31.30 MiB, will set to 412.71 MiB (RSS), difference: -3.63 MiB 2024.10.22 13:39:53.021547 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:53.021554 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:53.024968 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=281, queue_size=281, entries=query-0000000000..query-0000000280, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000279, last_skipped_entry_name=none 2024.10.22 13:39:53.024980 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000280 2024.10.22 13:39:53.024984 [ 221779 ] {} DDLWorker: Checking task query-0000000280 2024.10.22 13:39:53.025291 [ 221779 ] {} DDLWorker: Processing task query-0000000280 (ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:53.028500 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.064350 [ 221779 ] {8a16bf5c-d519-4b99-b9e6-2e8d3d4bb0a5} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 7a7caf96-5d07-45de-aba3-56ecc31fab57) /* ddl_entry=query-0000000280 */ ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:53.071525 [ 221779 ] {8a16bf5c-d519-4b99-b9e6-2e8d3d4bb0a5} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:53.071605 [ 221779 ] {8a16bf5c-d519-4b99-b9e6-2e8d3d4bb0a5} DDLWorker: Executed query: /* ddl_entry=query-0000000280 */ ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.071619 [ 221779 ] {} DDLWorker: Task query-0000000280 executed by current replica 2024.10.22 13:39:53.071818 [ 221573 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:53.075230 [ 221573 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:53.075260 [ 221573 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:53.075265 [ 221573 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:53.078631 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:53.082130 [ 221581 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 28973ms 2024.10.22 13:39:53.085715 [ 221573 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:53.089055 [ 221581 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 34865ms 2024.10.22 13:39:53.133866 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:53.133875 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:53.134059 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=282, queue_size=282, entries=query-0000000000..query-0000000281, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000280, last_skipped_entry_name=none 2024.10.22 13:39:53.134068 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000281 2024.10.22 13:39:53.134077 [ 221779 ] {} DDLWorker: Checking task query-0000000281 2024.10.22 13:39:53.137431 [ 221779 ] {} DDLWorker: Processing task query-0000000281 (ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:53.141106 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.174279 [ 221779 ] {1d195262-d6e4-4462-a44b-9aaa91b2be23} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 36fd9364-abb2-430e-8510-80b6d63f1144) /* ddl_entry=query-0000000281 */ ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:53.181449 [ 221779 ] {1d195262-d6e4-4462-a44b-9aaa91b2be23} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:53.181532 [ 221779 ] {1d195262-d6e4-4462-a44b-9aaa91b2be23} DDLWorker: Executed query: /* ddl_entry=query-0000000281 */ ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.181554 [ 221779 ] {} DDLWorker: Task query-0000000281 executed by current replica 2024.10.22 13:39:53.181596 [ 221603 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:53.185041 [ 221603 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:53.185071 [ 221603 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:53.185078 [ 221603 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:53.188545 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:53.188813 [ 221644 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 33290ms 2024.10.22 13:39:53.192440 [ 221603 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:53.195871 [ 221644 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 41389ms 2024.10.22 13:39:53.249889 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:53.249898 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:53.250101 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=283, queue_size=283, entries=query-0000000000..query-0000000282, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000281, last_skipped_entry_name=none 2024.10.22 13:39:53.250113 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000282 2024.10.22 13:39:53.250117 [ 221779 ] {} DDLWorker: Checking task query-0000000282 2024.10.22 13:39:53.253545 [ 221779 ] {} DDLWorker: Processing task query-0000000282 (ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:53.256825 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.290865 [ 221779 ] {c0612238-2fe0-461c-b5a7-381908956d16} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e6dc30bc-957e-4608-b966-3848150bf83d) /* ddl_entry=query-0000000282 */ ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:53.300794 [ 221779 ] {c0612238-2fe0-461c-b5a7-381908956d16} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:53.300869 [ 221779 ] {c0612238-2fe0-461c-b5a7-381908956d16} DDLWorker: Executed query: /* ddl_entry=query-0000000282 */ ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.300885 [ 221779 ] {} DDLWorker: Task query-0000000282 executed by current replica 2024.10.22 13:39:53.300972 [ 221539 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:53.304721 [ 221539 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:53.304775 [ 221539 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:53.304788 [ 221539 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:53.308112 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:53.311565 [ 221659 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 41644ms 2024.10.22 13:39:53.318330 [ 221539 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:53.318644 [ 221659 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 54288ms 2024.10.22 13:39:53.365722 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:53.365730 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:53.365943 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=284, queue_size=284, entries=query-0000000000..query-0000000283, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000282, last_skipped_entry_name=none 2024.10.22 13:39:53.365956 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000283 2024.10.22 13:39:53.365961 [ 221779 ] {} DDLWorker: Checking task query-0000000283 2024.10.22 13:39:53.369599 [ 221779 ] {} DDLWorker: Processing task query-0000000283 (ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:53.372891 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.409043 [ 221779 ] {867f76d9-f0d7-4cf4-9a4d-fe5a2da56c84} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: f719b793-1fce-468b-8a54-02aa869839fd) /* ddl_entry=query-0000000283 */ ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:53.416298 [ 221779 ] {867f76d9-f0d7-4cf4-9a4d-fe5a2da56c84} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:53.416402 [ 221779 ] {867f76d9-f0d7-4cf4-9a4d-fe5a2da56c84} DDLWorker: Executed query: /* ddl_entry=query-0000000283 */ ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.416423 [ 221779 ] {} DDLWorker: Task query-0000000283 executed by current replica 2024.10.22 13:39:53.416436 [ 221622 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:53.420326 [ 221622 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:53.420358 [ 221622 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:53.420365 [ 221622 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:53.423734 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:53.426926 [ 221553 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 37792ms 2024.10.22 13:39:53.430614 [ 221622 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:53.434120 [ 221553 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 47455ms 2024.10.22 13:39:53.477901 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:53.477906 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:53.478116 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=285, queue_size=285, entries=query-0000000000..query-0000000284, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000283, last_skipped_entry_name=none 2024.10.22 13:39:53.478126 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000284 2024.10.22 13:39:53.478129 [ 221779 ] {} DDLWorker: Checking task query-0000000284 2024.10.22 13:39:53.481696 [ 221779 ] {} DDLWorker: Processing task query-0000000284 (ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:53.484903 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.525113 [ 221779 ] {869ace49-8205-4224-b824-899582605e1c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: a221f343-806a-4779-b234-d4ac91c138da) /* ddl_entry=query-0000000284 */ ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:53.532041 [ 221779 ] {869ace49-8205-4224-b824-899582605e1c} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:53.532110 [ 221779 ] {869ace49-8205-4224-b824-899582605e1c} DDLWorker: Executed query: /* ddl_entry=query-0000000284 */ ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.532122 [ 221779 ] {} DDLWorker: Task query-0000000284 executed by current replica 2024.10.22 13:39:53.532179 [ 221637 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:53.535698 [ 221637 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:53.535731 [ 221637 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:53.535737 [ 221637 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:53.539333 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:53.543022 [ 221658 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 48410ms 2024.10.22 13:39:53.549667 [ 221637 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:53.549990 [ 221658 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 58761ms 2024.10.22 13:39:53.594096 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:53.594100 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:53.599058 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=286, queue_size=286, entries=query-0000000000..query-0000000285, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000284, last_skipped_entry_name=none 2024.10.22 13:39:53.599068 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000285 2024.10.22 13:39:53.599072 [ 221779 ] {} DDLWorker: Checking task query-0000000285 2024.10.22 13:39:53.599364 [ 221779 ] {} DDLWorker: Processing task query-0000000285 (ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:53.602604 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.644921 [ 221779 ] {b3ca85c4-8e4b-427c-8712-9345eb97bc95} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e9fdbd99-498e-40c4-bb6e-f4cb96a5fa37) /* ddl_entry=query-0000000285 */ ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:53.651637 [ 221779 ] {b3ca85c4-8e4b-427c-8712-9345eb97bc95} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:53.651733 [ 221779 ] {b3ca85c4-8e4b-427c-8712-9345eb97bc95} DDLWorker: Executed query: /* ddl_entry=query-0000000285 */ ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.651749 [ 221779 ] {} DDLWorker: Task query-0000000285 executed by current replica 2024.10.22 13:39:53.651779 [ 221598 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:53.657124 [ 221598 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:53.657158 [ 221598 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:53.657166 [ 221598 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:53.660342 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:53.663845 [ 221596 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 56179ms 2024.10.22 13:39:53.667987 [ 221598 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:53.672052 [ 221596 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:53.708515 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:53.708539 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:53.712392 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=287, queue_size=287, entries=query-0000000000..query-0000000286, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000285, last_skipped_entry_name=none 2024.10.22 13:39:53.712412 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000286 2024.10.22 13:39:53.712417 [ 221779 ] {} DDLWorker: Checking task query-0000000286 2024.10.22 13:39:53.712776 [ 221779 ] {} DDLWorker: Processing task query-0000000286 (ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:53.716223 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.730273 [ 221597 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 38283ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:53.754099 [ 221616 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:53.754292 [ 221616 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:53.754331 [ 221616 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:53.754341 [ 221616 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:53.757735 [ 221779 ] {} DDLWorker: Task query-0000000286 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:53.757898 [ 221779 ] {} DDLWorker: Task query-0000000286 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:53.764239 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:53.768285 [ 221616 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:53.768953 [ 221543 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 25396ms 2024.10.22 13:39:53.824729 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:53.824801 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:53.825138 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=288, queue_size=288, entries=query-0000000000..query-0000000287, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000286, last_skipped_entry_name=none 2024.10.22 13:39:53.825150 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000287 2024.10.22 13:39:53.825154 [ 221779 ] {} DDLWorker: Checking task query-0000000287 2024.10.22 13:39:53.828843 [ 221779 ] {} DDLWorker: Processing task query-0000000287 (ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:53.835743 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.872994 [ 221570 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:53.873156 [ 221570 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:53.873193 [ 221570 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:53.873202 [ 221570 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:53.876280 [ 221779 ] {} DDLWorker: Task query-0000000287 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:53.876434 [ 221779 ] {} DDLWorker: Task query-0000000287 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:53.883110 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:53.886422 [ 221570 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:53.889982 [ 221565 ] {} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Scheduling next merge selecting task after 36776ms 2024.10.22 13:39:53.894812 [ 221542 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 36835ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:53.944851 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:53.944903 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:53.945163 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=289, queue_size=289, entries=query-0000000000..query-0000000288, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000287, last_skipped_entry_name=none 2024.10.22 13:39:53.945175 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000288 2024.10.22 13:39:53.945182 [ 221779 ] {} DDLWorker: Checking task query-0000000288 2024.10.22 13:39:53.948526 [ 221779 ] {} DDLWorker: Processing task query-0000000288 (ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:53.952098 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.975239 [ 221779 ] {420d0d49-a97b-4bf3-b789-bde181d0b5d0} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d9db42c8-61cd-4b31-bde8-e0174cf3dd3e) /* ddl_entry=query-0000000288 */ ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:53.981366 [ 221537 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32243ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:53.984396 [ 221779 ] {420d0d49-a97b-4bf3-b789-bde181d0b5d0} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:53.984488 [ 221779 ] {420d0d49-a97b-4bf3-b789-bde181d0b5d0} DDLWorker: Executed query: /* ddl_entry=query-0000000288 */ ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:53.984502 [ 221779 ] {} DDLWorker: Task query-0000000288 executed by current replica 2024.10.22 13:39:53.984535 [ 221639 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:53.987763 [ 221639 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:53.987795 [ 221639 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:53.987803 [ 221639 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:53.991109 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:53.994313 [ 221549 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 26300ms 2024.10.22 13:39:53.997798 [ 221639 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:54.001491 [ 221549 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 34151ms 2024.10.22 13:39:54.059971 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:54.059983 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:54.060232 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=290, queue_size=290, entries=query-0000000000..query-0000000289, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000288, last_skipped_entry_name=none 2024.10.22 13:39:54.060242 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000289 2024.10.22 13:39:54.060245 [ 221779 ] {} DDLWorker: Checking task query-0000000289 2024.10.22 13:39:54.063742 [ 221779 ] {} DDLWorker: Processing task query-0000000289 (ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:54.066992 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.104854 [ 221779 ] {58d7c30c-55c7-4821-a19e-9262519cfe5c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 9d37150c-4a3c-4d51-ad68-cce826cd1acb) /* ddl_entry=query-0000000289 */ ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:54.114264 [ 221779 ] {58d7c30c-55c7-4821-a19e-9262519cfe5c} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:54.114347 [ 221612 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:54.114363 [ 221779 ] {58d7c30c-55c7-4821-a19e-9262519cfe5c} DDLWorker: Executed query: /* ddl_entry=query-0000000289 */ ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.114378 [ 221779 ] {} DDLWorker: Task query-0000000289 executed by current replica 2024.10.22 13:39:54.114528 [ 221612 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:54.114555 [ 221612 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:54.114561 [ 221612 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:54.121187 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:54.121208 [ 221535 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 36565ms 2024.10.22 13:39:54.128165 [ 221612 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:54.131566 [ 221535 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 47071ms 2024.10.22 13:39:54.173069 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:54.173073 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:54.173302 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=291, queue_size=291, entries=query-0000000000..query-0000000290, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000289, last_skipped_entry_name=none 2024.10.22 13:39:54.173315 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000290 2024.10.22 13:39:54.173319 [ 221779 ] {} DDLWorker: Checking task query-0000000290 2024.10.22 13:39:54.177193 [ 221779 ] {} DDLWorker: Processing task query-0000000290 (ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:54.180402 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.219618 [ 221779 ] {732b5766-b302-4d22-ba94-8c171e951947} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 048727fe-18ae-4484-b18a-3fb4f5831ab2) /* ddl_entry=query-0000000290 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:54.227149 [ 221779 ] {732b5766-b302-4d22-ba94-8c171e951947} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:54.227225 [ 221779 ] {732b5766-b302-4d22-ba94-8c171e951947} DDLWorker: Executed query: /* ddl_entry=query-0000000290 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.227238 [ 221779 ] {} DDLWorker: Task query-0000000290 executed by current replica 2024.10.22 13:39:54.227268 [ 221630 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:54.230697 [ 221630 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:54.230728 [ 221630 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:54.230737 [ 221630 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:54.234091 [ 221631 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:54.234130 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:54.244426 [ 221630 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:54.244605 [ 221631 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:54.261983 [ 221641 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 33209ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:54.289386 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:54.289388 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:54.292604 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=292, queue_size=292, entries=query-0000000000..query-0000000291, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000290, last_skipped_entry_name=none 2024.10.22 13:39:54.292614 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000291 2024.10.22 13:39:54.292618 [ 221779 ] {} DDLWorker: Checking task query-0000000291 2024.10.22 13:39:54.292955 [ 221779 ] {} DDLWorker: Processing task query-0000000291 (ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:54.296380 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.333161 [ 221779 ] {edc41dba-a271-4205-ad37-2d5502679617} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 45823e26-d92a-4e34-9c9c-f217b846f038) /* ddl_entry=query-0000000291 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:54.340351 [ 221779 ] {edc41dba-a271-4205-ad37-2d5502679617} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:54.340445 [ 221779 ] {edc41dba-a271-4205-ad37-2d5502679617} DDLWorker: Executed query: /* ddl_entry=query-0000000291 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.340465 [ 221779 ] {} DDLWorker: Task query-0000000291 executed by current replica 2024.10.22 13:39:54.340492 [ 221615 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:54.344059 [ 221615 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:54.344099 [ 221615 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:54.344108 [ 221615 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:54.347936 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:54.351199 [ 221627 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:54.358045 [ 221615 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:54.358356 [ 221627 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:54.401924 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:54.401935 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:54.405271 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=293, queue_size=293, entries=query-0000000000..query-0000000292, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000291, last_skipped_entry_name=none 2024.10.22 13:39:54.405282 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000292 2024.10.22 13:39:54.405286 [ 221779 ] {} DDLWorker: Checking task query-0000000292 2024.10.22 13:39:54.405668 [ 221779 ] {} DDLWorker: Processing task query-0000000292 (ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:54.409366 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.457229 [ 221590 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:54.460900 [ 221779 ] {} DDLWorker: Task query-0000000292 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:54.460934 [ 221590 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:54.461003 [ 221590 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:54.461017 [ 221590 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:54.461101 [ 221779 ] {} DDLWorker: Task query-0000000292 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:54.467519 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:54.471003 [ 221590 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:54.474587 [ 221633 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 44029ms 2024.10.22 13:39:54.517096 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:54.517101 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:54.517337 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=294, queue_size=294, entries=query-0000000000..query-0000000293, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000292, last_skipped_entry_name=none 2024.10.22 13:39:54.517359 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000293 2024.10.22 13:39:54.517367 [ 221779 ] {} DDLWorker: Checking task query-0000000293 2024.10.22 13:39:54.520667 [ 221779 ] {} DDLWorker: Processing task query-0000000293 (ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:54.524003 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.557495 [ 221779 ] {cd623563-9e29-47f8-9564-316764f54a07} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6531fb44-5d43-495a-b168-9f084fcbe273) /* ddl_entry=query-0000000293 */ ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:54.564541 [ 221779 ] {cd623563-9e29-47f8-9564-316764f54a07} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:54.564637 [ 221779 ] {cd623563-9e29-47f8-9564-316764f54a07} DDLWorker: Executed query: /* ddl_entry=query-0000000293 */ ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.564657 [ 221779 ] {} DDLWorker: Task query-0000000293 executed by current replica 2024.10.22 13:39:54.564664 [ 221533 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:54.568256 [ 221533 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:54.568288 [ 221533 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:54.568293 [ 221533 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:54.571652 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:54.574909 [ 221578 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 44416ms 2024.10.22 13:39:54.578507 [ 221533 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:54.582117 [ 221578 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 56905ms 2024.10.22 13:39:54.631068 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:54.631075 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:54.631340 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=295, queue_size=295, entries=query-0000000000..query-0000000294, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000293, last_skipped_entry_name=none 2024.10.22 13:39:54.631363 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000294 2024.10.22 13:39:54.631369 [ 221779 ] {} DDLWorker: Checking task query-0000000294 2024.10.22 13:39:54.634665 [ 221779 ] {} DDLWorker: Processing task query-0000000294 (ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:54.640992 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.676195 [ 221779 ] {fba6b2cf-0bae-4487-87ed-92b3b2aac2bf} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 40ff6f92-3c2e-4d22-877d-bf9176ef7954) /* ddl_entry=query-0000000294 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:54.683547 [ 221779 ] {fba6b2cf-0bae-4487-87ed-92b3b2aac2bf} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:54.683640 [ 221779 ] {fba6b2cf-0bae-4487-87ed-92b3b2aac2bf} DDLWorker: Executed query: /* ddl_entry=query-0000000294 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.683655 [ 221779 ] {} DDLWorker: Task query-0000000294 executed by current replica 2024.10.22 13:39:54.683672 [ 221628 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:54.687208 [ 221628 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:54.687242 [ 221628 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:54.687249 [ 221628 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:54.690479 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:54.693938 [ 221589 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:54.697625 [ 221628 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:54.701067 [ 221589 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:54.749841 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:54.749850 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:54.750047 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=296, queue_size=296, entries=query-0000000000..query-0000000295, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000294, last_skipped_entry_name=none 2024.10.22 13:39:54.750056 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000295 2024.10.22 13:39:54.750059 [ 221779 ] {} DDLWorker: Checking task query-0000000295 2024.10.22 13:39:54.753407 [ 221779 ] {} DDLWorker: Processing task query-0000000295 (ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:54.756732 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.796164 [ 221779 ] {92c397fe-9e98-40bd-94cd-111cac3c155f} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: a4cb2be3-8244-456b-b7eb-d7f97fdd5f80) /* ddl_entry=query-0000000295 */ ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:54.803278 [ 221779 ] {92c397fe-9e98-40bd-94cd-111cac3c155f} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:54.803356 [ 221779 ] {92c397fe-9e98-40bd-94cd-111cac3c155f} DDLWorker: Executed query: /* ddl_entry=query-0000000295 */ ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.803370 [ 221779 ] {} DDLWorker: Task query-0000000295 executed by current replica 2024.10.22 13:39:54.803507 [ 221655 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:54.806832 [ 221655 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:54.806868 [ 221655 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:54.806876 [ 221655 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:54.810110 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:54.810393 [ 221668 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 43528ms 2024.10.22 13:39:54.820676 [ 221655 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:54.821047 [ 221668 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 56105ms 2024.10.22 13:39:54.865931 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:54.865935 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:54.869354 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=297, queue_size=297, entries=query-0000000000..query-0000000296, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000295, last_skipped_entry_name=none 2024.10.22 13:39:54.869365 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000296 2024.10.22 13:39:54.869369 [ 221779 ] {} DDLWorker: Checking task query-0000000296 2024.10.22 13:39:54.869687 [ 221779 ] {} DDLWorker: Processing task query-0000000296 (ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:54.872934 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.913553 [ 221779 ] {620ba72a-add0-48a2-a470-e3b3e6aa0908} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 23f51753-d692-44db-a8e9-63c109de87d9) /* ddl_entry=query-0000000296 */ ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:54.922074 [ 221779 ] {620ba72a-add0-48a2-a470-e3b3e6aa0908} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:54.922161 [ 221779 ] {620ba72a-add0-48a2-a470-e3b3e6aa0908} DDLWorker: Executed query: /* ddl_entry=query-0000000296 */ ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:54.922176 [ 221779 ] {} DDLWorker: Task query-0000000296 executed by current replica 2024.10.22 13:39:54.922197 [ 221662 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:54.925663 [ 221662 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:54.925693 [ 221662 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:54.925702 [ 221662 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:54.928673 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:54.928910 [ 221666 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 39157ms 2024.10.22 13:39:54.944972 [ 221662 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:54.948410 [ 221666 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 47858ms 2024.10.22 13:39:54.982233 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:54.982240 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:54.985657 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=298, queue_size=298, entries=query-0000000000..query-0000000297, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000296, last_skipped_entry_name=none 2024.10.22 13:39:54.985671 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000297 2024.10.22 13:39:54.985675 [ 221779 ] {} DDLWorker: Checking task query-0000000297 2024.10.22 13:39:54.985948 [ 221779 ] {} DDLWorker: Processing task query-0000000297 (ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:54.989146 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:55.024985 [ 221779 ] {1367b02c-1e30-479b-bb69-7438dc62abe4} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4b9e186c-5a02-4e25-996f-e511f4b0d4cf) /* ddl_entry=query-0000000297 */ ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:55.032229 [ 221779 ] {1367b02c-1e30-479b-bb69-7438dc62abe4} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:55.032332 [ 221779 ] {1367b02c-1e30-479b-bb69-7438dc62abe4} DDLWorker: Executed query: /* ddl_entry=query-0000000297 */ ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:55.032352 [ 221779 ] {} DDLWorker: Task query-0000000297 executed by current replica 2024.10.22 13:39:55.032419 [ 221558 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:55.035745 [ 221558 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:55.035772 [ 221558 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:55.035779 [ 221558 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:55.039106 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:55.042563 [ 221555 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 51942ms 2024.10.22 13:39:55.049151 [ 221558 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:55.049616 [ 221555 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.095915 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:55.095938 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:55.096289 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=299, queue_size=299, entries=query-0000000000..query-0000000298, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000297, last_skipped_entry_name=none 2024.10.22 13:39:55.096300 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000298 2024.10.22 13:39:55.096305 [ 221779 ] {} DDLWorker: Checking task query-0000000298 2024.10.22 13:39:55.100188 [ 221779 ] {} DDLWorker: Processing task query-0000000298 (ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:55.103960 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:55.148720 [ 221596 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:55.148979 [ 221596 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:55.149021 [ 221596 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:55.149030 [ 221596 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:55.152364 [ 221779 ] {} DDLWorker: Task query-0000000298 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:55.155667 [ 221779 ] {} DDLWorker: Task query-0000000298 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:55.159018 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:55.162417 [ 221596 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:55.165848 [ 221599 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.208995 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:55.209038 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:55.209286 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=300, queue_size=300, entries=query-0000000000..query-0000000299, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000298, last_skipped_entry_name=none 2024.10.22 13:39:55.209298 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000299 2024.10.22 13:39:55.209303 [ 221779 ] {} DDLWorker: Checking task query-0000000299 2024.10.22 13:39:55.212688 [ 221779 ] {} DDLWorker: Processing task query-0000000299 (ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:55.215966 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:55.255742 [ 221779 ] {a139d163-2ceb-4c79-a82e-5f1252e7e0a4} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 13dedd15-f301-4790-9903-7d5ae0b8229d) /* ddl_entry=query-0000000299 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:55.263897 [ 221779 ] {a139d163-2ceb-4c79-a82e-5f1252e7e0a4} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Created mutation with ID 0000000004 (data versions: ) 2024.10.22 13:39:55.263985 [ 221551 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000004 - 0000000004 2024.10.22 13:39:55.263989 [ 221779 ] {a139d163-2ceb-4c79-a82e-5f1252e7e0a4} DDLWorker: Executed query: /* ddl_entry=query-0000000299 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:55.264023 [ 221779 ] {} DDLWorker: Task query-0000000299 executed by current replica 2024.10.22 13:39:55.264154 [ 221551 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Adding mutation 0000000004 for 0 partitions (data versions: ) 2024.10.22 13:39:55.264183 [ 221551 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000004 is done 2024.10.22 13:39:55.264190 [ 221551 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:55.271473 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:55.271981 [ 221548 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.281847 [ 221551 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Mutation 0000000004 is done 2024.10.22 13:39:55.282143 [ 221548 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.326550 [ 221653 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000009 - log-0000000009 2024.10.22 13:39:55.330448 [ 221653 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000009 to queue with type GET_PART with virtual parts [all_8_8_0] 2024.10.22 13:39:55.330466 [ 221653 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:55.336992 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_8_8_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:55.337160 [ 221730 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_8_8_0&client_protocol_version=8&compress=false 2024.10.22 13:39:55.337835 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:55.337849 [ 221730 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.55 GiB. 2024.10.22 13:39:55.337854 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:39:55.337862 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_8_8_0 onto disk default. 2024.10.22 13:39:55.339818 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_8_8_0 onto disk default finished. 2024.10.22 13:39:55.339835 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_8_8_0 to all_8_8_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:55.339863 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_8_8_0 to zookeeper 2024.10.22 13:39:55.348203 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:55.348207 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:55.348470 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=301, queue_size=301, entries=query-0000000000..query-0000000300, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000299, last_skipped_entry_name=none 2024.10.22 13:39:55.348480 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000300 2024.10.22 13:39:55.348486 [ 221779 ] {} DDLWorker: Checking task query-0000000300 2024.10.22 13:39:55.355632 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_8_8_0 committed to zookeeper 2024.10.22 13:39:55.355678 [ 221730 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_8_8_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:55.355716 [ 221605 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=88878569472, merge_with_ttl_allowedtrue) 2024.10.22 13:39:55.355731 [ 221605 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.356268 [ 221779 ] {} DDLWorker: Processing task query-0000000300 (ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:55.363005 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:55.402159 [ 221601 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:55.405677 [ 221779 ] {} DDLWorker: Task query-0000000300 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:55.405716 [ 221601 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:55.405780 [ 221568 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:55.405818 [ 221568 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:55.405968 [ 221779 ] {} DDLWorker: Task query-0000000300 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:55.412530 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:55.412946 [ 221601 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.420261 [ 221568 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:55.472482 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:55.472490 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:55.472738 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=302, queue_size=302, entries=query-0000000000..query-0000000301, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000300, last_skipped_entry_name=none 2024.10.22 13:39:55.472750 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000301 2024.10.22 13:39:55.472755 [ 221779 ] {} DDLWorker: Checking task query-0000000301 2024.10.22 13:39:55.476523 [ 221779 ] {} DDLWorker: Processing task query-0000000301 (ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:55.481862 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:55.521300 [ 221779 ] {26d7c489-5c7a-4116-9a9a-63ca82759577} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 643c3d79-5132-4f75-b150-bef5c5401e84) /* ddl_entry=query-0000000301 */ ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:55.528599 [ 221779 ] {26d7c489-5c7a-4116-9a9a-63ca82759577} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:55.528723 [ 221779 ] {26d7c489-5c7a-4116-9a9a-63ca82759577} DDLWorker: Executed query: /* ddl_entry=query-0000000301 */ ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:55.528745 [ 221779 ] {} DDLWorker: Task query-0000000301 executed by current replica 2024.10.22 13:39:55.528799 [ 221585 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:55.533020 [ 221585 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:55.533088 [ 221585 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:55.533097 [ 221585 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:55.536686 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:55.537063 [ 221602 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 51223ms 2024.10.22 13:39:55.540588 [ 221585 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:55.544385 [ 221602 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.590896 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:55.590921 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:55.591116 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=303, queue_size=303, entries=query-0000000000..query-0000000302, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000301, last_skipped_entry_name=none 2024.10.22 13:39:55.591129 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000302 2024.10.22 13:39:55.591132 [ 221779 ] {} DDLWorker: Checking task query-0000000302 2024.10.22 13:39:55.594485 [ 221779 ] {} DDLWorker: Processing task query-0000000302 (ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:55.597847 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:55.638842 [ 221779 ] {7b6cb284-07f5-4452-a432-f39d43c9dfa8} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 2810976b-2268-440d-8806-c674bd94d4a5) /* ddl_entry=query-0000000302 */ ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:55.645791 [ 221779 ] {7b6cb284-07f5-4452-a432-f39d43c9dfa8} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:55.645881 [ 221779 ] {7b6cb284-07f5-4452-a432-f39d43c9dfa8} DDLWorker: Executed query: /* ddl_entry=query-0000000302 */ ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:55.645896 [ 221779 ] {} DDLWorker: Task query-0000000302 executed by current replica 2024.10.22 13:39:55.645927 [ 221569 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:55.649360 [ 221569 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:55.649396 [ 221569 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:55.649405 [ 221569 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:55.652799 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:55.653129 [ 221636 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.660136 [ 221569 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:55.664366 [ 221636 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.707168 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:55.707176 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:55.707386 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=304, queue_size=304, entries=query-0000000000..query-0000000303, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000302, last_skipped_entry_name=none 2024.10.22 13:39:55.707397 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000303 2024.10.22 13:39:55.707401 [ 221779 ] {} DDLWorker: Checking task query-0000000303 2024.10.22 13:39:55.710782 [ 221779 ] {} DDLWorker: Processing task query-0000000303 (ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:55.714148 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:55.748928 [ 221779 ] {e9f7275f-1d1c-4b31-8bed-15f6d8ee7678} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: e1ad67ce-11da-4b16-95c8-5f7874123cb0) /* ddl_entry=query-0000000303 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:55.756555 [ 221779 ] {e9f7275f-1d1c-4b31-8bed-15f6d8ee7678} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:55.756642 [ 221779 ] {e9f7275f-1d1c-4b31-8bed-15f6d8ee7678} DDLWorker: Executed query: /* ddl_entry=query-0000000303 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:55.756660 [ 221779 ] {} DDLWorker: Task query-0000000303 executed by current replica 2024.10.22 13:39:55.756691 [ 221630 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:55.760368 [ 221630 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:55.760403 [ 221630 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:55.760408 [ 221630 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:55.763708 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:55.767148 [ 221631 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.770771 [ 221630 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:55.774241 [ 221631 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.783806 [ 221609 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 37143ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:55.791191 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1629 entries to flush up to offset 9869 2024.10.22 13:39:55.792615 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:55.792632 [ 221768 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.55 GiB. 2024.10.22 13:39:55.793126 [ 221768 ] {} MergedBlockOutputStream: filled checksums 202410_6_6_0 (state Temporary) 2024.10.22 13:39:55.793436 [ 221768 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Renaming temporary part tmp_insert_202410_6_6_0 to 202410_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:55.793536 [ 221584 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185) (MergerMutator): Selected 6 parts from 202410_1_1_0 to 202410_6_6_0 2024.10.22 13:39:55.793538 [ 221768 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 9869 2024.10.22 13:39:55.793565 [ 221584 ] {} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:55.793575 [ 221584 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.55 GiB. 2024.10.22 13:39:55.793732 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} MergeTask::PrepareStage: Merging 6 parts: from 202410_1_1_0 to 202410_6_6_0 into Compact with storage Full 2024.10.22 13:39:55.793802 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 13:39:55.793826 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_1_1_0, total 1736 rows starting from the beginning of the part 2024.10.22 13:39:55.793890 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_2_2_0, total 1631 rows starting from the beginning of the part 2024.10.22 13:39:55.793953 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_3_3_0, total 1629 rows starting from the beginning of the part 2024.10.22 13:39:55.794017 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_4_4_0, total 1623 rows starting from the beginning of the part 2024.10.22 13:39:55.794069 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_5_5_0, total 1621 rows starting from the beginning of the part 2024.10.22 13:39:55.794116 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_6_6_0, total 1629 rows starting from the beginning of the part 2024.10.22 13:39:55.796791 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} MergeTask::MergeProjectionsStage: Merge sorted 9869 rows, containing 4 columns (4 merged, 0 gathered) in 0.0031421 sec., 3140893.0333216637 rows/sec., 44.93 MiB/sec. 2024.10.22 13:39:55.797005 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} MergedBlockOutputStream: filled checksums 202410_1_6_1 (state Temporary) 2024.10.22 13:39:55.797210 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185): Renaming temporary part tmp_merge_202410_1_6_1 to 202410_1_6_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:55.797243 [ 221717 ] {75277011-29da-4f73-a8d2-135c23e50185::202410_1_6_1} system.asynchronous_metric_log (75277011-29da-4f73-a8d2-135c23e50185) (MergerMutator): Merged 6 parts: [202410_1_1_0, 202410_6_6_0] -> 202410_1_6_1 2024.10.22 13:39:55.797300 [ 221717 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 6.69 MiB. 2024.10.22 13:39:55.823715 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:55.823731 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:55.824129 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=305, queue_size=305, entries=query-0000000000..query-0000000304, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000303, last_skipped_entry_name=none 2024.10.22 13:39:55.824144 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000304 2024.10.22 13:39:55.824148 [ 221779 ] {} DDLWorker: Checking task query-0000000304 2024.10.22 13:39:55.827590 [ 221779 ] {} DDLWorker: Processing task query-0000000304 (ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:55.834046 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:55.878902 [ 221534 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:55.882274 [ 221779 ] {} DDLWorker: Task query-0000000304 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:55.882318 [ 221534 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:55.882364 [ 221534 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:55.882382 [ 221534 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:55.882441 [ 221779 ] {} DDLWorker: Task query-0000000304 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:55.889443 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:55.893206 [ 221534 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:55.897020 [ 221626 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:55.943298 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:55.943305 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:55.943549 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=306, queue_size=306, entries=query-0000000000..query-0000000305, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000304, last_skipped_entry_name=none 2024.10.22 13:39:55.943559 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000305 2024.10.22 13:39:55.943569 [ 221779 ] {} DDLWorker: Checking task query-0000000305 2024.10.22 13:39:55.946965 [ 221779 ] {} DDLWorker: Processing task query-0000000305 (ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:55.950783 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:55.980754 [ 221779 ] {0747845e-658e-4439-8cec-c2bb575be7a2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c1f6f6aa-fc0e-42f6-8336-a721d3d32bb0) /* ddl_entry=query-0000000305 */ ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:55.988246 [ 221779 ] {0747845e-658e-4439-8cec-c2bb575be7a2} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:55.988331 [ 221779 ] {0747845e-658e-4439-8cec-c2bb575be7a2} DDLWorker: Executed query: /* ddl_entry=query-0000000305 */ ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:55.988348 [ 221779 ] {} DDLWorker: Task query-0000000305 executed by current replica 2024.10.22 13:39:55.988394 [ 221590 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:55.992306 [ 221590 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:55.992339 [ 221590 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:55.992348 [ 221590 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:55.995576 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:55.999006 [ 221633 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 50102ms 2024.10.22 13:39:56.000466 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 412.96 MiB, peak 421.09 MiB, free memory in arenas 38.14 MiB, will set to 414.71 MiB (RSS), difference: 1.75 MiB 2024.10.22 13:39:56.006209 [ 221590 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:56.006491 [ 221633 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.060718 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:56.060763 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:56.064591 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=307, queue_size=307, entries=query-0000000000..query-0000000306, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000305, last_skipped_entry_name=none 2024.10.22 13:39:56.064602 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000306 2024.10.22 13:39:56.064606 [ 221779 ] {} DDLWorker: Checking task query-0000000306 2024.10.22 13:39:56.064965 [ 221779 ] {} DDLWorker: Processing task query-0000000306 (ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:56.068366 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.112790 [ 221556 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:56.116372 [ 221556 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:56.116425 [ 221578 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:56.116445 [ 221779 ] {} DDLWorker: Task query-0000000306 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:56.116451 [ 221578 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:56.116596 [ 221779 ] {} DDLWorker: Task query-0000000306 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:56.123025 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:56.123362 [ 221533 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.130147 [ 221578 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:56.173973 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:56.173984 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:56.174205 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=308, queue_size=308, entries=query-0000000000..query-0000000307, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000306, last_skipped_entry_name=none 2024.10.22 13:39:56.174216 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000307 2024.10.22 13:39:56.174221 [ 221779 ] {} DDLWorker: Checking task query-0000000307 2024.10.22 13:39:56.177975 [ 221779 ] {} DDLWorker: Processing task query-0000000307 (ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:56.181323 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.221502 [ 221779 ] {16ca8bdf-ef15-4b77-b0b3-8247a569b134} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 882f1125-17f2-4597-8490-167da72f5c28) /* ddl_entry=query-0000000307 */ ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:56.228669 [ 221779 ] {16ca8bdf-ef15-4b77-b0b3-8247a569b134} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:56.228758 [ 221779 ] {16ca8bdf-ef15-4b77-b0b3-8247a569b134} DDLWorker: Executed query: /* ddl_entry=query-0000000307 */ ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.228761 [ 221588 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:56.228790 [ 221779 ] {} DDLWorker: Task query-0000000307 executed by current replica 2024.10.22 13:39:56.228978 [ 221588 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:56.229014 [ 221588 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:56.229021 [ 221588 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:56.235633 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:56.238954 [ 221539 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.246363 [ 221588 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:56.246629 [ 221539 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.287955 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:56.287977 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:56.291321 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=309, queue_size=309, entries=query-0000000000..query-0000000308, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000307, last_skipped_entry_name=none 2024.10.22 13:39:56.291332 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000308 2024.10.22 13:39:56.291336 [ 221779 ] {} DDLWorker: Checking task query-0000000308 2024.10.22 13:39:56.291622 [ 221779 ] {} DDLWorker: Processing task query-0000000308 (ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:56.297961 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.333713 [ 221779 ] {3ac6c95e-15c9-407c-997c-07facddcd981} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 93562b29-fe6f-4197-a01f-d6565d27c7cb) /* ddl_entry=query-0000000308 */ ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:56.341235 [ 221779 ] {3ac6c95e-15c9-407c-997c-07facddcd981} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:56.341328 [ 221779 ] {3ac6c95e-15c9-407c-997c-07facddcd981} DDLWorker: Executed query: /* ddl_entry=query-0000000308 */ ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.341372 [ 221779 ] {} DDLWorker: Task query-0000000308 executed by current replica 2024.10.22 13:39:56.341387 [ 221668 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:56.345032 [ 221668 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:56.345076 [ 221668 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:56.345082 [ 221668 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:56.348257 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:56.351595 [ 221583 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 42456ms 2024.10.22 13:39:56.358219 [ 221668 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:56.358633 [ 221583 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 53818ms 2024.10.22 13:39:56.402386 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:56.402394 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:56.402606 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=310, queue_size=310, entries=query-0000000000..query-0000000309, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000308, last_skipped_entry_name=none 2024.10.22 13:39:56.402617 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000309 2024.10.22 13:39:56.402621 [ 221779 ] {} DDLWorker: Checking task query-0000000309 2024.10.22 13:39:56.406272 [ 221779 ] {} DDLWorker: Processing task query-0000000309 (ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:56.412946 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.448963 [ 221779 ] {522073ef-f3fd-4d58-9505-494ebc31e7ad} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 47b62b97-6781-4cfd-9f52-39f8c449b0be) /* ddl_entry=query-0000000309 */ ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:56.456492 [ 221779 ] {522073ef-f3fd-4d58-9505-494ebc31e7ad} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:56.456610 [ 221779 ] {522073ef-f3fd-4d58-9505-494ebc31e7ad} DDLWorker: Executed query: /* ddl_entry=query-0000000309 */ ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.456636 [ 221779 ] {} DDLWorker: Task query-0000000309 executed by current replica 2024.10.22 13:39:56.456703 [ 221527 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:56.460078 [ 221527 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:56.460112 [ 221527 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:56.460121 [ 221527 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:56.463908 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:56.467267 [ 221663 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 51997ms 2024.10.22 13:39:56.471031 [ 221527 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:56.474375 [ 221663 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.515283 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:56.515294 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:56.515481 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=311, queue_size=311, entries=query-0000000000..query-0000000310, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000309, last_skipped_entry_name=none 2024.10.22 13:39:56.515494 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000310 2024.10.22 13:39:56.515499 [ 221779 ] {} DDLWorker: Checking task query-0000000310 2024.10.22 13:39:56.518817 [ 221779 ] {} DDLWorker: Processing task query-0000000310 (ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:56.522178 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.525545 [ 221575 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 37265ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:56.561914 [ 221779 ] {295624dc-766e-4362-9bc7-32baf1540003} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b11f6a47-c2f9-4fd5-89f2-b6531a6f9bd8) /* ddl_entry=query-0000000310 */ ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:56.569386 [ 221779 ] {295624dc-766e-4362-9bc7-32baf1540003} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:56.569512 [ 221779 ] {295624dc-766e-4362-9bc7-32baf1540003} DDLWorker: Executed query: /* ddl_entry=query-0000000310 */ ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.569528 [ 221658 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:56.569566 [ 221779 ] {} DDLWorker: Task query-0000000310 executed by current replica 2024.10.22 13:39:56.569779 [ 221658 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:56.569818 [ 221658 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:56.569828 [ 221658 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:56.578163 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:56.581552 [ 221661 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.588464 [ 221658 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:56.588752 [ 221661 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.634585 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:56.634589 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:56.637821 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=312, queue_size=312, entries=query-0000000000..query-0000000311, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000310, last_skipped_entry_name=none 2024.10.22 13:39:56.637831 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000311 2024.10.22 13:39:56.637834 [ 221779 ] {} DDLWorker: Checking task query-0000000311 2024.10.22 13:39:56.638158 [ 221779 ] {} DDLWorker: Processing task query-0000000311 (ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:56.641572 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.674830 [ 221779 ] {e89f3d57-ca97-4a13-8ee5-0293aaccdf46} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5a955d52-65ed-425c-8c4c-f2f5fca64eae) /* ddl_entry=query-0000000311 */ ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:56.682970 [ 221779 ] {e89f3d57-ca97-4a13-8ee5-0293aaccdf46} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:56.683103 [ 221598 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:56.683124 [ 221779 ] {e89f3d57-ca97-4a13-8ee5-0293aaccdf46} DDLWorker: Executed query: /* ddl_entry=query-0000000311 */ ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.683138 [ 221779 ] {} DDLWorker: Task query-0000000311 executed by current replica 2024.10.22 13:39:56.683273 [ 221598 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:56.683295 [ 221598 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:56.683300 [ 221598 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:56.689927 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:56.690051 [ 221617 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 57401ms 2024.10.22 13:39:56.699802 [ 221598 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:56.700227 [ 221617 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.746768 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:56.746775 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:56.747021 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=313, queue_size=313, entries=query-0000000000..query-0000000312, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000311, last_skipped_entry_name=none 2024.10.22 13:39:56.747031 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000312 2024.10.22 13:39:56.747035 [ 221779 ] {} DDLWorker: Checking task query-0000000312 2024.10.22 13:39:56.750506 [ 221779 ] {} DDLWorker: Processing task query-0000000312 (ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:56.753856 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.800736 [ 221595 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:56.800911 [ 221595 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:56.800949 [ 221595 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:56.800958 [ 221595 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:56.804177 [ 221779 ] {} DDLWorker: Task query-0000000312 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:56.804325 [ 221779 ] {} DDLWorker: Task query-0000000312 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:56.810699 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:56.814102 [ 221595 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:56.814589 [ 221550 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.863278 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:56.863311 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:56.863511 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=314, queue_size=314, entries=query-0000000000..query-0000000313, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000312, last_skipped_entry_name=none 2024.10.22 13:39:56.863522 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000313 2024.10.22 13:39:56.863527 [ 221779 ] {} DDLWorker: Checking task query-0000000313 2024.10.22 13:39:56.867040 [ 221779 ] {} DDLWorker: Processing task query-0000000313 (ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:56.870350 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.898880 [ 221779 ] {2f30aab5-633e-42e2-8be0-d9add4163787} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0f6b0058-7281-4d25-98a1-e191163c2db1) /* ddl_entry=query-0000000313 */ ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:56.906480 [ 221779 ] {2f30aab5-633e-42e2-8be0-d9add4163787} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:56.906564 [ 221779 ] {2f30aab5-633e-42e2-8be0-d9add4163787} DDLWorker: Executed query: /* ddl_entry=query-0000000313 */ ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:56.906578 [ 221779 ] {} DDLWorker: Task query-0000000313 executed by current replica 2024.10.22 13:39:56.906680 [ 221542 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:56.910009 [ 221542 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:56.910036 [ 221542 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:56.910044 [ 221542 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:56.913393 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:56.916782 [ 221545 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.924169 [ 221542 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:56.924439 [ 221545 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:56.982048 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:56.982057 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:56.982300 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=315, queue_size=315, entries=query-0000000000..query-0000000314, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000313, last_skipped_entry_name=none 2024.10.22 13:39:56.982311 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000314 2024.10.22 13:39:56.982315 [ 221779 ] {} DDLWorker: Checking task query-0000000314 2024.10.22 13:39:56.985743 [ 221779 ] {} DDLWorker: Processing task query-0000000314 (ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:56.988908 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.027674 [ 221779 ] {4bc3c12c-c12f-482d-8ab5-15fab590b1d6} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 22fb011b-b278-4ca9-af67-92ee07a1cf94) /* ddl_entry=query-0000000314 */ ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:57.037616 [ 221779 ] {4bc3c12c-c12f-482d-8ab5-15fab590b1d6} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:57.037749 [ 221779 ] {4bc3c12c-c12f-482d-8ab5-15fab590b1d6} DDLWorker: Executed query: /* ddl_entry=query-0000000314 */ ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.037774 [ 221779 ] {} DDLWorker: Task query-0000000314 executed by current replica 2024.10.22 13:39:57.037846 [ 221537 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:57.041218 [ 221537 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:57.041251 [ 221537 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:57.041260 [ 221537 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:57.044767 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:57.048147 [ 221608 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 32649ms 2024.10.22 13:39:57.053990 [ 221537 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:57.057555 [ 221608 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 39235ms 2024.10.22 13:39:57.098050 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:57.098057 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:57.101535 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=316, queue_size=316, entries=query-0000000000..query-0000000315, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000314, last_skipped_entry_name=none 2024.10.22 13:39:57.101547 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000315 2024.10.22 13:39:57.101550 [ 221779 ] {} DDLWorker: Checking task query-0000000315 2024.10.22 13:39:57.101849 [ 221779 ] {} DDLWorker: Processing task query-0000000315 (ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:57.105001 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.145983 [ 221635 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:57.149301 [ 221779 ] {} DDLWorker: Task query-0000000315 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:57.149369 [ 221635 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:57.149412 [ 221635 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:57.149422 [ 221635 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:57.149446 [ 221779 ] {} DDLWorker: Task query-0000000315 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:57.155971 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:57.159422 [ 221635 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:57.164270 [ 221535 ] {} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Scheduling next merge selecting task after 44640ms 2024.10.22 13:39:57.211419 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:57.211448 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:57.211667 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=317, queue_size=317, entries=query-0000000000..query-0000000316, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000315, last_skipped_entry_name=none 2024.10.22 13:39:57.211678 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000316 2024.10.22 13:39:57.211688 [ 221779 ] {} DDLWorker: Checking task query-0000000316 2024.10.22 13:39:57.215136 [ 221779 ] {} DDLWorker: Processing task query-0000000316 (ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:57.218351 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.258247 [ 221779 ] {73f45ff2-1ec0-4f6d-8002-b1e85faea6d5} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8a9ab3fe-2af7-401e-a0ef-5a999b9d4157) /* ddl_entry=query-0000000316 */ ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:57.265535 [ 221779 ] {73f45ff2-1ec0-4f6d-8002-b1e85faea6d5} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:57.265637 [ 221779 ] {73f45ff2-1ec0-4f6d-8002-b1e85faea6d5} DDLWorker: Executed query: /* ddl_entry=query-0000000316 */ ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.265639 [ 221567 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:57.265651 [ 221779 ] {} DDLWorker: Task query-0000000316 executed by current replica 2024.10.22 13:39:57.265863 [ 221567 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:57.265895 [ 221567 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:57.265902 [ 221567 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:57.272301 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:57.272572 [ 221643 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 44938ms 2024.10.22 13:39:57.279539 [ 221567 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:57.283078 [ 221643 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 54255ms 2024.10.22 13:39:57.324312 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:57.324323 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:57.324586 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=318, queue_size=318, entries=query-0000000000..query-0000000317, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000316, last_skipped_entry_name=none 2024.10.22 13:39:57.324596 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000317 2024.10.22 13:39:57.324600 [ 221779 ] {} DDLWorker: Checking task query-0000000317 2024.10.22 13:39:57.327895 [ 221779 ] {} DDLWorker: Processing task query-0000000317 (ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:57.331129 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.369076 [ 221779 ] {ad4e47e2-35ee-47b7-b364-fc859cfcec2e} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 326e5805-eadf-43c3-a967-0b18938c39b9) /* ddl_entry=query-0000000317 */ ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:57.376250 [ 221779 ] {ad4e47e2-35ee-47b7-b364-fc859cfcec2e} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:57.376337 [ 221779 ] {ad4e47e2-35ee-47b7-b364-fc859cfcec2e} DDLWorker: Executed query: /* ddl_entry=query-0000000317 */ ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.376350 [ 221779 ] {} DDLWorker: Task query-0000000317 executed by current replica 2024.10.22 13:39:57.376473 [ 221615 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:57.379839 [ 221615 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:57.379873 [ 221615 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:57.379883 [ 221615 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:57.383176 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:57.389148 [ 221627 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:57.396269 [ 221615 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:57.396698 [ 221627 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:57.440161 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:57.440185 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:57.440422 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=319, queue_size=319, entries=query-0000000000..query-0000000318, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000317, last_skipped_entry_name=none 2024.10.22 13:39:57.440430 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000318 2024.10.22 13:39:57.440433 [ 221779 ] {} DDLWorker: Checking task query-0000000318 2024.10.22 13:39:57.443743 [ 221779 ] {} DDLWorker: Processing task query-0000000318 (ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:57.450228 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.496638 [ 221534 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:57.496979 [ 221534 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:57.497046 [ 221534 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:57.497058 [ 221534 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:57.500290 [ 221779 ] {} DDLWorker: Task query-0000000318 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:57.500471 [ 221779 ] {} DDLWorker: Task query-0000000318 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:57.507264 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:57.510772 [ 221534 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:57.511211 [ 221626 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:57.559773 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:57.559784 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:57.560118 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=320, queue_size=320, entries=query-0000000000..query-0000000319, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000318, last_skipped_entry_name=none 2024.10.22 13:39:57.560131 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000319 2024.10.22 13:39:57.560135 [ 221779 ] {} DDLWorker: Checking task query-0000000319 2024.10.22 13:39:57.563435 [ 221779 ] {} DDLWorker: Processing task query-0000000319 (ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:57.569583 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.597268 [ 221573 ] {} oximeter.fields_i16_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 30539ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:57.607094 [ 221779 ] {9109bb17-9d3e-4091-97d0-c4abbe6507af} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1f22fe97-e44b-4bbe-b770-67905af8b948) /* ddl_entry=query-0000000319 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:57.614512 [ 221779 ] {9109bb17-9d3e-4091-97d0-c4abbe6507af} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:57.614590 [ 221779 ] {9109bb17-9d3e-4091-97d0-c4abbe6507af} DDLWorker: Executed query: /* ddl_entry=query-0000000319 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.614604 [ 221779 ] {} DDLWorker: Task query-0000000319 executed by current replica 2024.10.22 13:39:57.614714 [ 221581 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:57.618086 [ 221581 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:57.618116 [ 221581 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:57.618123 [ 221581 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:57.621404 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:57.621614 [ 221638 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:57.631627 [ 221581 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:57.632038 [ 221638 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:57.674974 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:57.674985 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:57.677841 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=321, queue_size=321, entries=query-0000000000..query-0000000320, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000319, last_skipped_entry_name=none 2024.10.22 13:39:57.677858 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000320 2024.10.22 13:39:57.677865 [ 221779 ] {} DDLWorker: Checking task query-0000000320 2024.10.22 13:39:57.678286 [ 221779 ] {} DDLWorker: Processing task query-0000000320 (ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:57.685932 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.737010 [ 221654 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:57.737202 [ 221654 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:57.737251 [ 221656 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 36378ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:57.737262 [ 221654 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:57.737269 [ 221654 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:57.741064 [ 221779 ] {} DDLWorker: Task query-0000000320 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:57.741192 [ 221779 ] {} DDLWorker: Task query-0000000320 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:57.748564 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:57.752271 [ 221654 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:57.758142 [ 221618 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 56029ms 2024.10.22 13:39:57.790793 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:57.790802 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:57.794798 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=322, queue_size=322, entries=query-0000000000..query-0000000321, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000320, last_skipped_entry_name=none 2024.10.22 13:39:57.794811 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000321 2024.10.22 13:39:57.794816 [ 221779 ] {} DDLWorker: Checking task query-0000000321 2024.10.22 13:39:57.795137 [ 221779 ] {} DDLWorker: Processing task query-0000000321 (ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:57.799404 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.845872 [ 221779 ] {b9fbe3d1-e790-4231-bdf6-1e2a174f8bfb} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: a356a114-3205-46e2-a876-99574e2d48c6) /* ddl_entry=query-0000000321 */ ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:57.854720 [ 221779 ] {b9fbe3d1-e790-4231-bdf6-1e2a174f8bfb} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:57.854804 [ 221779 ] {b9fbe3d1-e790-4231-bdf6-1e2a174f8bfb} DDLWorker: Executed query: /* ddl_entry=query-0000000321 */ ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.854822 [ 221779 ] {} DDLWorker: Task query-0000000321 executed by current replica 2024.10.22 13:39:57.854869 [ 221539 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:57.858236 [ 221539 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:57.858264 [ 221539 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:57.858270 [ 221539 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:57.861567 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:57.865018 [ 221621 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:57.868681 [ 221539 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:57.872455 [ 221621 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:57.904442 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:57.904516 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:57.904747 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=323, queue_size=323, entries=query-0000000000..query-0000000322, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000321, last_skipped_entry_name=none 2024.10.22 13:39:57.904763 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000322 2024.10.22 13:39:57.904773 [ 221779 ] {} DDLWorker: Checking task query-0000000322 2024.10.22 13:39:57.908239 [ 221779 ] {} DDLWorker: Processing task query-0000000322 (ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:57.911552 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.955985 [ 221779 ] {5407fcb8-9191-48de-b2a3-245b33fe308d} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b38ed695-840a-43d0-8d7f-f828558b4d35) /* ddl_entry=query-0000000322 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:57.963284 [ 221779 ] {5407fcb8-9191-48de-b2a3-245b33fe308d} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:57.963392 [ 221779 ] {5407fcb8-9191-48de-b2a3-245b33fe308d} DDLWorker: Executed query: /* ddl_entry=query-0000000322 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:57.963409 [ 221779 ] {} DDLWorker: Task query-0000000322 executed by current replica 2024.10.22 13:39:57.963483 [ 221625 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:57.966905 [ 221625 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:57.966945 [ 221625 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:57.966951 [ 221625 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:57.970709 [ 221622 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:57.970935 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:57.978328 [ 221625 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:57.981868 [ 221622 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:57.981958 [ 221540 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 37271ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:58.019588 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:58.019591 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:58.021903 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=324, queue_size=324, entries=query-0000000000..query-0000000323, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000322, last_skipped_entry_name=none 2024.10.22 13:39:58.021915 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000323 2024.10.22 13:39:58.021920 [ 221779 ] {} DDLWorker: Checking task query-0000000323 2024.10.22 13:39:58.022298 [ 221779 ] {} DDLWorker: Processing task query-0000000323 (ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:58.024513 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:58.067714 [ 221663 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:58.067920 [ 221663 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:58.067964 [ 221666 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:58.067989 [ 221666 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:58.071510 [ 221779 ] {} DDLWorker: Task query-0000000323 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:58.071646 [ 221779 ] {} DDLWorker: Task query-0000000323 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:58.077217 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:58.080825 [ 221666 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:58.081027 [ 221663 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.133439 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:58.133485 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:58.137352 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=325, queue_size=325, entries=query-0000000000..query-0000000324, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000323, last_skipped_entry_name=none 2024.10.22 13:39:58.137370 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000324 2024.10.22 13:39:58.137377 [ 221779 ] {} DDLWorker: Checking task query-0000000324 2024.10.22 13:39:58.137734 [ 221779 ] {} DDLWorker: Processing task query-0000000324 (ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:58.144287 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:58.190292 [ 221600 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:58.195018 [ 221600 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:58.195065 [ 221600 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:58.195067 [ 221779 ] {} DDLWorker: Task query-0000000324 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:58.195073 [ 221600 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:58.195249 [ 221779 ] {} DDLWorker: Task query-0000000324 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:58.201889 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:58.202395 [ 221658 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 59603ms 2024.10.22 13:39:58.209389 [ 221600 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:58.246552 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:58.246558 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:58.251127 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=326, queue_size=326, entries=query-0000000000..query-0000000325, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000324, last_skipped_entry_name=none 2024.10.22 13:39:58.251145 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000325 2024.10.22 13:39:58.251152 [ 221779 ] {} DDLWorker: Checking task query-0000000325 2024.10.22 13:39:58.251568 [ 221779 ] {} DDLWorker: Processing task query-0000000325 (ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:58.256625 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:58.293307 [ 221779 ] {1cf127c6-c798-42ae-8a60-840c5ce73fad} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 75f091aa-7da9-4499-a845-1b7be597f344) /* ddl_entry=query-0000000325 */ ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:58.301100 [ 221779 ] {1cf127c6-c798-42ae-8a60-840c5ce73fad} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:58.301213 [ 221779 ] {1cf127c6-c798-42ae-8a60-840c5ce73fad} DDLWorker: Executed query: /* ddl_entry=query-0000000325 */ ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:58.301232 [ 221779 ] {} DDLWorker: Task query-0000000325 executed by current replica 2024.10.22 13:39:58.301260 [ 221531 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:58.304861 [ 221531 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:58.304898 [ 221531 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:58.304908 [ 221531 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:58.309869 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:58.313550 [ 221572 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.320888 [ 221531 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:58.321281 [ 221572 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.361665 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:58.361671 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:58.365196 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=327, queue_size=327, entries=query-0000000000..query-0000000326, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000325, last_skipped_entry_name=none 2024.10.22 13:39:58.365210 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000326 2024.10.22 13:39:58.365217 [ 221779 ] {} DDLWorker: Checking task query-0000000326 2024.10.22 13:39:58.365643 [ 221779 ] {} DDLWorker: Processing task query-0000000326 (ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:58.372964 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:58.419747 [ 221624 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:58.423462 [ 221779 ] {} DDLWorker: Task query-0000000326 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:58.423517 [ 221624 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:58.423564 [ 221613 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:58.423581 [ 221613 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:58.423601 [ 221779 ] {} DDLWorker: Task query-0000000326 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:58.430180 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:58.433894 [ 221613 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:58.436948 [ 221624 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.474861 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:58.474872 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:58.475141 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=328, queue_size=328, entries=query-0000000000..query-0000000327, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000326, last_skipped_entry_name=none 2024.10.22 13:39:58.475176 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000327 2024.10.22 13:39:58.475182 [ 221779 ] {} DDLWorker: Checking task query-0000000327 2024.10.22 13:39:58.479384 [ 221779 ] {} DDLWorker: Processing task query-0000000327 (ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates')) 2024.10.22 13:39:58.484374 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:58.525063 [ 221779 ] {e96e6606-8c10-4245-a9b2-798a60cbd3e7} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0d66cf5d-e6bc-41dd-8d0a-ee77a3a6cb1d) /* ddl_entry=query-0000000327 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') (stage: Complete) 2024.10.22 13:39:58.532557 [ 221779 ] {e96e6606-8c10-4245-a9b2-798a60cbd3e7} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Created mutation with ID 0000000005 (data versions: ) 2024.10.22 13:39:58.532686 [ 221779 ] {e96e6606-8c10-4245-a9b2-798a60cbd3e7} DDLWorker: Executed query: /* ddl_entry=query-0000000327 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('switch_table:capacity', 'switch_table:collisions', 'switch_table:delete_misses', 'switch_table:deletes', 'switch_table:exhaustion', 'switch_table:inserts', 'switch_table:occupancy', 'switch_table:update_misses', 'switch_table:updates') 2024.10.22 13:39:58.532693 [ 221570 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000005 - 0000000005 2024.10.22 13:39:58.532715 [ 221779 ] {} DDLWorker: Task query-0000000327 executed by current replica 2024.10.22 13:39:58.532914 [ 221570 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Adding mutation 0000000005 for 0 partitions (data versions: ) 2024.10.22 13:39:58.532945 [ 221570 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000005 is done 2024.10.22 13:39:58.532953 [ 221570 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:58.539988 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:58.543476 [ 221605 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.550109 [ 221570 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Mutation 0000000005 is done 2024.10.22 13:39:58.550483 [ 221605 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.603522 [ 221542 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000010 - log-0000000010 2024.10.22 13:39:58.610564 [ 221542 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000010 to queue with type GET_PART with virtual parts [all_9_9_0] 2024.10.22 13:39:58.610580 [ 221542 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:58.620398 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:58.620411 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:58.620421 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_9_9_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:58.623882 [ 221745 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_9_9_0&client_protocol_version=8&compress=false 2024.10.22 13:39:58.623894 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=329, queue_size=329, entries=query-0000000000..query-0000000328, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000327, last_skipped_entry_name=none 2024.10.22 13:39:58.623907 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000328 2024.10.22 13:39:58.623911 [ 221779 ] {} DDLWorker: Checking task query-0000000328 2024.10.22 13:39:58.624283 [ 221779 ] {} DDLWorker: Processing task query-0000000328 (ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:58.624562 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:58.624580 [ 221745 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.44 GiB. 2024.10.22 13:39:58.624589 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:39:58.624606 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_9_9_0 onto disk default. 2024.10.22 13:39:58.625154 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_9_9_0 onto disk default finished. 2024.10.22 13:39:58.625172 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_9_9_0 to all_9_9_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:58.625204 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_9_9_0 to zookeeper 2024.10.22 13:39:58.627768 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:58.640905 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_9_9_0 committed to zookeeper 2024.10.22 13:39:58.640975 [ 221745 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_9_9_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:39:58.641044 [ 221537 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Selected 6 parts from all_0_4_1 to all_9_9_0 2024.10.22 13:39:58.641072 [ 221537 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 1 partitions with parts that may be merged: [all](max_total_size_to_merge=88818868224, merge_with_ttl_allowedtrue) 2024.10.22 13:39:58.660858 [ 221537 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Selected 6 parts from all_0_4_1 to all_9_9_0 2024.10.22 13:39:58.664259 [ 221779 ] {e37ba5c0-4cd7-4c63-82de-c35ac7d73f91} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 298bffe1-0878-4488-85c4-59e92a7eef9d) /* ddl_entry=query-0000000328 */ ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:58.667670 [ 221537 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Created log entry /clickhouse/tables/01/version/log/log-0000000011 for merge all_0_9_2 2024.10.22 13:39:58.667763 [ 221537 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Selected 6 parts from all_0_4_1 to all_9_9_0 2024.10.22 13:39:58.667791 [ 221537 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 1 partitions with parts that may be merged: [all](max_total_size_to_merge=88818794496, merge_with_ttl_allowedtrue) 2024.10.22 13:39:58.675106 [ 221779 ] {e37ba5c0-4cd7-4c63-82de-c35ac7d73f91} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:39:58.675194 [ 221779 ] {e37ba5c0-4cd7-4c63-82de-c35ac7d73f91} DDLWorker: Executed query: /* ddl_entry=query-0000000328 */ ALTER TABLE oximeter.measurements_bool_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:58.675210 [ 221779 ] {} DDLWorker: Task query-0000000328 executed by current replica 2024.10.22 13:39:58.675226 [ 221576 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000011 - log-0000000011 2024.10.22 13:39:58.675255 [ 221612 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:58.678567 [ 221612 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:58.678598 [ 221612 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:58.678605 [ 221612 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:58.685095 [ 221576 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000011 to queue with type MERGE_PARTS with virtual parts [all_0_9_2] 2024.10.22 13:39:58.685109 [ 221576 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:39:58.685210 [ 221714 ] {} 6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2 (MergeFromLogEntryTask): Executing log entry to merge parts all_0_4_1, all_5_5_0, all_6_6_0, all_7_7_0, all_8_8_0, all_9_9_0 to all_0_9_2 2024.10.22 13:39:58.685250 [ 221714 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:58.685269 [ 221714 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.44 GiB. 2024.10.22 13:39:58.685389 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} MergeTask::PrepareStage: Merging 6 parts: from all_0_4_1 to all_9_9_0 into Compact with storage Full 2024.10.22 13:39:58.685437 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 13:39:58.685451 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} MergeTreeSequentialSource: Reading 2 marks from part all_0_4_1, total 5 rows starting from the beginning of the part 2024.10.22 13:39:58.685503 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} MergeTreeSequentialSource: Reading 2 marks from part all_5_5_0, total 1 rows starting from the beginning of the part 2024.10.22 13:39:58.685532 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} MergeTreeSequentialSource: Reading 2 marks from part all_6_6_0, total 1 rows starting from the beginning of the part 2024.10.22 13:39:58.685557 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} MergeTreeSequentialSource: Reading 2 marks from part all_7_7_0, total 1 rows starting from the beginning of the part 2024.10.22 13:39:58.685598 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} MergeTreeSequentialSource: Reading 2 marks from part all_8_8_0, total 1 rows starting from the beginning of the part 2024.10.22 13:39:58.685691 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} MergeTreeSequentialSource: Reading 2 marks from part all_9_9_0, total 1 rows starting from the beginning of the part 2024.10.22 13:39:58.686357 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} MergeTask::MergeProjectionsStage: Merge sorted 10 rows, containing 2 columns (2 merged, 0 gathered) in 0.00104415 sec., 9577.168031413112 rows/sec., 149.64 KiB/sec. 2024.10.22 13:39:58.687739 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} MergedBlockOutputStream: filled checksums all_0_9_2 (state Temporary) 2024.10.22 13:39:58.687916 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp_merge_all_0_9_2 to all_0_9_2 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:58.687949 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Merged 6 parts: [all_0_4_1, all_9_9_0] -> all_0_9_2 2024.10.22 13:39:58.687966 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_0_9_2 to zookeeper 2024.10.22 13:39:58.688744 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:58.692500 [ 221571 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.701551 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): The part /clickhouse/tables/01/version/replicas/01/parts/all_0_9_2 on a replica suddenly appeared, will recheck checksums 2024.10.22 13:39:58.701576 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_0_9_2 to zookeeper 2024.10.22 13:39:58.704900 [ 221537 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.708439 [ 221612 ] {} oximeter.measurements_bool_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:58.711660 [ 221714 ] {6db82f34-d193-4788-8506-ec59aad0987f::all_0_9_2} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_0_9_2 committed to zookeeper 2024.10.22 13:39:58.715002 [ 221714 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 3.27 MiB. 2024.10.22 13:39:58.715062 [ 221632 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=88818636800, merge_with_ttl_allowedtrue) 2024.10.22 13:39:58.715082 [ 221632 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.715105 [ 221571 ] {} oximeter.measurements_bool_local (729717df-7208-4355-9607-b469f035e73e): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.732948 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:58.732958 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:58.736236 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=330, queue_size=330, entries=query-0000000000..query-0000000329, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000328, last_skipped_entry_name=none 2024.10.22 13:39:58.736251 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000329 2024.10.22 13:39:58.736258 [ 221779 ] {} DDLWorker: Checking task query-0000000329 2024.10.22 13:39:58.736555 [ 221779 ] {} DDLWorker: Processing task query-0000000329 (ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:58.739788 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:58.744165 [ 221636 ] {} DNSResolver: Updating DNS cache 2024.10.22 13:39:58.744217 [ 221636 ] {} DNSResolver: Updated DNS cache 2024.10.22 13:39:58.776449 [ 221779 ] {06cfdc2d-265d-4e9a-8cee-5f4a21a527f0} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 575bfd20-4ee9-4545-955a-f325f99d20b4) /* ddl_entry=query-0000000329 */ ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:58.776611 [ 221641 ] {} oximeter.fields_string_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32569ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:58.783668 [ 221779 ] {06cfdc2d-265d-4e9a-8cee-5f4a21a527f0} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:39:58.783766 [ 221779 ] {06cfdc2d-265d-4e9a-8cee-5f4a21a527f0} DDLWorker: Executed query: /* ddl_entry=query-0000000329 */ ALTER TABLE oximeter.measurements_bytes_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:58.783788 [ 221779 ] {} DDLWorker: Task query-0000000329 executed by current replica 2024.10.22 13:39:58.783900 [ 221630 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:58.787431 [ 221630 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:58.787461 [ 221630 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:58.787467 [ 221630 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:58.790518 [ 221771 ] {} SystemLog (system.trace_log): Flushing system log, 4 entries to flush up to offset 24 2024.10.22 13:39:58.790981 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:58.790998 [ 221771 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.44 GiB. 2024.10.22 13:39:58.791281 [ 221771 ] {} MergedBlockOutputStream: filled checksums 202410_5_5_0 (state Temporary) 2024.10.22 13:39:58.791509 [ 221771 ] {} system.trace_log (6bd3c2f5-472a-416c-8917-09586fdf1677): Renaming temporary part tmp_insert_202410_5_5_0 to 202410_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:58.791626 [ 221771 ] {} SystemLog (system.trace_log): Flushed system log up to offset 24 2024.10.22 13:39:58.791690 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:58.792054 [ 221763 ] {} SystemLog (system.part_log): Flushing system log, 3 entries to flush up to offset 12 2024.10.22 13:39:58.793324 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:58.793354 [ 221763 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.44 GiB. 2024.10.22 13:39:58.793745 [ 221763 ] {} MergedBlockOutputStream: filled checksums 202410_5_5_0 (state Temporary) 2024.10.22 13:39:58.794113 [ 221763 ] {} system.part_log (a8e098cb-5459-4082-8532-f8ecf0c3f80f): Renaming temporary part tmp_insert_202410_5_5_0 to 202410_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:58.794276 [ 221763 ] {} SystemLog (system.part_log): Flushed system log up to offset 12 2024.10.22 13:39:58.794477 [ 221567 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.801276 [ 221630 ] {} oximeter.measurements_bytes_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:58.801586 [ 221567 ] {} oximeter.measurements_bytes_local (9078c97c-b81f-4648-b62d-c70c642d6a9e): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.819136 [ 221770 ] {} SystemLog (system.query_log): Flushing system log, 96 entries to flush up to offset 502 2024.10.22 13:39:58.822020 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:58.822038 [ 221770 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.44 GiB. 2024.10.22 13:39:58.822903 [ 221770 ] {} MergedBlockOutputStream: filled checksums 202410_6_6_0 (state Temporary) 2024.10.22 13:39:58.823299 [ 221770 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Renaming temporary part tmp_insert_202410_6_6_0 to 202410_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:58.823400 [ 221528 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557) (MergerMutator): Selected 6 parts from 202410_1_1_0 to 202410_6_6_0 2024.10.22 13:39:58.823423 [ 221528 ] {} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:58.823434 [ 221528 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.44 GiB. 2024.10.22 13:39:58.823505 [ 221770 ] {} SystemLog (system.query_log): Flushed system log up to offset 502 2024.10.22 13:39:58.823620 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} MergeTask::PrepareStage: Merging 6 parts: from 202410_1_1_0 to 202410_6_6_0 into Compact with storage Full 2024.10.22 13:39:58.824109 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 13:39:58.824180 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_1_1_0, total 80 rows starting from the beginning of the part 2024.10.22 13:39:58.824410 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_2_2_0, total 88 rows starting from the beginning of the part 2024.10.22 13:39:58.824651 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_3_3_0, total 92 rows starting from the beginning of the part 2024.10.22 13:39:58.824869 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_4_4_0, total 74 rows starting from the beginning of the part 2024.10.22 13:39:58.825076 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_5_5_0, total 72 rows starting from the beginning of the part 2024.10.22 13:39:58.825284 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_6_6_0, total 96 rows starting from the beginning of the part 2024.10.22 13:39:58.830140 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} MergeTask::MergeProjectionsStage: Merge sorted 502 rows, containing 72 columns (72 merged, 0 gathered) in 0.00661244 sec., 75917.51305115812 rows/sec., 73.04 MiB/sec. 2024.10.22 13:39:58.830900 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} MergedBlockOutputStream: filled checksums 202410_1_6_1 (state Temporary) 2024.10.22 13:39:58.846038 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:58.846045 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:58.846330 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557): Renaming temporary part tmp_merge_202410_1_6_1 to 202410_1_6_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:58.846377 [ 221713 ] {937f9534-5c1a-4e9e-8e20-bb987438a557::202410_1_6_1} system.query_log (937f9534-5c1a-4e9e-8e20-bb987438a557) (MergerMutator): Merged 6 parts: [202410_1_1_0, 202410_6_6_0] -> 202410_1_6_1 2024.10.22 13:39:58.846506 [ 221713 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 5.01 MiB. 2024.10.22 13:39:58.849609 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=331, queue_size=331, entries=query-0000000000..query-0000000330, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000329, last_skipped_entry_name=none 2024.10.22 13:39:58.849627 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000330 2024.10.22 13:39:58.849635 [ 221779 ] {} DDLWorker: Checking task query-0000000330 2024.10.22 13:39:58.849991 [ 221779 ] {} DDLWorker: Processing task query-0000000330 (ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:58.853275 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:58.892226 [ 221779 ] {9be9e42e-4f95-438c-bb2f-054e7a9b213e} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5454cc06-a2b7-438f-932c-38e271d2eefa) /* ddl_entry=query-0000000330 */ ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:58.899138 [ 221779 ] {9be9e42e-4f95-438c-bb2f-054e7a9b213e} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:39:58.899222 [ 221779 ] {9be9e42e-4f95-438c-bb2f-054e7a9b213e} DDLWorker: Executed query: /* ddl_entry=query-0000000330 */ ALTER TABLE oximeter.measurements_cumulativef32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:58.899242 [ 221779 ] {} DDLWorker: Task query-0000000330 executed by current replica 2024.10.22 13:39:58.899314 [ 221615 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:58.902682 [ 221615 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:58.902714 [ 221615 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:58.902721 [ 221615 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:58.906047 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:58.910618 [ 221627 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.917218 [ 221615 ] {} oximeter.measurements_cumulativef32_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:58.917548 [ 221606 ] {} oximeter.fields_i8_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32427ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:58.917675 [ 221627 ] {} oximeter.measurements_cumulativef32_local (66df5f5f-7076-47ae-b2cb-73746dfb5476): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:58.917924 [ 221765 ] {} SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 46 2024.10.22 13:39:58.927857 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:58.927878 [ 221765 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.44 GiB. 2024.10.22 13:39:58.932414 [ 221765 ] {} MergedBlockOutputStream: filled checksums 202410_6_6_0 (state Temporary) 2024.10.22 13:39:58.936602 [ 221765 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Renaming temporary part tmp_insert_202410_6_6_0 to 202410_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:58.936797 [ 221534 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6) (MergerMutator): Selected 6 parts from 202410_1_1_0 to 202410_6_6_0 2024.10.22 13:39:58.936819 [ 221534 ] {} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:39:58.936828 [ 221534 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.44 GiB. 2024.10.22 13:39:58.937001 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} MergeTask::PrepareStage: Merging 6 parts: from 202410_1_1_0 to 202410_6_6_0 into Compact with storage Full 2024.10.22 13:39:58.937723 [ 221765 ] {} SystemLog (system.metric_log): Flushed system log up to offset 46 2024.10.22 13:39:58.940913 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 13:39:58.941438 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_1_1_0, total 8 rows starting from the beginning of the part 2024.10.22 13:39:58.944008 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_2_2_0, total 8 rows starting from the beginning of the part 2024.10.22 13:39:58.946590 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_3_3_0, total 7 rows starting from the beginning of the part 2024.10.22 13:39:58.949280 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_4_4_0, total 8 rows starting from the beginning of the part 2024.10.22 13:39:58.951862 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_5_5_0, total 7 rows starting from the beginning of the part 2024.10.22 13:39:58.954482 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_6_6_0, total 8 rows starting from the beginning of the part 2024.10.22 13:39:58.959182 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:58.959189 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:58.962859 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=332, queue_size=332, entries=query-0000000000..query-0000000331, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000330, last_skipped_entry_name=none 2024.10.22 13:39:58.962874 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000331 2024.10.22 13:39:58.962879 [ 221779 ] {} DDLWorker: Checking task query-0000000331 2024.10.22 13:39:58.963215 [ 221779 ] {} DDLWorker: Processing task query-0000000331 (ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:58.966511 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:58.995469 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} MergeTask::MergeProjectionsStage: Merge sorted 46 rows, containing 679 columns (679 merged, 0 gathered) in 0.058546021 sec., 785.7066836361091 rows/sec., 1.51 MiB/sec. 2024.10.22 13:39:58.996508 [ 221779 ] {366a1b76-aab5-47ca-b645-ecc6cb5367a6} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 1b23ae9f-8f52-4dfe-8cec-e73f98110e79) /* ddl_entry=query-0000000331 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:58.996626 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} MergedBlockOutputStream: filled checksums 202410_1_6_1 (state Temporary) 2024.10.22 13:39:59.000433 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 421.03 MiB, peak 426.45 MiB, free memory in arenas 57.16 MiB, will set to 430.64 MiB (RSS), difference: 9.61 MiB 2024.10.22 13:39:59.004073 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6): Renaming temporary part tmp_merge_202410_1_6_1 to 202410_1_6_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:39:59.004132 [ 221708 ] {ea770d17-13fb-4134-bb48-757e02e48ca6::202410_1_6_1} system.metric_log (ea770d17-13fb-4134-bb48-757e02e48ca6) (MergerMutator): Merged 6 parts: [202410_1_1_0, 202410_6_6_0] -> 202410_1_6_1 2024.10.22 13:39:59.004863 [ 221708 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 10.63 MiB. 2024.10.22 13:39:59.005106 [ 221779 ] {366a1b76-aab5-47ca-b645-ecc6cb5367a6} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:39:59.005198 [ 221779 ] {366a1b76-aab5-47ca-b645-ecc6cb5367a6} DDLWorker: Executed query: /* ddl_entry=query-0000000331 */ ALTER TABLE oximeter.measurements_cumulativef64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.005221 [ 221779 ] {} DDLWorker: Task query-0000000331 executed by current replica 2024.10.22 13:39:59.005251 [ 221646 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:59.008972 [ 221646 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:59.009037 [ 221646 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:59.009047 [ 221646 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:59.012377 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:59.012532 [ 221629 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.022805 [ 221646 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:59.023136 [ 221573 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 38772ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:59.023203 [ 221629 ] {} oximeter.measurements_cumulativef64_local (58ed2b76-989e-4930-a32f-e53927b44b2c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.073133 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:59.073141 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:59.073368 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=333, queue_size=333, entries=query-0000000000..query-0000000332, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000331, last_skipped_entry_name=none 2024.10.22 13:39:59.073378 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000332 2024.10.22 13:39:59.073382 [ 221779 ] {} DDLWorker: Checking task query-0000000332 2024.10.22 13:39:59.077022 [ 221779 ] {} DDLWorker: Processing task query-0000000332 (ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:59.080452 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.117362 [ 221779 ] {b951580d-b25c-4bb6-b5ea-261e41855b79} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 916917b5-3406-4aa5-ad1f-465aa30b6099) /* ddl_entry=query-0000000332 */ ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:59.125284 [ 221779 ] {b951580d-b25c-4bb6-b5ea-261e41855b79} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:39:59.125381 [ 221779 ] {b951580d-b25c-4bb6-b5ea-261e41855b79} DDLWorker: Executed query: /* ddl_entry=query-0000000332 */ ALTER TABLE oximeter.measurements_cumulativei64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.125399 [ 221779 ] {} DDLWorker: Task query-0000000332 executed by current replica 2024.10.22 13:39:59.125440 [ 221578 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:59.128771 [ 221578 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:59.128815 [ 221578 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:59.128825 [ 221578 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:59.131888 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:59.135232 [ 221644 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.138960 [ 221578 ] {} oximeter.measurements_cumulativei64_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:59.142470 [ 221644 ] {} oximeter.measurements_cumulativei64_local (c3ec9c9b-0ab7-42e2-87db-fcb8a3d40ffe): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.177146 [ 221628 ] {} oximeter.fields_i32_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 31635ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:59.190014 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:59.190024 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:59.193536 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=334, queue_size=334, entries=query-0000000000..query-0000000333, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000332, last_skipped_entry_name=none 2024.10.22 13:39:59.193551 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000333 2024.10.22 13:39:59.193557 [ 221779 ] {} DDLWorker: Checking task query-0000000333 2024.10.22 13:39:59.193903 [ 221779 ] {} DDLWorker: Processing task query-0000000333 (ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:59.197371 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_cumulativeu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.239181 [ 221667 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:59.239277 [ 221591 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 39344ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:59.242443 [ 221667 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:59.242458 [ 221779 ] {} DDLWorker: Task query-0000000333 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.242488 [ 221667 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:59.242497 [ 221667 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:59.242601 [ 221779 ] {} DDLWorker: Task query-0000000333 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.248894 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:59.249187 [ 221660 ] {} oximeter.measurements_cumulativeu64_local (b4d25fa7-6b3c-4d62-8156-f5ec7e6e72b4): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.256116 [ 221667 ] {} oximeter.measurements_cumulativeu64_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:59.265359 [ 221621 ] {} oximeter.fields_ipaddr_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 33431ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:59.302262 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:59.302269 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:59.302517 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=335, queue_size=335, entries=query-0000000000..query-0000000334, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000333, last_skipped_entry_name=none 2024.10.22 13:39:59.302530 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000334 2024.10.22 13:39:59.302535 [ 221779 ] {} DDLWorker: Checking task query-0000000334 2024.10.22 13:39:59.305927 [ 221779 ] {} DDLWorker: Processing task query-0000000334 (ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:59.309121 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.344968 [ 221583 ] {} oximeter.fields_u16_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32017ms, ratio: 0, points per minute: 0) 2024.10.22 13:39:59.348195 [ 221779 ] {c3124df8-7f6f-4a85-8a70-065f57d99888} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 89475281-a8d7-4f59-91fe-fd6e8cad7a95) /* ddl_entry=query-0000000334 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:39:59.355413 [ 221779 ] {c3124df8-7f6f-4a85-8a70-065f57d99888} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:39:59.355506 [ 221779 ] {c3124df8-7f6f-4a85-8a70-065f57d99888} DDLWorker: Executed query: /* ddl_entry=query-0000000334 */ ALTER TABLE oximeter.measurements_f32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.355521 [ 221779 ] {} DDLWorker: Task query-0000000334 executed by current replica 2024.10.22 13:39:59.355609 [ 221553 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:59.358973 [ 221553 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:59.359015 [ 221553 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:59.359022 [ 221553 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:59.362561 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:59.365646 [ 221532 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.372301 [ 221553 ] {} oximeter.measurements_f32_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:59.372646 [ 221532 ] {} oximeter.measurements_f32_local (cbf4d6e9-971b-4446-a480-0873052a736c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.424090 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:59.424100 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:59.424338 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=336, queue_size=336, entries=query-0000000000..query-0000000335, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000334, last_skipped_entry_name=none 2024.10.22 13:39:59.424353 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000335 2024.10.22 13:39:59.424363 [ 221779 ] {} DDLWorker: Checking task query-0000000335 2024.10.22 13:39:59.427775 [ 221779 ] {} DDLWorker: Processing task query-0000000335 (ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:59.431195 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_f64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.475852 [ 221779 ] {} DDLWorker: Task query-0000000335 still not executed, will try to wait for it or execute ourselves, tries count 1 2024.10.22 13:39:59.475976 [ 221564 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:59.479527 [ 221564 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:59.479567 [ 221564 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:59.479576 [ 221564 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:59.485814 [ 221779 ] {} DDLWorker: Task query-0000000335 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.485957 [ 221779 ] {} DDLWorker: Task query-0000000335 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.488826 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:59.491667 [ 221564 ] {} oximeter.measurements_f64_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:59.495072 [ 221637 ] {} oximeter.measurements_f64_local (18c5d239-04b8-4343-86a7-7f0eced60863): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.540101 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:59.540113 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:59.540321 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=337, queue_size=337, entries=query-0000000000..query-0000000336, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000335, last_skipped_entry_name=none 2024.10.22 13:39:59.540332 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000336 2024.10.22 13:39:59.540342 [ 221779 ] {} DDLWorker: Checking task query-0000000336 2024.10.22 13:39:59.543863 [ 221779 ] {} DDLWorker: Processing task query-0000000336 (ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:59.550394 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.592067 [ 221555 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:59.595711 [ 221555 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:59.595761 [ 221593 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:59.595782 [ 221593 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:59.595950 [ 221779 ] {} DDLWorker: Task query-0000000336 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.596077 [ 221779 ] {} DDLWorker: Task query-0000000336 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.602745 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:59.606147 [ 221593 ] {} oximeter.measurements_histogramf32_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:59.610049 [ 221555 ] {} oximeter.measurements_histogramf32_local (f7d3d6f4-4828-4c60-bb6c-60be4c814f3e): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.663012 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:59.663022 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:59.663302 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=338, queue_size=338, entries=query-0000000000..query-0000000337, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000336, last_skipped_entry_name=none 2024.10.22 13:39:59.663318 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000337 2024.10.22 13:39:59.663322 [ 221779 ] {} DDLWorker: Checking task query-0000000337 2024.10.22 13:39:59.667970 [ 221779 ] {} DDLWorker: Processing task query-0000000337 (ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:59.676635 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramf64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.718520 [ 221599 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:59.722056 [ 221599 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:59.722092 [ 221779 ] {} DDLWorker: Task query-0000000337 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.722106 [ 221599 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:59.722116 [ 221599 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:59.722244 [ 221779 ] {} DDLWorker: Task query-0000000337 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.728615 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:59.729114 [ 221546 ] {} oximeter.measurements_histogramf64_local (06ab915c-d456-4833-bd24-11a0b51f3286): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.736115 [ 221599 ] {} oximeter.measurements_histogramf64_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:59.797016 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:59.797021 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:59.797314 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=339, queue_size=339, entries=query-0000000000..query-0000000338, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000337, last_skipped_entry_name=none 2024.10.22 13:39:59.797325 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000338 2024.10.22 13:39:59.797329 [ 221779 ] {} DDLWorker: Checking task query-0000000338 2024.10.22 13:39:59.801882 [ 221779 ] {} DDLWorker: Processing task query-0000000338 (ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:59.805125 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.852105 [ 221624 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:59.852282 [ 221624 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:59.852360 [ 221551 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:59.852374 [ 221551 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:59.856369 [ 221779 ] {} DDLWorker: Task query-0000000338 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.860373 [ 221779 ] {} DDLWorker: Task query-0000000338 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.864376 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:59.864492 [ 221624 ] {} oximeter.measurements_histogrami16_local (dc7e56ef-e5ac-4a17-9552-db1c0bcc8f77): Scheduling next merge selecting task after 60000ms 2024.10.22 13:39:59.872854 [ 221551 ] {} oximeter.measurements_histogrami16_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:39:59.921174 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:39:59.921204 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:39:59.921483 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=340, queue_size=340, entries=query-0000000000..query-0000000339, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000338, last_skipped_entry_name=none 2024.10.22 13:39:59.922779 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000339 2024.10.22 13:39:59.922790 [ 221779 ] {} DDLWorker: Checking task query-0000000339 2024.10.22 13:39:59.926520 [ 221779 ] {} DDLWorker: Processing task query-0000000339 (ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:39:59.934452 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:39:59.981950 [ 221605 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:39:59.984628 [ 221605 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:39:59.984686 [ 221779 ] {} DDLWorker: Task query-0000000339 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.985439 [ 221605 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:39:59.985448 [ 221605 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:39:59.988574 [ 221779 ] {} DDLWorker: Task query-0000000339 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:39:59.992803 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:39:59.993099 [ 221568 ] {} oximeter.measurements_histogrami32_local (c1289a14-fd9a-4835-bddd-793c4df6b53f): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.000525 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 426.25 MiB, peak 430.64 MiB, free memory in arenas 64.82 MiB, will set to 430.63 MiB (RSS), difference: 4.38 MiB 2024.10.22 13:40:00.001963 [ 221605 ] {} oximeter.measurements_histogrami32_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:00.062001 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:00.061998 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:00.065545 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=341, queue_size=341, entries=query-0000000000..query-0000000340, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000339, last_skipped_entry_name=none 2024.10.22 13:40:00.065561 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000340 2024.10.22 13:40:00.065567 [ 221779 ] {} DDLWorker: Checking task query-0000000340 2024.10.22 13:40:00.065944 [ 221779 ] {} DDLWorker: Processing task query-0000000340 (ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:00.072612 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.112813 [ 221577 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:00.116508 [ 221552 ] {} oximeter.fields_bool_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 34532ms, ratio: 0, points per minute: 0) 2024.10.22 13:40:00.116518 [ 221779 ] {} DDLWorker: Task query-0000000340 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:40:00.116525 [ 221577 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:00.116560 [ 221577 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:00.116574 [ 221577 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:00.116659 [ 221779 ] {} DDLWorker: Task query-0000000340 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:40:00.123397 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:00.127635 [ 221577 ] {} oximeter.measurements_histogrami64_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:00.131293 [ 221566 ] {} oximeter.measurements_histogrami64_local (98988eb0-10cf-4c56-b964-0165249a4fbd): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.174440 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:00.174447 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:00.177993 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=342, queue_size=342, entries=query-0000000000..query-0000000341, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000340, last_skipped_entry_name=none 2024.10.22 13:40:00.178009 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000341 2024.10.22 13:40:00.178015 [ 221779 ] {} DDLWorker: Checking task query-0000000341 2024.10.22 13:40:00.178540 [ 221779 ] {} DDLWorker: Processing task query-0000000341 (ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:00.181803 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogrami8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.225840 [ 221576 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:00.229122 [ 221576 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:00.229171 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:00.229200 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:00.229205 [ 221779 ] {} DDLWorker: Task query-0000000341 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:40:00.232712 [ 221779 ] {} DDLWorker: Task query-0000000341 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:40:00.236373 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:00.236388 [ 221612 ] {} oximeter.fields_u32_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32442ms, ratio: 0, points per minute: 0) 2024.10.22 13:40:00.236685 [ 221576 ] {} oximeter.measurements_histogrami8_local (a506ad34-e679-4759-877b-48efcb98a091): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.243466 [ 221537 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:00.287543 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:00.287549 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:00.287804 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=343, queue_size=343, entries=query-0000000000..query-0000000342, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000341, last_skipped_entry_name=none 2024.10.22 13:40:00.287819 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000342 2024.10.22 13:40:00.287827 [ 221779 ] {} DDLWorker: Checking task query-0000000342 2024.10.22 13:40:00.291435 [ 221779 ] {} DDLWorker: Processing task query-0000000342 (ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:00.294843 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.329781 [ 221779 ] {191eab25-1bd5-47dd-9643-1cb20b1241f5} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 334fb090-6777-48cb-a2a6-a11a8c1621f2) /* ddl_entry=query-0000000342 */ ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:00.337106 [ 221779 ] {191eab25-1bd5-47dd-9643-1cb20b1241f5} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:00.337185 [ 221779 ] {191eab25-1bd5-47dd-9643-1cb20b1241f5} DDLWorker: Executed query: /* ddl_entry=query-0000000342 */ ALTER TABLE oximeter.measurements_histogramu16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.337201 [ 221779 ] {} DDLWorker: Task query-0000000342 executed by current replica 2024.10.22 13:40:00.337254 [ 221631 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:00.340761 [ 221631 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:00.340804 [ 221631 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:00.340816 [ 221631 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:00.344234 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:00.348177 [ 221642 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 47330ms 2024.10.22 13:40:00.354821 [ 221631 ] {} oximeter.measurements_histogramu16_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:00.355151 [ 221642 ] {} oximeter.measurements_histogramu16_local (bb4d2b7f-291f-4dfb-ac8b-614a5beb9d35): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.403682 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:00.403688 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:00.403922 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=344, queue_size=344, entries=query-0000000000..query-0000000343, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000342, last_skipped_entry_name=none 2024.10.22 13:40:00.403934 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000343 2024.10.22 13:40:00.403957 [ 221779 ] {} DDLWorker: Checking task query-0000000343 2024.10.22 13:40:00.407271 [ 221779 ] {} DDLWorker: Processing task query-0000000343 (ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:00.413896 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.458581 [ 221623 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:00.462076 [ 221779 ] {} DDLWorker: Task query-0000000343 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:40:00.462133 [ 221623 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:00.462173 [ 221623 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:00.462196 [ 221623 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:00.462271 [ 221779 ] {} DDLWorker: Task query-0000000343 has already been executed by replica (%3A%3A1:9001) of the same shard. 2024.10.22 13:40:00.469036 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:00.472402 [ 221623 ] {} oximeter.measurements_histogramu32_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:00.476068 [ 221645 ] {} oximeter.measurements_histogramu32_local (4a3801e7-9bc3-4218-a094-95f1b71e310c): Scheduling next merge selecting task after 54419ms 2024.10.22 13:40:00.516262 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:00.516268 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:00.516536 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=345, queue_size=345, entries=query-0000000000..query-0000000344, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000343, last_skipped_entry_name=none 2024.10.22 13:40:00.516550 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000344 2024.10.22 13:40:00.516555 [ 221779 ] {} DDLWorker: Checking task query-0000000344 2024.10.22 13:40:00.520042 [ 221779 ] {} DDLWorker: Processing task query-0000000344 (ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:00.523224 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.558691 [ 221779 ] {2644d56d-2914-4afd-8d57-86e5d8bc71b8} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 859d40ff-945f-4681-b8de-9b9b408ab4f5) /* ddl_entry=query-0000000344 */ ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:00.568343 [ 221779 ] {2644d56d-2914-4afd-8d57-86e5d8bc71b8} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:00.568438 [ 221779 ] {2644d56d-2914-4afd-8d57-86e5d8bc71b8} DDLWorker: Executed query: /* ddl_entry=query-0000000344 */ ALTER TABLE oximeter.measurements_histogramu64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.568516 [ 221779 ] {} DDLWorker: Task query-0000000344 executed by current replica 2024.10.22 13:40:00.568579 [ 221606 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:00.572049 [ 221606 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:00.572090 [ 221606 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:00.572102 [ 221606 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:00.575347 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:00.578554 [ 221627 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.582227 [ 221606 ] {} oximeter.measurements_histogramu64_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:00.582611 [ 221627 ] {} oximeter.measurements_histogramu64_local (815843a1-e3f7-4b17-a3b9-d9bda6362620): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.632549 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:00.632558 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:00.632793 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=346, queue_size=346, entries=query-0000000000..query-0000000345, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000344, last_skipped_entry_name=none 2024.10.22 13:40:00.632806 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000345 2024.10.22 13:40:00.632811 [ 221779 ] {} DDLWorker: Checking task query-0000000345 2024.10.22 13:40:00.636237 [ 221779 ] {} DDLWorker: Processing task query-0000000345 (ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:00.639520 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.679463 [ 221779 ] {11eff0db-a830-4ec9-b351-b6c0b327906a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8662e473-b459-4bb2-9093-0148e9fe4c36) /* ddl_entry=query-0000000345 */ ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:00.686972 [ 221779 ] {11eff0db-a830-4ec9-b351-b6c0b327906a} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:00.687053 [ 221779 ] {11eff0db-a830-4ec9-b351-b6c0b327906a} DDLWorker: Executed query: /* ddl_entry=query-0000000345 */ ALTER TABLE oximeter.measurements_histogramu8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.687072 [ 221779 ] {} DDLWorker: Task query-0000000345 executed by current replica 2024.10.22 13:40:00.687097 [ 221587 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:00.690628 [ 221587 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:00.690664 [ 221587 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:00.690673 [ 221587 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:00.693828 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:00.697384 [ 221646 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.704606 [ 221587 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:00.705200 [ 221646 ] {} oximeter.measurements_histogramu8_local (4f18429a-a87d-4f5f-adac-b911ac3b7970): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.752512 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:00.752518 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:00.756443 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=347, queue_size=347, entries=query-0000000000..query-0000000346, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000345, last_skipped_entry_name=none 2024.10.22 13:40:00.756454 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000346 2024.10.22 13:40:00.756458 [ 221779 ] {} DDLWorker: Checking task query-0000000346 2024.10.22 13:40:00.756813 [ 221779 ] {} DDLWorker: Processing task query-0000000346 (ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:00.760093 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.798870 [ 221779 ] {f6424041-bd42-4998-a459-02b7a4e55d45} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 18994bb9-f745-4d99-8b93-8f3beea049a9) /* ddl_entry=query-0000000346 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:00.808276 [ 221779 ] {f6424041-bd42-4998-a459-02b7a4e55d45} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:00.808374 [ 221779 ] {f6424041-bd42-4998-a459-02b7a4e55d45} DDLWorker: Executed query: /* ddl_entry=query-0000000346 */ ALTER TABLE oximeter.measurements_i16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.808391 [ 221779 ] {} DDLWorker: Task query-0000000346 executed by current replica 2024.10.22 13:40:00.808439 [ 221581 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:00.812407 [ 221581 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:00.812433 [ 221581 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:00.812441 [ 221581 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:00.815796 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:00.819138 [ 221638 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.825815 [ 221581 ] {} oximeter.measurements_i16_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:00.826156 [ 221638 ] {} oximeter.measurements_i16_local (49e50a30-00f0-4040-a59b-a6f152b2be2d): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.865501 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:00.865509 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:00.865715 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=348, queue_size=348, entries=query-0000000000..query-0000000347, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000346, last_skipped_entry_name=none 2024.10.22 13:40:00.865724 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000347 2024.10.22 13:40:00.865730 [ 221779 ] {} DDLWorker: Checking task query-0000000347 2024.10.22 13:40:00.869435 [ 221779 ] {} DDLWorker: Processing task query-0000000347 (ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:00.872836 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.906252 [ 221779 ] {04ea455a-65fe-417d-a0cd-b8d0b14b5d19} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8255e171-f2c6-4505-b95b-002a45a03b62) /* ddl_entry=query-0000000347 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:00.916343 [ 221779 ] {04ea455a-65fe-417d-a0cd-b8d0b14b5d19} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:00.916431 [ 221779 ] {04ea455a-65fe-417d-a0cd-b8d0b14b5d19} DDLWorker: Executed query: /* ddl_entry=query-0000000347 */ ALTER TABLE oximeter.measurements_i32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:00.916438 [ 221659 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:00.916450 [ 221779 ] {} DDLWorker: Task query-0000000347 executed by current replica 2024.10.22 13:40:00.916652 [ 221659 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:00.916687 [ 221659 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:00.916696 [ 221659 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:00.923523 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:00.923655 [ 221588 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.930598 [ 221659 ] {} oximeter.measurements_i32_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:00.933939 [ 221588 ] {} oximeter.measurements_i32_local (0e4545a4-72fe-474b-98d7-468f7bab75ce): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:00.985916 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:00.985921 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:00.986112 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=349, queue_size=349, entries=query-0000000000..query-0000000348, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000347, last_skipped_entry_name=none 2024.10.22 13:40:00.986126 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000348 2024.10.22 13:40:00.986129 [ 221779 ] {} DDLWorker: Checking task query-0000000348 2024.10.22 13:40:00.989315 [ 221779 ] {} DDLWorker: Processing task query-0000000348 (ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:00.992478 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.000410 [ 221775 ] {} AsynchronousMetrics: MemoryTracking: was 430.66 MiB, peak 430.66 MiB, free memory in arenas 34.66 MiB, will set to 429.10 MiB (RSS), difference: -1.56 MiB 2024.10.22 13:40:01.018939 [ 221667 ] {} oximeter.measurements_histogramu8_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 31051ms, ratio: 0, points per minute: 0) 2024.10.22 13:40:01.032495 [ 221779 ] {0a2494d9-f9d3-499d-be97-ebb78832bec3} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 33f0e63f-64ef-4abb-b63c-81c37e24dbea) /* ddl_entry=query-0000000348 */ ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:01.040038 [ 221779 ] {0a2494d9-f9d3-499d-be97-ebb78832bec3} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:01.040209 [ 221779 ] {0a2494d9-f9d3-499d-be97-ebb78832bec3} DDLWorker: Executed query: /* ddl_entry=query-0000000348 */ ALTER TABLE oximeter.measurements_i64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.040236 [ 221779 ] {} DDLWorker: Task query-0000000348 executed by current replica 2024.10.22 13:40:01.040305 [ 221670 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:01.043628 [ 221670 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:01.043659 [ 221670 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:01.043669 [ 221670 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:01.047057 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:01.050404 [ 221640 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.053951 [ 221670 ] {} oximeter.measurements_i64_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:01.057660 [ 221640 ] {} oximeter.measurements_i64_local (ebec6def-2fab-4484-9e31-952627d2620b): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.105315 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:01.105320 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:01.105606 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=350, queue_size=350, entries=query-0000000000..query-0000000349, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000348, last_skipped_entry_name=none 2024.10.22 13:40:01.105621 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000349 2024.10.22 13:40:01.105629 [ 221779 ] {} DDLWorker: Checking task query-0000000349 2024.10.22 13:40:01.109277 [ 221779 ] {} DDLWorker: Processing task query-0000000349 (ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:01.112448 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.145672 [ 221553 ] {} oximeter.fields_string_local (1a7682b7-8009-431c-aef6-d5a74e3f181e): Scheduling next merge selecting task after 15251ms 2024.10.22 13:40:01.152364 [ 221779 ] {230f05dd-8e80-42ee-a938-96e3a10d9872} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0774f520-80f8-4d34-b1f0-59acdd5ab15c) /* ddl_entry=query-0000000349 */ ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:01.159842 [ 221779 ] {230f05dd-8e80-42ee-a938-96e3a10d9872} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:01.159926 [ 221779 ] {230f05dd-8e80-42ee-a938-96e3a10d9872} DDLWorker: Executed query: /* ddl_entry=query-0000000349 */ ALTER TABLE oximeter.measurements_i8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.159944 [ 221779 ] {} DDLWorker: Task query-0000000349 executed by current replica 2024.10.22 13:40:01.160000 [ 221527 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:01.163432 [ 221527 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:01.163463 [ 221527 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:01.163471 [ 221527 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:01.166879 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:01.170141 [ 221525 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.176743 [ 221527 ] {} oximeter.measurements_i8_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:01.177130 [ 221525 ] {} oximeter.measurements_i8_local (a51c5796-2389-45fc-9ca8-1855ed13f246): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.221454 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:01.221463 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:01.221706 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=351, queue_size=351, entries=query-0000000000..query-0000000350, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000349, last_skipped_entry_name=none 2024.10.22 13:40:01.221715 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000350 2024.10.22 13:40:01.221720 [ 221779 ] {} DDLWorker: Checking task query-0000000350 2024.10.22 13:40:01.225403 [ 221779 ] {} DDLWorker: Processing task query-0000000350 (ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:01.228848 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.267476 [ 221779 ] {e405bc5c-1fce-4ade-8452-eb21ed1f8c56} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 90afa71f-da59-4ea2-878c-73e177e68154) /* ddl_entry=query-0000000350 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:01.274991 [ 221779 ] {e405bc5c-1fce-4ade-8452-eb21ed1f8c56} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:01.275191 [ 221779 ] {e405bc5c-1fce-4ade-8452-eb21ed1f8c56} DDLWorker: Executed query: /* ddl_entry=query-0000000350 */ ALTER TABLE oximeter.measurements_string_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.275209 [ 221779 ] {} DDLWorker: Task query-0000000350 executed by current replica 2024.10.22 13:40:01.275263 [ 221600 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:01.278628 [ 221600 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:01.278667 [ 221600 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:01.278677 [ 221600 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:01.282008 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:01.285338 [ 221563 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.289005 [ 221600 ] {} oximeter.measurements_string_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:01.292678 [ 221563 ] {} oximeter.measurements_string_local (eea1a119-308f-477e-ad5d-b5867c90408c): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.340867 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:01.340875 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:01.344314 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=352, queue_size=352, entries=query-0000000000..query-0000000351, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000350, last_skipped_entry_name=none 2024.10.22 13:40:01.344328 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000351 2024.10.22 13:40:01.344336 [ 221779 ] {} DDLWorker: Checking task query-0000000351 2024.10.22 13:40:01.344675 [ 221779 ] {} DDLWorker: Processing task query-0000000351 (ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:01.350353 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.391847 [ 221779 ] {7a8c2158-a8ba-4bdb-8bc1-1fbae1c99f7a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4c14cfd7-2ec4-44e7-a51f-2379917ffbf5) /* ddl_entry=query-0000000351 */ ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:01.398839 [ 221779 ] {7a8c2158-a8ba-4bdb-8bc1-1fbae1c99f7a} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:01.398910 [ 221779 ] {7a8c2158-a8ba-4bdb-8bc1-1fbae1c99f7a} DDLWorker: Executed query: /* ddl_entry=query-0000000351 */ ALTER TABLE oximeter.measurements_u16_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.398923 [ 221779 ] {} DDLWorker: Task query-0000000351 executed by current replica 2024.10.22 13:40:01.398966 [ 221598 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:01.402075 [ 221598 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:01.402110 [ 221598 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:01.402124 [ 221598 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:01.407219 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:01.410672 [ 221546 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.414279 [ 221598 ] {} oximeter.measurements_u16_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:01.420282 [ 221546 ] {} oximeter.measurements_u16_local (dfaebfff-88a2-4890-bf2c-fe68c86b5fac): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.453886 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:01.453894 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:01.454223 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=353, queue_size=353, entries=query-0000000000..query-0000000352, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000351, last_skipped_entry_name=none 2024.10.22 13:40:01.454233 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000352 2024.10.22 13:40:01.454236 [ 221779 ] {} DDLWorker: Checking task query-0000000352 2024.10.22 13:40:01.457816 [ 221779 ] {} DDLWorker: Processing task query-0000000352 (ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:01.461221 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.499762 [ 221779 ] {b96593dc-a778-43cd-8dcf-6d846a02b817} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 535f27fa-9974-48fe-b4d7-7fa7a6652fbd) /* ddl_entry=query-0000000352 */ ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:01.506808 [ 221779 ] {b96593dc-a778-43cd-8dcf-6d846a02b817} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:01.506896 [ 221779 ] {b96593dc-a778-43cd-8dcf-6d846a02b817} DDLWorker: Executed query: /* ddl_entry=query-0000000352 */ ALTER TABLE oximeter.measurements_u32_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.506915 [ 221779 ] {} DDLWorker: Task query-0000000352 executed by current replica 2024.10.22 13:40:01.507011 [ 221543 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:01.510374 [ 221543 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:01.510409 [ 221543 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:01.510417 [ 221543 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:01.513689 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:01.517186 [ 221604 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.520861 [ 221543 ] {} oximeter.measurements_u32_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:01.524447 [ 221604 ] {} oximeter.measurements_u32_local (05d56c2f-af43-49b9-a141-477040bf93ca): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.570492 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:01.570498 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:01.570763 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=354, queue_size=354, entries=query-0000000000..query-0000000353, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000352, last_skipped_entry_name=none 2024.10.22 13:40:01.570774 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000353 2024.10.22 13:40:01.570778 [ 221779 ] {} DDLWorker: Checking task query-0000000353 2024.10.22 13:40:01.574105 [ 221779 ] {} DDLWorker: Processing task query-0000000353 (ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:01.577453 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.603670 [ 221565 ] {} oximeter.measurements_histogrami8_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 32188ms, ratio: 0, points per minute: 0) 2024.10.22 13:40:01.613858 [ 221779 ] {5cb581dc-87a8-4411-83a3-1c51ecbc37c0} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 4bb8d455-c955-4296-adcc-fa51c3eae007) /* ddl_entry=query-0000000353 */ ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:01.620891 [ 221779 ] {5cb581dc-87a8-4411-83a3-1c51ecbc37c0} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:01.620975 [ 221779 ] {5cb581dc-87a8-4411-83a3-1c51ecbc37c0} DDLWorker: Executed query: /* ddl_entry=query-0000000353 */ ALTER TABLE oximeter.measurements_u64_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.620990 [ 221779 ] {} DDLWorker: Task query-0000000353 executed by current replica 2024.10.22 13:40:01.621064 [ 221568 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:01.624498 [ 221568 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:01.624537 [ 221568 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:01.624544 [ 221568 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:01.627790 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:01.628026 [ 221605 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.634950 [ 221568 ] {} oximeter.measurements_u64_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:01.638337 [ 221605 ] {} oximeter.measurements_u64_local (c3945f89-76d8-482c-a33a-5e547c937d0a): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.693039 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:01.693044 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:01.693285 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=355, queue_size=355, entries=query-0000000000..query-0000000354, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000353, last_skipped_entry_name=none 2024.10.22 13:40:01.693297 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000354 2024.10.22 13:40:01.693305 [ 221779 ] {} DDLWorker: Checking task query-0000000354 2024.10.22 13:40:01.696618 [ 221779 ] {} DDLWorker: Processing task query-0000000354 (ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:01.699921 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.736079 [ 221779 ] {ed4cc2ce-b227-4a03-a60a-3757cbf0065f} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 940537bf-3c7b-4836-a68f-cde46157b7b5) /* ddl_entry=query-0000000354 */ ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:01.746356 [ 221779 ] {ed4cc2ce-b227-4a03-a60a-3757cbf0065f} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:01.746439 [ 221779 ] {ed4cc2ce-b227-4a03-a60a-3757cbf0065f} DDLWorker: Executed query: /* ddl_entry=query-0000000354 */ ALTER TABLE oximeter.measurements_u8_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.746457 [ 221779 ] {} DDLWorker: Task query-0000000354 executed by current replica 2024.10.22 13:40:01.746472 [ 221579 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:01.749887 [ 221579 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:01.749919 [ 221579 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:01.749928 [ 221579 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:01.753386 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:01.756812 [ 221538 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.760294 [ 221579 ] {} oximeter.measurements_u8_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:01.764395 [ 221538 ] {} oximeter.measurements_u8_local (63d6ec9c-a137-4c48-9835-fddedbb6d7b3): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.805567 [ 221779 ] {} DDLWorker: Scheduling tasks 2024.10.22 13:40:01.805592 [ 221778 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.10.22 13:40:01.809230 [ 221779 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=356, queue_size=356, entries=query-0000000000..query-0000000355, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000354, last_skipped_entry_name=none 2024.10.22 13:40:01.809244 [ 221779 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000355 2024.10.22 13:40:01.809251 [ 221779 ] {} DDLWorker: Checking task query-0000000355 2024.10.22 13:40:01.809568 [ 221779 ] {} DDLWorker: Processing task query-0000000355 (ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram')) 2024.10.22 13:40:01.812921 [ 221779 ] {} DDLWorker: Executing query: ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.849966 [ 221779 ] {5f1268fd-da15-4655-b9a6-25f0e0ca6817} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: bf5de276-4a45-4386-9981-30077976634b) /* ddl_entry=query-0000000355 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') (stage: Complete) 2024.10.22 13:40:01.858891 [ 221779 ] {5f1268fd-da15-4655-b9a6-25f0e0ca6817} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Created mutation with ID 0000000006 (data versions: ) 2024.10.22 13:40:01.858982 [ 221779 ] {5f1268fd-da15-4655-b9a6-25f0e0ca6817} DDLWorker: Executed query: /* ddl_entry=query-0000000355 */ ALTER TABLE oximeter.timeseries_schema_local DELETE WHERE timeseries_name IN ('http_service:request_latency_histogram') 2024.10.22 13:40:01.859000 [ 221779 ] {} DDLWorker: Task query-0000000355 executed by current replica 2024.10.22 13:40:01.859032 [ 221612 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000006 - 0000000006 2024.10.22 13:40:01.862462 [ 221612 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Adding mutation 0000000006 for 0 partitions (data versions: ) 2024.10.22 13:40:01.862493 [ 221612 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Will check if mutation 0000000006 is done 2024.10.22 13:40:01.862502 [ 221612 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Trying to finalize 1 mutations 2024.10.22 13:40:01.865916 [ 221779 ] {} DDLWorker: Waiting for queue updates 2024.10.22 13:40:01.869217 [ 221576 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.875977 [ 221612 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Mutation 0000000006 is done 2024.10.22 13:40:01.876408 [ 221576 ] {} oximeter.timeseries_schema_local (23b30514-b5ec-4753-a91b-7ac43a61e1b5): Scheduling next merge selecting task after 60000ms 2024.10.22 13:40:01.923888 [ 221641 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000012 - log-0000000012 2024.10.22 13:40:01.928477 [ 221641 ] {} oximeter.version (ReplicatedMergeTreeQueue): Insert entry queue-0000000012 to queue with type GET_PART with virtual parts [all_10_10_0] 2024.10.22 13:40:01.928491 [ 221641 ] {} oximeter.version (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.10.22 13:40:01.931629 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetching part all_10_10_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:40:01.931775 [ 221731 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::]:9009/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F01%2Fversion%2Freplicas%2F01&part=all_10_10_0&client_protocol_version=8&compress=false 2024.10.22 13:40:01.932291 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 13:40:01.932312 [ 221731 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 165.83 GiB. 2024.10.22 13:40:01.932320 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.10.22 13:40:01.932332 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Downloading part all_10_10_0 onto disk default. 2024.10.22 13:40:01.934530 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (Fetcher): Download of part all_10_10_0 onto disk default finished. 2024.10.22 13:40:01.934553 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Renaming temporary part tmp-fetch_all_10_10_0 to all_10_10_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 13:40:01.934590 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Committing part all_10_10_0 to zookeeper 2024.10.22 13:40:01.942149 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Part all_10_10_0 committed to zookeeper 2024.10.22 13:40:01.942202 [ 221731 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Fetched part all_10_10_0 from default:/clickhouse/tables/01/version/replicas/01 2024.10.22 13:40:01.942231 [ 221631 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89029670912, merge_with_ttl_allowedtrue) 2024.10.22 13:40:01.942254 [ 221631 ] {} oximeter.version (6db82f34-d193-4788-8506-ec59aad0987f): Scheduling next merge selecting task after 60000ms