2024.08.27 19:19:55.389892 [ 1 ] {} Application: Forked a child process to watch 2024.08.27 19:19:55.401412 [ 1 ] {} Application: Will watch for the process with pid 21032 2024.08.27 19:19:55.644032 [ 1 ] {} Application: Starting ClickHouse 23.8.7.1 (revision: 54477, git hash: b6a391579f09dde47a1aa5602e154e7fcde80d1e, build id: ), PID 21032 2024.08.27 19:19:55.644550 [ 1 ] {} Application: starting up 2024.08.27 19:19:55.644725 [ 1 ] {} Application: OS name: SunOS, version: 5.11, architecture: i86pc 2024.08.27 19:19:55.695624 [ 1 ] {} Application: Available RAM: 31.99 GiB; physical cores: 8; logical cores: 8. 2024.08.27 19:19:55.706533 [ 1 ] {} Application: rlimit on number of file descriptors is 65536 2024.08.27 19:19:55.706682 [ 1 ] {} Application: Initializing DateLUT. 2024.08.27 19:19:55.706797 [ 1 ] {} Application: Initialized DateLUT with time zone 'UTC'. 2024.08.27 19:19:55.706962 [ 1 ] {} Context: Setting up /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/data/tmp/ to store temporary data in it 2024.08.27 19:19:55.707665 [ 1 ] {} Application: Initializing interserver credentials. 2024.08.27 19:19:55.708990 [ 1 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.08.27 19:19:55.710372 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.08.27 19:19:55.711002 [ 1 ] {} Application: Setting max_server_memory_usage was set to 28.79 GiB (31.99 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.08.27 19:19:55.711017 [ 1 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 16.00 GiB (31.99 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.08.27 19:19:55.711029 [ 1 ] {} Application: Merges and mutations memory limit is set to 16.00 GiB 2024.08.27 19:19:55.721969 [ 1 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2024.08.27 19:19:55.723537 [ 1 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads 2024.08.27 19:19:55.739012 [ 1 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2024.08.27 19:19:55.739898 [ 1 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2024.08.27 19:19:55.740864 [ 1 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.08.27 19:19:55.740942 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.08.27 19:19:55.741752 [ 1 ] {} Application: Listening for replica communication (interserver): http://[::1]:19402 2024.08.27 19:19:55.762793 [ 1 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.08.27 19:19:55.765431 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.08.27 19:19:55.787803 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.08.27 19:19:55.789235 [ 1 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml 2024.08.27 19:19:55.948453 [ 1 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2024.08.27 19:19:55.949996 [ 1 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2024.08.27 19:19:55.950563 [ 1 ] {} Context: Initialized background executor for fetches with num_threads=8, num_tasks=8 2024.08.27 19:19:55.951064 [ 1 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2024.08.27 19:19:55.952294 [ 1 ] {} DNSCacheUpdater: Update period 15 seconds 2024.08.27 19:19:55.952323 [ 1 ] {} Application: Loading metadata from /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/data/ 2024.08.27 19:19:55.955510 [ 57 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:19:55.955585 [ 57 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:19:55.971767 [ 1 ] {} DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total. 2024.08.27 19:19:55.971828 [ 1 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.000351614 sec 2024.08.27 19:19:55.971902 [ 1 ] {} ReferentialDeps: No tables 2024.08.27 19:19:55.971917 [ 1 ] {} LoadingDeps: No tables 2024.08.27 19:19:55.972057 [ 1 ] {} DatabaseAtomic (system): Starting up tables. 2024.08.27 19:19:55.972146 [ 1 ] {} SystemLog: Not creating system.query_log since corresponding section 'query_log' is missing from config 2024.08.27 19:19:55.972159 [ 1 ] {} SystemLog: Not creating system.query_thread_log since corresponding section 'query_thread_log' is missing from config 2024.08.27 19:19:55.972199 [ 1 ] {} SystemLog: Not creating system.part_log since corresponding section 'part_log' is missing from config 2024.08.27 19:19:55.972208 [ 1 ] {} SystemLog: Not creating system.trace_log since corresponding section 'trace_log' is missing from config 2024.08.27 19:19:55.972217 [ 1 ] {} SystemLog: Not creating system.crash_log since corresponding section 'crash_log' is missing from config 2024.08.27 19:19:55.972251 [ 1 ] {} SystemLog: Not creating system.text_log since corresponding section 'text_log' is missing from config 2024.08.27 19:19:55.972265 [ 1 ] {} SystemLog: Not creating system.metric_log since corresponding section 'metric_log' is missing from config 2024.08.27 19:19:55.972275 [ 1 ] {} SystemLog: Not creating system.filesystem_cache_log since corresponding section 'filesystem_cache_log' is missing from config 2024.08.27 19:19:55.972308 [ 1 ] {} SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config 2024.08.27 19:19:55.972323 [ 1 ] {} SystemLog: Not creating system.asynchronous_metric_log since corresponding section 'asynchronous_metric_log' is missing from config 2024.08.27 19:19:55.972332 [ 1 ] {} SystemLog: Not creating system.opentelemetry_span_log since corresponding section 'opentelemetry_span_log' is missing from config 2024.08.27 19:19:55.972341 [ 1 ] {} SystemLog: Not creating system.query_views_log since corresponding section 'query_views_log' is missing from config 2024.08.27 19:19:55.972367 [ 1 ] {} SystemLog: Not creating system.zookeeper_log since corresponding section 'zookeeper_log' is missing from config 2024.08.27 19:19:55.972376 [ 1 ] {} SystemLog: Not creating system.session_log since corresponding section 'session_log' is missing from config 2024.08.27 19:19:55.972409 [ 1 ] {} SystemLog: Not creating system.transactions_info_log since corresponding section 'transactions_info_log' is missing from config 2024.08.27 19:19:55.972424 [ 1 ] {} SystemLog: Not creating system.processors_profile_log since corresponding section 'processors_profile_log' is missing from config 2024.08.27 19:19:55.972433 [ 1 ] {} SystemLog: Not creating system.asynchronous_insert_log since corresponding section 'asynchronous_insert_log' is missing from config 2024.08.27 19:19:56.028399 [ 1 ] {} DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal. 2024.08.27 19:19:56.054298 [ 1 ] {} DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total. 2024.08.27 19:19:56.054337 [ 1 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.000134018 sec 2024.08.27 19:19:56.054348 [ 1 ] {} ReferentialDeps: No tables 2024.08.27 19:19:56.054356 [ 1 ] {} LoadingDeps: No tables 2024.08.27 19:19:56.054396 [ 1 ] {} DatabaseAtomic (default): Starting up tables. 2024.08.27 19:19:56.054958 [ 1 ] {} UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/data/user_defined/ 2024.08.27 19:19:56.055055 [ 1 ] {} UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded 2024.08.27 19:19:56.055069 [ 1 ] {} Application: Loaded metadata. 2024.08.27 19:19:56.055088 [ 1 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2024.08.27 19:19:56.055097 [ 1 ] {} Application: TaskStats is not implemented for this OS. IO accounting will be disabled. 2024.08.27 19:19:56.055320 [ 1 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.08.27 19:19:56.055642 [ 1 ] {} AsynchronousMetrics: MemoryTracking: was 9.99 MiB, peak 16.18 MiB, free memory in arenas 0.00 B, will set to 98.03 MiB (RSS), difference: 88.04 MiB 2024.08.27 19:19:56.056344 [ 1 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000110271 sec. 2024.08.27 19:19:56.057188 [ 1 ] {} Application: Listening for http://[::1]:19302 2024.08.27 19:19:56.057283 [ 1 ] {} Application: Listening for native protocol (tcp): [::1]:19202 2024.08.27 19:19:56.057296 [ 1 ] {} Application: Ready for connections. 2024.08.27 19:19:56.070304 [ 249 ] {} DDLWorker: Started DDLWorker cleanup thread 2024.08.27 19:19:56.073531 [ 244 ] {} DDLWorker: Starting DDLWorker thread 2024.08.27 19:19:56.073590 [ 244 ] {} DDLWorker: Initializing DDLWorker thread 2024.08.27 19:19:56.846826 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: GET, Address: [::1]:65512, User-Agent: (none), Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:19:57.080070 [ 244 ] {} ZooKeeperClient: Connected to a suboptimal ZooKeeper host ([::1]:19002, index 1). To preserve balance in ZooKeeper usage, this ZooKeeper session will expire in 16235 seconds 2024.08.27 19:19:57.080152 [ 244 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19002 with session_id 2 Poco::Exception. Code: 1000, e.code() = 0, Timeout: connect timed out: [::1]:19001 (version 23.8.7.1), [::1]:19001 2024.08.27 19:19:57.082868 [ 244 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.08.27 19:19:57.082910 [ 244 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.08.27 19:19:57.082923 [ 244 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.08.27 19:19:57.082962 [ 244 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003 2024.08.27 19:19:57.106122 [ 244 ] {} DDLWorker: Initialized DDLWorker thread 2024.08.27 19:19:57.106178 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:19:57.106187 [ 244 ] {} DDLWorker: Don't have unfinished tasks after restarting 2024.08.27 19:19:57.106229 [ 249 ] {} DDLWorker: Cleaning queue 2024.08.27 19:19:57.106671 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=0, queue_size=0, entries=none..none, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2024.08.27 19:19:57.106704 [ 244 ] {} DDLWorker: No tasks to schedule 2024.08.27 19:19:57.106714 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:19:57.486188 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:19:57.486220 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:19:57.487592 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=1, queue_size=1, entries=query-0000000000..query-0000000000, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2024.08.27 19:19:57.487702 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000000 2024.08.27 19:19:57.487723 [ 244 ] {} DDLWorker: Checking task query-0000000000 2024.08.27 19:19:57.491288 [ 244 ] {} DDLWorker: Processing task query-0000000000 (CREATE DATABASE IF NOT EXISTS oximeter UUID '4e169194-bd2b-407c-8d78-081075618ab9') 2024.08.27 19:19:57.495127 [ 244 ] {} DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID '4e169194-bd2b-407c-8d78-081075618ab9' 2024.08.27 19:19:57.495484 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: be97acaf-9db9-4e7c-b4e3-5559d009900b) /* ddl_entry=query-0000000000 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '4e169194-bd2b-407c-8d78-081075618ab9' (stage: Complete) 2024.08.27 19:19:57.496960 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} DatabaseAtomic (oximeter): Metadata processed, database oximeter has 0 tables and 0 dictionaries in total. 2024.08.27 19:19:57.496984 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} TablesLoader: Parsed metadata of 0 tables in 1 databases in 8.2856e-05 sec 2024.08.27 19:19:57.496995 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} ReferentialDeps: No tables 2024.08.27 19:19:57.497014 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} LoadingDeps: No tables 2024.08.27 19:19:57.497039 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} DatabaseAtomic (oximeter): Starting up tables. 2024.08.27 19:19:57.497159 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} DDLWorker: Executed query: /* ddl_entry=query-0000000000 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '4e169194-bd2b-407c-8d78-081075618ab9' 2024.08.27 19:19:57.500403 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:02.177754 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:02.177770 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:02.178184 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=2, queue_size=2, entries=query-0000000000..query-0000000001, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000000, last_skipped_entry_name=none 2024.08.27 19:20:02.178221 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000001 2024.08.27 19:20:02.178230 [ 244 ] {} DDLWorker: Checking task query-0000000001 2024.08.27 19:20:02.182332 [ 244 ] {} DDLWorker: Processing task query-0000000001 (CREATE TABLE IF NOT EXISTS oximeter.version UUID 'a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)) 2024.08.27 19:20:02.185977 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID 'a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.08.27 19:20:02.186229 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b1a3482e-4a05-424b-a61a-9a61af385a27) /* ddl_entry=query-0000000001 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) 2024.08.27 19:20:02.189163 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} StoragePolicy (default): Storage policy default created, total volumes 1 2024.08.27 19:20:02.190420 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Loading data parts 2024.08.27 19:20:02.191361 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): There are no data parts 2024.08.27 19:20:02.207883 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Creating table /clickhouse/tables/1/version 2024.08.27 19:20:02.246330 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Creating shared ID for table oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e) 2024.08.27 19:20:02.249286 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Shared ID for table oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e) doesn't exist in ZooKeeper on path /clickhouse/tables/1/version/table_shared_id 2024.08.27 19:20:02.249323 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Got candidate ID a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e, will try to create it in ZooKeeper on path /clickhouse/tables/1/version/table_shared_id 2024.08.27 19:20:02.252396 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Initializing table shared ID with a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e 2024.08.27 19:20:02.253753 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Starting up table 2024.08.27 19:20:02.257145 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Became leader 2024.08.27 19:20:02.257174 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:02.257217 [ 93 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.08.27 19:20:02.257299 [ 93 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:02.264339 [ 93 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:02.264714 [ 93 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:02.264789 [ 93 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue 2024.08.27 19:20:02.265122 [ 93 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:02.265622 [ 93 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:02.271495 [ 93 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:02.271635 [ 97 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 6048ms 2024.08.27 19:20:02.271806 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} DDLWorker: Executed query: /* ddl_entry=query-0000000001 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.08.27 19:20:02.278287 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:02.350396 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:02.350415 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:02.351016 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=3, queue_size=3, entries=query-0000000000..query-0000000002, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000001, last_skipped_entry_name=none 2024.08.27 19:20:02.351044 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000002 2024.08.27 19:20:02.351066 [ 244 ] {} DDLWorker: Checking task query-0000000002 2024.08.27 19:20:02.355417 [ 244 ] {} DDLWorker: Processing task query-0000000002 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '5a85093b-c21a-4b08-bf37-6af0108427b6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.08.27 19:20:02.359559 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '5a85093b-c21a-4b08-bf37-6af0108427b6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.08.27 19:20:02.360209 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0b56b027-8b9f-4d5b-bc1f-279770028326) /* ddl_entry=query-0000000002 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '5a85093b-c21a-4b08-bf37-6af0108427b6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.08.27 19:20:02.364659 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Loading data parts 2024.08.27 19:20:02.365283 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): There are no data parts 2024.08.27 19:20:02.369858 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Creating table /clickhouse/tables/1/measurements_cumulativef64_local 2024.08.27 19:20:02.429554 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Creating shared ID for table oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) 2024.08.27 19:20:02.430008 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Initializing table shared ID with 5a85093b-c21a-4b08-bf37-6af0108427b6 2024.08.27 19:20:02.431360 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Starting up table 2024.08.27 19:20:02.435171 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Became leader 2024.08.27 19:20:02.435243 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:02.435373 [ 87 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.08.27 19:20:02.435410 [ 87 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:02.439857 [ 87 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:02.440229 [ 87 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:02.440273 [ 87 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue 2024.08.27 19:20:02.440611 [ 87 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:02.441074 [ 87 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:02.452135 [ 87 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:02.452187 [ 169 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 6104ms 2024.08.27 19:20:02.452498 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} DDLWorker: Executed query: /* ddl_entry=query-0000000002 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '5a85093b-c21a-4b08-bf37-6af0108427b6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.08.27 19:20:02.455852 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:02.520244 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:02.520279 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:02.521164 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=4, queue_size=4, entries=query-0000000000..query-0000000003, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000002, last_skipped_entry_name=none 2024.08.27 19:20:02.521205 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000003 2024.08.27 19:20:02.521216 [ 244 ] {} DDLWorker: Checking task query-0000000003 2024.08.27 19:20:02.525392 [ 244 ] {} DDLWorker: Processing task query-0000000003 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'bb1f6542-3e31-405f-bfaa-a78e4b1d3083' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:02.528524 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'bb1f6542-3e31-405f-bfaa-a78e4b1d3083' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:02.528759 [ 244 ] {b3567f78-03b6-4d49-afef-8b4c7a18d9b6} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8db40eed-8365-49a4-a4bb-213e762f5861) /* ddl_entry=query-0000000003 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'bb1f6542-3e31-405f-bfaa-a78e4b1d3083' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:02.529939 [ 244 ] {b3567f78-03b6-4d49-afef-8b4c7a18d9b6} StorageDistributed (measurements_cumulativef64): Auto-increment is 0 2024.08.27 19:20:02.531431 [ 244 ] {b3567f78-03b6-4d49-afef-8b4c7a18d9b6} DDLWorker: Executed query: /* ddl_entry=query-0000000003 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'bb1f6542-3e31-405f-bfaa-a78e4b1d3083' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:02.536359 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:02.644926 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:02.644940 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:02.648554 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=5, queue_size=5, entries=query-0000000000..query-0000000004, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000003, last_skipped_entry_name=none 2024.08.27 19:20:02.648594 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000004 2024.08.27 19:20:02.648607 [ 244 ] {} DDLWorker: Checking task query-0000000004 2024.08.27 19:20:02.650042 [ 244 ] {} DDLWorker: Processing task query-0000000004 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cf08e0ee-71a3-4243-81ae-d52967c1399a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.08.27 19:20:02.653948 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cf08e0ee-71a3-4243-81ae-d52967c1399a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:02.655345 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 95e19506-23b5-475e-b73d-b39f4ccabc7e) /* ddl_entry=query-0000000004 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cf08e0ee-71a3-4243-81ae-d52967c1399a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.08.27 19:20:02.658551 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Loading data parts 2024.08.27 19:20:02.659519 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): There are no data parts 2024.08.27 19:20:02.668105 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Creating table /clickhouse/tables/1/fields_i64_local 2024.08.27 19:20:02.706568 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Creating shared ID for table oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) 2024.08.27 19:20:02.707216 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Shared ID for table oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) doesn't exist in ZooKeeper on path /clickhouse/tables/1/fields_i64_local/table_shared_id 2024.08.27 19:20:02.707261 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Got candidate ID cf08e0ee-71a3-4243-81ae-d52967c1399a, will try to create it in ZooKeeper on path /clickhouse/tables/1/fields_i64_local/table_shared_id 2024.08.27 19:20:02.710972 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Initializing table shared ID with cf08e0ee-71a3-4243-81ae-d52967c1399a 2024.08.27 19:20:02.712491 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Starting up table 2024.08.27 19:20:02.724222 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Became leader 2024.08.27 19:20:02.724319 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:02.724384 [ 89 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.08.27 19:20:02.724404 [ 89 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:02.732673 [ 89 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:02.733123 [ 89 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:02.733167 [ 89 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue 2024.08.27 19:20:02.733962 [ 89 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:02.734553 [ 89 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:02.746002 [ 89 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:02.746047 [ 77 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 6378ms 2024.08.27 19:20:02.746610 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} DDLWorker: Executed query: /* ddl_entry=query-0000000004 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cf08e0ee-71a3-4243-81ae-d52967c1399a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:02.751066 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:02.829883 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:02.829909 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:02.830539 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=6, queue_size=6, entries=query-0000000000..query-0000000005, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000004, last_skipped_entry_name=none 2024.08.27 19:20:02.830582 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000005 2024.08.27 19:20:02.830593 [ 244 ] {} DDLWorker: Checking task query-0000000005 2024.08.27 19:20:02.835150 [ 244 ] {} DDLWorker: Processing task query-0000000005 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2bcf3967-e0ba-4c8e-93cc-a7d49d0063ff' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:02.838285 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2bcf3967-e0ba-4c8e-93cc-a7d49d0063ff' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:02.838604 [ 244 ] {4dc9be3d-e731-42de-a2f0-993fd9a7cd41} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 13bf1d3d-d4ba-4e5d-9651-1ceee17e4ed0) /* ddl_entry=query-0000000005 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2bcf3967-e0ba-4c8e-93cc-a7d49d0063ff' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:02.839876 [ 244 ] {4dc9be3d-e731-42de-a2f0-993fd9a7cd41} StorageDistributed (fields_i64): Auto-increment is 0 2024.08.27 19:20:02.841187 [ 244 ] {4dc9be3d-e731-42de-a2f0-993fd9a7cd41} DDLWorker: Executed query: /* ddl_entry=query-0000000005 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2bcf3967-e0ba-4c8e-93cc-a7d49d0063ff' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:02.844760 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:02.914466 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:02.914543 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:02.915216 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=7, queue_size=7, entries=query-0000000000..query-0000000006, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000005, last_skipped_entry_name=none 2024.08.27 19:20:02.915268 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000006 2024.08.27 19:20:02.915280 [ 244 ] {} DDLWorker: Checking task query-0000000006 2024.08.27 19:20:02.920796 [ 244 ] {} DDLWorker: Processing task query-0000000006 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a9e89244-7177-439d-9410-6c84872c1664' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.08.27 19:20:02.925074 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a9e89244-7177-439d-9410-6c84872c1664' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:02.925753 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5ef8b8c4-a644-449b-8690-8760d69fa872) /* ddl_entry=query-0000000006 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a9e89244-7177-439d-9410-6c84872c1664' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.08.27 19:20:02.929731 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Loading data parts 2024.08.27 19:20:02.930210 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): There are no data parts 2024.08.27 19:20:02.938920 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Creating table /clickhouse/tables/1/fields_uuid_local 2024.08.27 19:20:02.947748 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): It looks like the table /clickhouse/tables/1/fields_uuid_local was created by another server at the same moment, will retry 2024.08.27 19:20:02.948990 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): This table /clickhouse/tables/1/fields_uuid_local is already created, will add new replica 2024.08.27 19:20:02.957714 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Creating replica /clickhouse/tables/1/fields_uuid_local/replicas/2 2024.08.27 19:20:03.000695 [ 246 ] {} AsynchronousMetrics: MemoryTracking: was 102.06 MiB, peak 102.06 MiB, free memory in arenas 0.00 B, will set to 104.77 MiB (RSS), difference: 2.71 MiB 2024.08.27 19:20:03.029192 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Creating shared ID for table oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) 2024.08.27 19:20:03.030153 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Initializing table shared ID with a9e89244-7177-439d-9410-6c84872c1664 2024.08.27 19:20:03.031909 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Starting up table 2024.08.27 19:20:03.034971 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Became leader 2024.08.27 19:20:03.035001 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:03.035059 [ 97 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.08.27 19:20:03.035129 [ 97 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:03.043529 [ 97 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Replica 1 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.08.27 19:20:03.043587 [ 97 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Will mimic 1 2024.08.27 19:20:03.053777 [ 97 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Queued 0 parts to be fetched, 0 parts ignored 2024.08.27 19:20:03.053836 [ 97 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Copied 0 queue entries, 0 entries ignored 2024.08.27 19:20:03.054398 [ 97 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Parts in ZooKeeper after mimic: 2024.08.27 19:20:03.054455 [ 97 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Enqueued fetches after mimic: 2024.08.27 19:20:03.058159 [ 97 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:03.058549 [ 97 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:03.058585 [ 97 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue 2024.08.27 19:20:03.059076 [ 97 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:03.059472 [ 97 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:03.062380 [ 97 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:03.062420 [ 77 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 6159ms 2024.08.27 19:20:03.062835 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} DDLWorker: Executed query: /* ddl_entry=query-0000000006 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a9e89244-7177-439d-9410-6c84872c1664' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:03.066682 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:03.206600 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:03.206605 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:03.207417 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=8, queue_size=8, entries=query-0000000000..query-0000000007, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000006, last_skipped_entry_name=none 2024.08.27 19:20:03.207465 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000007 2024.08.27 19:20:03.207477 [ 244 ] {} DDLWorker: Checking task query-0000000007 2024.08.27 19:20:03.212424 [ 244 ] {} DDLWorker: Processing task query-0000000007 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID 'e9919c3e-527e-45d0-bc14-c1846f7d72bb' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:03.219168 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID 'e9919c3e-527e-45d0-bc14-c1846f7d72bb' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:03.219662 [ 244 ] {988b4e86-1ffd-464d-8022-25817d76a898} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 48779d3d-3b83-4b05-afaa-eea90bbbfa75) /* ddl_entry=query-0000000007 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID 'e9919c3e-527e-45d0-bc14-c1846f7d72bb' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:03.221168 [ 244 ] {988b4e86-1ffd-464d-8022-25817d76a898} StorageDistributed (fields_uuid): Auto-increment is 0 2024.08.27 19:20:03.223281 [ 244 ] {988b4e86-1ffd-464d-8022-25817d76a898} DDLWorker: Executed query: /* ddl_entry=query-0000000007 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID 'e9919c3e-527e-45d0-bc14-c1846f7d72bb' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:03.228326 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:03.348210 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:03.350073 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=9, queue_size=9, entries=query-0000000000..query-0000000008, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000007, last_skipped_entry_name=none 2024.08.27 19:20:03.350112 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000008 2024.08.27 19:20:03.350126 [ 244 ] {} DDLWorker: Checking task query-0000000008 2024.08.27 19:20:03.350884 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:03.356343 [ 244 ] {} DDLWorker: Processing task query-0000000008 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '95e71a20-0d77-40b6-ae4f-41a6e9863749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)) 2024.08.27 19:20:03.362618 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '95e71a20-0d77-40b6-ae4f-41a6e9863749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.08.27 19:20:03.363093 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 2c58ba80-f1c2-4463-a133-ca2f604b1fef) /* ddl_entry=query-0000000008 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '95e71a20-0d77-40b6-ae4f-41a6e9863749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) 2024.08.27 19:20:03.365766 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Loading data parts 2024.08.27 19:20:03.366316 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): There are no data parts 2024.08.27 19:20:03.376869 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Creating table /clickhouse/tables/1/timeseries_schema_local 2024.08.27 19:20:03.452468 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Creating shared ID for table oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) 2024.08.27 19:20:03.453011 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Shared ID for table oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) doesn't exist in ZooKeeper on path /clickhouse/tables/1/timeseries_schema_local/table_shared_id 2024.08.27 19:20:03.453073 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Got candidate ID 95e71a20-0d77-40b6-ae4f-41a6e9863749, will try to create it in ZooKeeper on path /clickhouse/tables/1/timeseries_schema_local/table_shared_id 2024.08.27 19:20:03.459111 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Initializing table shared ID with 95e71a20-0d77-40b6-ae4f-41a6e9863749 2024.08.27 19:20:03.460542 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Starting up table 2024.08.27 19:20:03.467971 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Became leader 2024.08.27 19:20:03.468002 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:03.468272 [ 181 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.08.27 19:20:03.468317 [ 181 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:03.473801 [ 181 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:03.474420 [ 181 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:03.474451 [ 181 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue 2024.08.27 19:20:03.474857 [ 181 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:03.478626 [ 181 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:03.485280 [ 181 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:03.485377 [ 77 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 6407ms 2024.08.27 19:20:03.485919 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} DDLWorker: Executed query: /* ddl_entry=query-0000000008 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '95e71a20-0d77-40b6-ae4f-41a6e9863749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.08.27 19:20:03.494160 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:03.638249 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:03.638291 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:03.639013 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=10, queue_size=10, entries=query-0000000000..query-0000000009, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000008, last_skipped_entry_name=none 2024.08.27 19:20:03.639062 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000009 2024.08.27 19:20:03.639072 [ 244 ] {} DDLWorker: Checking task query-0000000009 2024.08.27 19:20:03.649775 [ 244 ] {} DDLWorker: Processing task query-0000000009 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '0a9c4888-9434-4e55-8004-ef2c1a6760f2' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:03.661754 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '0a9c4888-9434-4e55-8004-ef2c1a6760f2' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:03.662296 [ 244 ] {67e15156-b1e6-422c-8ff5-c8491e141ccf} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d5618f2a-ecd1-4f2e-bd07-034fd0ad7816) /* ddl_entry=query-0000000009 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '0a9c4888-9434-4e55-8004-ef2c1a6760f2' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:03.664139 [ 244 ] {67e15156-b1e6-422c-8ff5-c8491e141ccf} StorageDistributed (timeseries_schema): Auto-increment is 0 2024.08.27 19:20:03.666291 [ 244 ] {67e15156-b1e6-422c-8ff5-c8491e141ccf} DDLWorker: Executed query: /* ddl_entry=query-0000000009 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '0a9c4888-9434-4e55-8004-ef2c1a6760f2' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:03.671275 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:03.765903 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 93, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:03.766168 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:03.766212 [ 3 ] {} HTTP-Session: 67a3ed93-3475-4961-a062-c81ea0e2724f Authenticating user 'default' from [::1]:65512 2024.08.27 19:20:03.766336 [ 3 ] {} HTTP-Session: 67a3ed93-3475-4961-a062-c81ea0e2724f Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:03.766361 [ 3 ] {} HTTP-Session: 67a3ed93-3475-4961-a062-c81ea0e2724f Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:03.766513 [ 3 ] {} ContextAccess (default): Settings: readonly = 0, allow_ddl = true, allow_introspection_functions = false 2024.08.27 19:20:03.766577 [ 3 ] {} ContextAccess (default): List of all grants: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* 2024.08.27 19:20:03.766612 [ 3 ] {} ContextAccess (default): List of all grants including implicit: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* 2024.08.27 19:20:03.766700 [ 3 ] {} HTTP-Session: 67a3ed93-3475-4961-a062-c81ea0e2724f Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:03.767247 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} executeQuery: (from [::1]:65512) SELECT name FROM system.tables WHERE database = 'oximeter' AND engine = 'ReplicatedMergeTree' (stage: Complete) 2024.08.27 19:20:03.768278 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} ContextAccess (default): Access granted: SELECT(database, name, engine) ON system.tables 2024.08.27 19:20:03.768862 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:03.769871 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} ContextAccess (default): Access granted: SHOW TABLES ON *.* 2024.08.27 19:20:03.771404 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} executeQuery: Read 9 rows, 631.00 B in 0.004303 sec., 2091.564025098768 rows/sec., 143.20 KiB/sec. 2024.08.27 19:20:03.772194 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} DynamicQueryHandler: Done processing query 2024.08.27 19:20:03.772225 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} MemoryTracker: Peak memory usage (for query): 4.00 MiB. 2024.08.27 19:20:03.772240 [ 3 ] {} HTTP-Session: 67a3ed93-3475-4961-a062-c81ea0e2724f Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:04.000452 [ 246 ] {} AsynchronousMetrics: MemoryTracking: was 105.16 MiB, peak 110.13 MiB, free memory in arenas 0.00 B, will set to 106.23 MiB (RSS), difference: 1.07 MiB 2024.08.27 19:20:04.837374 [ 89 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.08.27 19:20:04.842015 [ 89 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.08.27 19:20:04.842125 [ 89 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:04.846976 [ 193 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Fetching part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/1 2024.08.27 19:20:04.850703 [ 193 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ftimeseries_schema_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.08.27 19:20:04.850977 [ 193 ] {} HTTPSessionAdapter: Created HTTP(S) session with ::1:19401 (::1:19401) 2024.08.27 19:20:04.853241 [ 193 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:04.853340 [ 193 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:04.853362 [ 193 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:04.853425 [ 193 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.08.27 19:20:04.856485 [ 193 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.08.27 19:20:04.856542 [ 193 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:04.856728 [ 193 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Committing part all_0_0_0 to zookeeper 2024.08.27 19:20:04.860284 [ 193 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Part all_0_0_0 committed to zookeeper 2024.08.27 19:20:04.860411 [ 193 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Fetched part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/1 2024.08.27 19:20:04.860592 [ 87 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue) 2024.08.27 19:20:04.860652 [ 87 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 7716ms 2024.08.27 19:20:04.878504 [ 87 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.08.27 19:20:04.881920 [ 87 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.08.27 19:20:04.881951 [ 87 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:04.886638 [ 194 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1 2024.08.27 19:20:04.890120 [ 194 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.08.27 19:20:04.892854 [ 194 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:04.892929 [ 194 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:04.892946 [ 194 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:04.892974 [ 194 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.08.27 19:20:04.895594 [ 194 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.08.27 19:20:04.895712 [ 194 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:04.895844 [ 194 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Committing part all_0_0_0 to zookeeper 2024.08.27 19:20:04.905443 [ 194 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Part all_0_0_0 committed to zookeeper 2024.08.27 19:20:04.905723 [ 194 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1 2024.08.27 19:20:04.905802 [ 87 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue) 2024.08.27 19:20:04.905866 [ 87 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 7874ms 2024.08.27 19:20:04.914504 [ 87 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.08.27 19:20:04.921952 [ 87 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.08.27 19:20:04.922042 [ 87 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:04.928749 [ 193 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1 2024.08.27 19:20:04.933059 [ 193 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.08.27 19:20:04.934708 [ 193 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:04.934787 [ 193 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:04.934822 [ 193 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:04.934939 [ 193 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.08.27 19:20:04.937440 [ 193 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.08.27 19:20:04.937525 [ 193 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:04.937730 [ 193 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Committing part all_0_0_0 to zookeeper 2024.08.27 19:20:04.942294 [ 193 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Part all_0_0_0 committed to zookeeper 2024.08.27 19:20:04.942379 [ 89 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000 2024.08.27 19:20:04.942400 [ 193 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1 2024.08.27 19:20:04.942516 [ 87 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue) 2024.08.27 19:20:04.942591 [ 87 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 8085ms 2024.08.27 19:20:04.951886 [ 89 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.08.27 19:20:04.951942 [ 89 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:04.964262 [ 196 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Fetching part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1 2024.08.27 19:20:04.964866 [ 196 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.08.27 19:20:04.968933 [ 196 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:04.969014 [ 196 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:04.969050 [ 196 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:04.969085 [ 196 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.08.27 19:20:04.971806 [ 196 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.08.27 19:20:04.971912 [ 196 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:04.972024 [ 196 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Committing part all_0_0_0 to zookeeper 2024.08.27 19:20:04.975403 [ 196 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Part all_0_0_0 committed to zookeeper 2024.08.27 19:20:04.975520 [ 196 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Fetched part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1 2024.08.27 19:20:04.975622 [ 77 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue) 2024.08.27 19:20:04.975683 [ 77 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 7522ms 2024.08.27 19:20:05.001149 [ 246 ] {} AsynchronousMetrics: MemoryTracking: was 106.23 MiB, peak 110.13 MiB, free memory in arenas 0.00 B, will set to 107.61 MiB (RSS), difference: 1.38 MiB 2024.08.27 19:20:05.037259 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 60, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:05.037386 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:05.037408 [ 3 ] {} HTTP-Session: 56bdfc97-924b-49c6-bc4a-5c5dcb548255 Authenticating user 'default' from [::1]:65512 2024.08.27 19:20:05.037452 [ 3 ] {} HTTP-Session: 56bdfc97-924b-49c6-bc4a-5c5dcb548255 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:05.037464 [ 3 ] {} HTTP-Session: 56bdfc97-924b-49c6-bc4a-5c5dcb548255 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:05.037527 [ 3 ] {} HTTP-Session: 56bdfc97-924b-49c6-bc4a-5c5dcb548255 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:05.037895 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} executeQuery: (from [::1]:65512) SELECT * FROM oximeter.timeseries_schema FORMAT JSONEachRow; (stage: Complete) 2024.08.27 19:20:05.038364 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema 2024.08.27 19:20:05.038713 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema 2024.08.27 19:20:05.039434 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local 2024.08.27 19:20:05.039716 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:05.039904 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:05.040333 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (SelectExecutor): Key condition: unknown 2024.08.27 19:20:05.040452 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.08.27 19:20:05.040519 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:05.040638 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0 2024.08.27 19:20:05.045207 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} executeQuery: Read 1 rows, 126.00 B in 0.007414 sec., 134.87995683841382 rows/sec., 16.60 KiB/sec. 2024.08.27 19:20:05.046023 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} DynamicQueryHandler: Done processing query 2024.08.27 19:20:05.046064 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} MemoryTracker: Peak memory usage (for query): 4.00 MiB. 2024.08.27 19:20:05.046138 [ 3 ] {} HTTP-Session: 56bdfc97-924b-49c6-bc4a-5c5dcb548255 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:05.048965 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:05.049131 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:05.049186 [ 3 ] {} HTTP-Session: 96e4e428-4693-4521-93b5-b5e809e7f954 Authenticating user 'default' from [::1]:65512 2024.08.27 19:20:05.049213 [ 3 ] {} HTTP-Session: 96e4e428-4693-4521-93b5-b5e809e7f954 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:05.049223 [ 3 ] {} HTTP-Session: 96e4e428-4693-4521-93b5-b5e809e7f954 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:05.049301 [ 3 ] {} HTTP-Session: 96e4e428-4693-4521-93b5-b5e809e7f954 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:05.049934 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} executeQuery: (from [::1]:65512) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:05.050689 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:05.051174 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:05.051620 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:05.052550 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:05.054919 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:05.055219 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e6f74f0) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:05.055262 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e6f74f0) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:05.055485 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e6f74f0) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.08.27 19:20:05.057254 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:05.058272 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:05.058429 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e6f2e60) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:05.058463 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e6f2e60) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:05.059575 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:05.059974 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:05.060397 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:05.060439 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:05.060710 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.08.27 19:20:05.060794 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:05.061071 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:05.061297 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e7191b0) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0) 2024.08.27 19:20:05.061323 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e7191b0) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)] 2024.08.27 19:20:05.062071 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:05.063189 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:05.063672 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:05.064076 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:05.064110 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:05.064385 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.08.27 19:20:05.064462 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:05.064528 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:05.064637 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e74f450) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:05.064654 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e74f450) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:05.064832 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e6f2e60) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.08.27 19:20:05.065333 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:05.065782 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:05.066171 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:05.066204 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:05.066468 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.08.27 19:20:05.066548 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:05.066615 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:05.066628 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:05.066671 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.08.27 19:20:05.066769 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:05.066840 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:05.066870 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:05.066902 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.08.27 19:20:05.067480 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:05.067535 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:05.067590 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:05.067615 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:05.067629 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:05.067668 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.08.27 19:20:05.067685 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:05.067826 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:05.067858 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 8 rows starting from 0 2024.08.27 19:20:05.068081 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:05.068130 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:05.068173 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:05.068208 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.08.27 19:20:05.068225 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:05.068265 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.08.27 19:20:05.068279 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:05.068369 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:05.068402 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0 2024.08.27 19:20:05.068497 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.08.27 19:20:05.068535 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:05.068673 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:05.068710 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:05.068729 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:05.068748 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:05.068761 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:05.068784 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.08.27 19:20:05.068807 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:05.068894 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:05.068924 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0 2024.08.27 19:20:05.069001 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:05.069036 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.08.27 19:20:05.072637 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} executeQuery: Read 40 rows, 2.89 KiB in 0.023113 sec., 1730.6277852290918 rows/sec., 125.06 KiB/sec. 2024.08.27 19:20:05.072952 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e74f450) Join data is being destroyed, 12800 bytes and 8 rows in hash table 2024.08.27 19:20:05.073132 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} HashJoin: (0x1e7191b0) Join data is being destroyed, 12544 bytes and 8 rows in hash table 2024.08.27 19:20:05.073858 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} DynamicQueryHandler: Done processing query 2024.08.27 19:20:05.073888 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} MemoryTracker: Peak memory usage (for query): 4.00 MiB. 2024.08.27 19:20:05.073904 [ 3 ] {} HTTP-Session: 96e4e428-4693-4521-93b5-b5e809e7f954 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:05.075551 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 409, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:05.075659 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:05.075681 [ 3 ] {} HTTP-Session: c9ae3c7a-de20-4e46-a82f-d23525dd1cd0 Authenticating user 'default' from [::1]:65512 2024.08.27 19:20:05.075721 [ 3 ] {} HTTP-Session: c9ae3c7a-de20-4e46-a82f-d23525dd1cd0 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:05.075732 [ 3 ] {} HTTP-Session: c9ae3c7a-de20-4e46-a82f-d23525dd1cd0 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:05.075790 [ 3 ] {} HTTP-Session: c9ae3c7a-de20-4e46-a82f-d23525dd1cd0 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:05.076152 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} executeQuery: (from [::1]:65512) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (627643266003148065,4866144566314509062,5109363932695672526,6133729158133445591,6418373900407287174,7614030865733607559,9495597746874019221,15640909565249536871)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:05.077047 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.08.27 19:20:05.077639 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.08.27 19:20:05.078128 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:05.078174 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (627643266003148065, 4866144566314509062, 5109363932695672526, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 15640909565249536871)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:05.078548 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local 2024.08.27 19:20:05.078647 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:05.078763 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:05.079111 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Key condition: (column 1 in 8-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:05.079171 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps 2024.08.27 19:20:05.079221 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.08.27 19:20:05.079243 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Spreading ranges among streams with order 2024.08.27 19:20:05.079402 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (627643266003148065, 4866144566314509062, 5109363932695672526, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 15640909565249536871))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:05.079442 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 2024.08.27 19:20:05.082200 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} executeQuery: Read 400 rows, 25.78 KiB in 0.006253 sec., 63969.29473852551 rows/sec., 4.03 MiB/sec. 2024.08.27 19:20:05.082852 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} DynamicQueryHandler: Done processing query 2024.08.27 19:20:05.082889 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} MemoryTracker: Peak memory usage (for query): 3.99 MiB. 2024.08.27 19:20:05.082903 [ 3 ] {} HTTP-Session: c9ae3c7a-de20-4e46-a82f-d23525dd1cd0 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.000509 [ 246 ] {} AsynchronousMetrics: MemoryTracking: was 107.76 MiB, peak 112.72 MiB, free memory in arenas 0.00 B, will set to 110.14 MiB (RSS), difference: 2.38 MiB 2024.08.27 19:20:06.079439 [ 247 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.08.27 19:20:06.080741 [ 247 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.08.27 19:20:06.081510 [ 247 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.08.27 19:20:06.086984 [ 245 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.08.27 19:20:06.088353 [ 245 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.08.27 19:20:06.089182 [ 245 ] {} Application: Setting max_server_memory_usage was set to 28.79 GiB (31.99 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.08.27 19:20:06.089200 [ 245 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 16.00 GiB (31.99 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.08.27 19:20:06.089225 [ 245 ] {} Application: Merges and mutations memory limit is set to 16.00 GiB 2024.08.27 19:20:06.089643 [ 245 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor 2024.08.27 19:20:06.089690 [ 245 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor 2024.08.27 19:20:06.089703 [ 245 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor 2024.08.27 19:20:06.089731 [ 245 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor 2024.08.27 19:20:06.090193 [ 245 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.08.27 19:20:06.090239 [ 245 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.08.27 19:20:06.093532 [ 245 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.08.27 19:20:06.094306 [ 245 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.08.27 19:20:06.556486 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:06.556517 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:06.557423 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=11, queue_size=11, entries=query-0000000000..query-0000000010, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000009, last_skipped_entry_name=none 2024.08.27 19:20:06.557456 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000010 2024.08.27 19:20:06.557465 [ 244 ] {} DDLWorker: Checking task query-0000000010 2024.08.27 19:20:06.561660 [ 244 ] {} DDLWorker: Processing task query-0000000010 (CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b') 2024.08.27 19:20:06.567391 [ 244 ] {} DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b' 2024.08.27 19:20:06.567523 [ 244 ] {50c9aaae-93f2-4adf-bf5d-76a204cd968a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 00225401-2519-48fa-8153-0a4188d42636) /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b' (stage: Complete) 2024.08.27 19:20:06.567687 [ 244 ] {50c9aaae-93f2-4adf-bf5d-76a204cd968a} DDLWorker: Executed query: /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b' 2024.08.27 19:20:06.578751 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:06.692139 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:06.692256 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:06.695666 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=12, queue_size=12, entries=query-0000000000..query-0000000011, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000010, last_skipped_entry_name=none 2024.08.27 19:20:06.695743 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000011 2024.08.27 19:20:06.695785 [ 244 ] {} DDLWorker: Checking task query-0000000011 2024.08.27 19:20:06.697023 [ 244 ] {} DDLWorker: Processing task query-0000000011 (CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)) 2024.08.27 19:20:06.700245 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.08.27 19:20:06.700467 [ 244 ] {aa71291c-7c9e-442d-a88d-ca0d5bad0fab} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6f6c813b-85a8-4f90-b375-647f513add95) /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) 2024.08.27 19:20:06.700687 [ 244 ] {aa71291c-7c9e-442d-a88d-ca0d5bad0fab} DDLWorker: Executed query: /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.08.27 19:20:06.711901 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:06.818250 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:06.818292 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:06.819011 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=13, queue_size=13, entries=query-0000000000..query-0000000012, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000011, last_skipped_entry_name=none 2024.08.27 19:20:06.819077 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000012 2024.08.27 19:20:06.819088 [ 244 ] {} DDLWorker: Checking task query-0000000012 2024.08.27 19:20:06.822945 [ 244 ] {} DDLWorker: Processing task query-0000000012 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.08.27 19:20:06.829048 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.08.27 19:20:06.829423 [ 244 ] {e6a0e741-516e-4fc3-8470-d3dbe95d13d1} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 60e1672f-1a93-42f4-bdb3-23817d9077bf) /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.08.27 19:20:06.829736 [ 244 ] {e6a0e741-516e-4fc3-8470-d3dbe95d13d1} DDLWorker: Executed query: /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.08.27 19:20:06.835820 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.000271 [ 246 ] {} AsynchronousMetrics: MemoryTracking: was 110.19 MiB, peak 123.14 MiB, free memory in arenas 0.00 B, will set to 123.58 MiB (RSS), difference: 13.39 MiB 2024.08.27 19:20:07.001855 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.001895 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.002292 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=14, queue_size=14, entries=query-0000000000..query-0000000013, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000012, last_skipped_entry_name=none 2024.08.27 19:20:07.002325 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000013 2024.08.27 19:20:07.002362 [ 244 ] {} DDLWorker: Checking task query-0000000013 2024.08.27 19:20:07.006588 [ 244 ] {} DDLWorker: Processing task query-0000000013 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:07.017237 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.017649 [ 244 ] {d3311414-7a74-49c3-8efe-99573e907cc2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ee8e23ad-46b3-40df-b03c-32b65df97ae1) /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.018007 [ 244 ] {d3311414-7a74-49c3-8efe-99573e907cc2} DDLWorker: Executed query: /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.023334 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.130562 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.130583 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.134914 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=15, queue_size=15, entries=query-0000000000..query-0000000014, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000013, last_skipped_entry_name=none 2024.08.27 19:20:07.134984 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000014 2024.08.27 19:20:07.135025 [ 244 ] {} DDLWorker: Checking task query-0000000014 2024.08.27 19:20:07.140949 [ 244 ] {} DDLWorker: Processing task query-0000000014 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.08.27 19:20:07.148398 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:07.148797 [ 244 ] {9bbbcea1-0588-473c-aba5-e6f791ae6d65} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: eaf35fa9-e032-40af-9452-955864320874) /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.08.27 19:20:07.149253 [ 244 ] {9bbbcea1-0588-473c-aba5-e6f791ae6d65} DDLWorker: Executed query: /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:07.155227 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.273862 [ 4 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:44467, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:07.274068 [ 4 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false 2024.08.27 19:20:07.274116 [ 4 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Replicated PartsService): Sending part all_0_0_0 2024.08.27 19:20:07.274997 [ 4 ] {} InterserverIOHTTPHandler: Done processing query 2024.08.27 19:20:07.304258 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.304287 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.305076 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=16, queue_size=16, entries=query-0000000000..query-0000000015, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000014, last_skipped_entry_name=none 2024.08.27 19:20:07.305101 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000015 2024.08.27 19:20:07.305139 [ 244 ] {} DDLWorker: Checking task query-0000000015 2024.08.27 19:20:07.310278 [ 244 ] {} DDLWorker: Processing task query-0000000015 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:07.313755 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.314034 [ 244 ] {a1ca1924-2d39-4e9d-a7a9-726c146f0011} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8f0c970b-a421-4abd-b2da-5fbaf796d1ae) /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.314435 [ 244 ] {a1ca1924-2d39-4e9d-a7a9-726c146f0011} DDLWorker: Executed query: /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.325773 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.432954 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.432964 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.437198 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=17, queue_size=17, entries=query-0000000000..query-0000000016, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000015, last_skipped_entry_name=none 2024.08.27 19:20:07.437282 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000016 2024.08.27 19:20:07.437315 [ 244 ] {} DDLWorker: Checking task query-0000000016 2024.08.27 19:20:07.439053 [ 244 ] {} DDLWorker: Processing task query-0000000016 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.08.27 19:20:07.447301 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:07.447648 [ 244 ] {95d74268-12a9-4c34-b824-87d9c11cdbe5} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 35f235fc-dba9-407f-b58a-0f191ba3745f) /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.08.27 19:20:07.448065 [ 244 ] {95d74268-12a9-4c34-b824-87d9c11cdbe5} DDLWorker: Executed query: /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:07.454471 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.605863 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.605883 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.606316 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=18, queue_size=18, entries=query-0000000000..query-0000000017, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000016, last_skipped_entry_name=none 2024.08.27 19:20:07.606351 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000017 2024.08.27 19:20:07.606361 [ 244 ] {} DDLWorker: Checking task query-0000000017 2024.08.27 19:20:07.607342 [ 244 ] {} DDLWorker: Processing task query-0000000017 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:07.619603 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.619944 [ 244 ] {25a2f02e-4608-461a-9203-e71fbbea5d98} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8) /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.620446 [ 244 ] {25a2f02e-4608-461a-9203-e71fbbea5d98} DDLWorker: Executed query: /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.629360 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.742981 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.743043 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.743415 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=19, queue_size=19, entries=query-0000000000..query-0000000018, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000017, last_skipped_entry_name=none 2024.08.27 19:20:07.743451 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000018 2024.08.27 19:20:07.743459 [ 244 ] {} DDLWorker: Checking task query-0000000018 2024.08.27 19:20:07.747797 [ 244 ] {} DDLWorker: Processing task query-0000000018 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)) 2024.08.27 19:20:07.752586 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.08.27 19:20:07.753915 [ 244 ] {db2e785c-5f1c-4aff-b970-8f0273512e81} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6d401fb3-1fb6-4626-9ac6-8c45c8759efc) /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) 2024.08.27 19:20:07.755420 [ 244 ] {db2e785c-5f1c-4aff-b970-8f0273512e81} DDLWorker: Executed query: /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.08.27 19:20:07.759974 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.902013 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.902038 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.902476 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000018, last_skipped_entry_name=none 2024.08.27 19:20:07.902504 [ 244 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000019 2024.08.27 19:20:07.902512 [ 244 ] {} DDLWorker: Checking task query-0000000019 2024.08.27 19:20:07.906960 [ 244 ] {} DDLWorker: Processing task query-0000000019 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:07.910073 [ 244 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.910644 [ 244 ] {deba4f4d-bd3e-4ef0-a861-1e9937f3ff83} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d848e6a3-a4e5-4966-94fc-a41a0fa3e828) /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.911601 [ 244 ] {deba4f4d-bd3e-4ef0-a861-1e9937f3ff83} DDLWorker: Executed query: /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.917115 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:08.319916 [ 108 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 7385ms 2024.08.27 19:20:09.113720 [ 108 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.08.27 19:20:09.118691 [ 108 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.08.27 19:20:09.118730 [ 108 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:09.125883 [ 241 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetching part all_1_1_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 2024.08.27 19:20:09.129204 [ 241 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.08.27 19:20:09.129434 [ 241 ] {} HTTPSessionAdapter: Created HTTP(S) session with ::1:19403 (::1:19403) 2024.08.27 19:20:09.130730 [ 241 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:09.130830 [ 241 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:09.130845 [ 241 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:09.130875 [ 241 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Downloading part all_1_1_0 onto disk default. 2024.08.27 19:20:09.145205 [ 241 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Download of part all_1_1_0 onto disk default finished. 2024.08.27 19:20:09.145301 [ 241 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:09.145464 [ 241 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Committing part all_1_1_0 to zookeeper 2024.08.27 19:20:09.162426 [ 167 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.08.27 19:20:09.169991 [ 241 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Part all_1_1_0 committed to zookeeper 2024.08.27 19:20:09.170258 [ 241 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetched part all_1_1_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 2024.08.27 19:20:09.170415 [ 108 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71804254208, merge_with_ttl_allowedtrue) 2024.08.27 19:20:09.170694 [ 108 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 10002ms 2024.08.27 19:20:09.184558 [ 167 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.08.27 19:20:09.184606 [ 167 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:09.199084 [ 196 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Fetching part all_1_1_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3 2024.08.27 19:20:09.199791 [ 196 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.08.27 19:20:09.200278 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.08.27 19:20:09.201753 [ 196 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:09.201817 [ 196 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:09.201841 [ 196 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:09.201881 [ 196 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Downloading part all_1_1_0 onto disk default. 2024.08.27 19:20:09.204643 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.08.27 19:20:09.204699 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:09.205211 [ 196 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Download of part all_1_1_0 onto disk default finished. 2024.08.27 19:20:09.205268 [ 196 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:09.205474 [ 196 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Committing part all_1_1_0 to zookeeper 2024.08.27 19:20:09.213860 [ 196 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Part all_1_1_0 committed to zookeeper 2024.08.27 19:20:09.213966 [ 196 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Fetched part all_1_1_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3 2024.08.27 19:20:09.214110 [ 193 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Fetching part all_1_1_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/3 2024.08.27 19:20:09.214175 [ 98 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:09.214212 [ 98 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 9936ms 2024.08.27 19:20:09.220093 [ 193 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.08.27 19:20:09.221447 [ 193 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:09.221511 [ 193 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:09.221530 [ 193 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:09.221561 [ 193 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Downloading part all_1_1_0 onto disk default. 2024.08.27 19:20:09.223577 [ 193 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Download of part all_1_1_0 onto disk default finished. 2024.08.27 19:20:09.223628 [ 193 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:09.223744 [ 193 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Committing part all_1_1_0 to zookeeper 2024.08.27 19:20:09.232357 [ 193 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Part all_1_1_0 committed to zookeeper 2024.08.27 19:20:09.232462 [ 193 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Fetched part all_1_1_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/3 2024.08.27 19:20:09.232586 [ 98 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:09.232614 [ 98 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 9831ms 2024.08.27 19:20:09.325197 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:09.325391 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:09.325424 [ 3 ] {} HTTP-Session: ae209baf-3efa-44ab-8436-23d4434d66de Authenticating user 'default' from [::1]:65512 2024.08.27 19:20:09.325461 [ 3 ] {} HTTP-Session: ae209baf-3efa-44ab-8436-23d4434d66de Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.325472 [ 3 ] {} HTTP-Session: ae209baf-3efa-44ab-8436-23d4434d66de Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.325548 [ 3 ] {} HTTP-Session: ae209baf-3efa-44ab-8436-23d4434d66de Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:09.326248 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} executeQuery: (from [::1]:65512) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:09.327058 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.327657 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.328283 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.329004 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.330122 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.330537 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e6ef840) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:09.330576 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e6ef840) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:09.330832 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e6ef840) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.08.27 19:20:09.331669 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.332664 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.332840 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e6fe920) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:09.332860 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e6fe920) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:09.335059 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.336240 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.336931 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:09.337023 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:09.337392 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.08.27 19:20:09.337502 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.337587 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:09.337727 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e754bb0) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0) 2024.08.27 19:20:09.337744 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e754bb0) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)] 2024.08.27 19:20:09.338586 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.339708 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.340180 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.340631 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:09.340963 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:09.341271 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.08.27 19:20:09.341410 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.341502 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:09.341681 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e77db50) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:09.341701 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e77db50) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:09.341915 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e6fe920) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.08.27 19:20:09.342593 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.343303 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.343783 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:09.343838 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:09.344183 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.08.27 19:20:09.344300 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.344431 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:09.344453 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.344480 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.08.27 19:20:09.344526 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.344570 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.344622 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.344650 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.345271 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:09.345464 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:09.345540 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.345542 [ 260 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.08.27 19:20:09.345595 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:09.345647 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.345912 [ 260 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.345968 [ 260 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:09.345981 [ 260 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.346261 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.08.27 19:20:09.346300 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:09.346611 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.08.27 19:20:09.346660 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Reading approx. 16 rows with 2 streams 2024.08.27 19:20:09.346757 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.346851 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.347079 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:09.347207 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:09.347249 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.08.27 19:20:09.347264 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.347317 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.347332 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.08.27 19:20:09.347356 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.08.27 19:20:09.347407 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.347403 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.347753 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.08.27 19:20:09.347785 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:09.347981 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.08.27 19:20:09.348006 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Reading approx. 32 rows with 2 streams 2024.08.27 19:20:09.348115 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.348207 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.348332 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.08.27 19:20:09.348467 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.348641 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:09.348833 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:09.348873 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.348887 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:09.348900 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.348934 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.08.27 19:20:09.348961 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.348970 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:09.348981 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.349142 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.08.27 19:20:09.349172 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:09.349373 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.08.27 19:20:09.349396 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Reading approx. 32 rows with 2 streams 2024.08.27 19:20:09.349486 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.349576 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.349698 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.349729 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.356791 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} executeQuery: Read 80 rows, 5.78 KiB in 0.031 sec., 2580.6451612903224 rows/sec., 186.49 KiB/sec. 2024.08.27 19:20:09.357148 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e77db50) Join data is being destroyed, 13312 bytes and 16 rows in hash table 2024.08.27 19:20:09.357356 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} HashJoin: (0x1e754bb0) Join data is being destroyed, 12800 bytes and 16 rows in hash table 2024.08.27 19:20:09.358095 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} DynamicQueryHandler: Done processing query 2024.08.27 19:20:09.358125 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} MemoryTracker: Peak memory usage (for query): 5.16 MiB. 2024.08.27 19:20:09.358150 [ 3 ] {} HTTP-Session: ae209baf-3efa-44ab-8436-23d4434d66de Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.360118 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 574, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:09.360225 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:09.360248 [ 3 ] {} HTTP-Session: 32818862-6341-4f6f-9f1d-666b4e25119e Authenticating user 'default' from [::1]:65512 2024.08.27 19:20:09.360285 [ 3 ] {} HTTP-Session: 32818862-6341-4f6f-9f1d-666b4e25119e Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.360296 [ 3 ] {} HTTP-Session: 32818862-6341-4f6f-9f1d-666b4e25119e Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.360366 [ 3 ] {} HTTP-Session: 32818862-6341-4f6f-9f1d-666b4e25119e Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:09.360769 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} executeQuery: (from [::1]:65512) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (627643266003148065,875477573237006945,4866144566314509062,5109363932695672526,5458299684297804759,6133729158133445591,6418373900407287174,7614030865733607559,9495597746874019221,10554623360235070440,15640909565249536871,15773007174814909684,16012973074142820055,16258445060165149256,17045523200003126967,18285850980281983665)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:09.361567 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.08.27 19:20:09.362221 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.08.27 19:20:09.362849 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:09.362898 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (627643266003148065, 875477573237006945, 4866144566314509062, 5109363932695672526, 5458299684297804759, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 10554623360235070440, 15640909565249536871, 15773007174814909684, 16012973074142820055, 16258445060165149256, 17045523200003126967, 18285850980281983665)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:09.363389 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local 2024.08.27 19:20:09.363496 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.363614 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:09.363927 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Key condition: (column 1 in 16-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:09.364090 [ 259 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps 2024.08.27 19:20:09.364178 [ 261 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Used generic exclusion search over index for part all_1_1_0 with 1 steps 2024.08.27 19:20:09.364420 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.08.27 19:20:09.364456 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Spreading ranges among streams with order 2024.08.27 19:20:09.364602 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (627643266003148065, 875477573237006945, 4866144566314509062, 5109363932695672526, 5458299684297804759, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 10554623360235070440, 15640909565249536871, 15773007174814909684, 16012973074142820055, 16258445060165149256, 17045523200003126967, 18285850980281983665))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.364629 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_1_1_0, approx. 400 rows starting from 0 2024.08.27 19:20:09.364732 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (627643266003148065, 875477573237006945, 4866144566314509062, 5109363932695672526, 5458299684297804759, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 10554623360235070440, 15640909565249536871, 15773007174814909684, 16012973074142820055, 16258445060165149256, 17045523200003126967, 18285850980281983665))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.364762 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 2024.08.27 19:20:09.368305 [ 258 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} MergingSortedTransform: Merge sorted 1 blocks, 800 rows in 0.003263082 sec., 245166.99243230786 rows/sec., 9.88 MiB/sec 2024.08.27 19:20:09.370201 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} executeQuery: Read 800 rows, 51.56 KiB in 0.009605 sec., 83289.95314940135 rows/sec., 5.24 MiB/sec. 2024.08.27 19:20:09.371529 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} DynamicQueryHandler: Done processing query 2024.08.27 19:20:09.371571 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} MemoryTracker: Peak memory usage (for query): 4.14 MiB. 2024.08.27 19:20:09.371599 [ 3 ] {} HTTP-Session: 32818862-6341-4f6f-9f1d-666b4e25119e Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:10.464584 [ 5 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51482, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:10.464740 [ 5 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F2&part=all_1_1_0&client_protocol_version=8&compress=false 2024.08.27 19:20:10.464803 [ 5 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Replicated PartsService): Sending part all_1_1_0 2024.08.27 19:20:10.466024 [ 5 ] {} InterserverIOHTTPHandler: Done processing query 2024.08.27 19:20:10.474051 [ 5 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51482, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:10.474154 [ 5 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F2&part=all_1_1_0&client_protocol_version=8&compress=false 2024.08.27 19:20:10.474177 [ 5 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Replicated PartsService): Sending part all_1_1_0 2024.08.27 19:20:10.474991 [ 5 ] {} InterserverIOHTTPHandler: Done processing query 2024.08.27 19:20:10.892185 [ 252 ] {} ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::Exception::Exception, std::allocator > >(int, FormatStringHelperImpl::type, std::type_identity, std::allocator > >::type>, unsigned long&, std::__cxx11::basic_string, std::allocator >&&) @ 0x000000000ac3631e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000ac360fa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::receiveEvent() @ 0x0000000016bafed2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. Coordination::ZooKeeper::receiveThread() @ 0x0000000016baf7d8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. std::_Function_handler::ThreadFromGlobalPoolImpl > const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional >&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector > const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional >&&)::$_1&&)::{lambda()#1}>::_M_invoke(std::_Any_data const&) @ 0x0000000016bb4b98 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. ThreadPoolImpl::worker(std::_List_iterator) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32 9. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 (version 23.8.7.1) 2024.08.27 19:20:10.892300 [ 252 ] {} ZooKeeperClient: Finalizing session 2. finalization_started: false, queue_finished: false, reason: 'Exception in receiveThread' 2024.08.27 19:20:10.892515 [ 252 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:10.892584 [ 252 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:10.892616 [ 252 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:10.892660 [ 252 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:10.892705 [ 252 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:10.892627 [ 173 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:10.892693 [ 75 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:10.892730 [ 175 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:10.892797 [ 173 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/2/is_active since session has been expired 2024.08.27 19:20:10.892810 [ 75 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/2/is_active since session has been expired 2024.08.27 19:20:10.892854 [ 173 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Waiting for threads to finish 2024.08.27 19:20:10.892873 [ 75 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Waiting for threads to finish 2024.08.27 19:20:10.892806 [ 179 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:10.892856 [ 175 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/2/is_active since session has been expired 2024.08.27 19:20:10.892937 [ 175 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Waiting for threads to finish 2024.08.27 19:20:10.892911 [ 252 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 134, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): (version 23.8.7.1) 2024.08.27 19:20:10.892931 [ 179 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/2/is_active since session has been expired 2024.08.27 19:20:10.892994 [ 179 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Waiting for threads to finish 2024.08.27 19:20:10.892649 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:10.893113 [ 167 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/is_active since session has been expired 2024.08.27 19:20:10.893165 [ 167 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Waiting for threads to finish 2024.08.27 19:20:10.893190 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:10.893235 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:10.894008 [ 75 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Threads finished 2024.08.27 19:20:10.894040 [ 75 ] {} Context: Trying to establish a new connection with ZooKeeper 2024.08.27 19:20:10.899241 [ 75 ] {} ZooKeeperClient: Connected to a suboptimal ZooKeeper host ([::1]:19001, index 1). To preserve balance in ZooKeeper usage, this ZooKeeper session will expire in 17613 seconds 2024.08.27 19:20:10.899283 [ 75 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19001 with session_id 8 Poco::Exception. Code: 1000, e.code() = 146, Connection refused: [::1]:19002 (version 23.8.7.1), [::1]:19002 2024.08.27 19:20:10.900129 [ 75 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.08.27 19:20:10.900149 [ 75 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.08.27 19:20:10.900156 [ 75 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.08.27 19:20:10.900168 [ 75 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003 2024.08.27 19:20:10.900187 [ 75 ] {} Context: Establishing a new connection with ZooKeeper took 6 ms 2024.08.27 19:20:10.900197 [ 75 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:10.903819 [ 179 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Threads finished 2024.08.27 19:20:10.903867 [ 179 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:10.904017 [ 175 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Threads finished 2024.08.27 19:20:10.904059 [ 175 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:10.904214 [ 173 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Threads finished 2024.08.27 19:20:10.904249 [ 173 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:10.909381 [ 244 ] {} DDLWorker: Lost ZooKeeper connection, will try to connect again: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000ffe19c6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000016bb6e38 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000016bb14ce in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. Coordination::ZooKeeper::list(std::__cxx11::basic_string, std::allocator > const&, Coordination::ListRequestType, std::function, std::shared_ptr >) @ 0x0000000016bb37d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(std::__cxx11::basic_string, std::allocator > const&, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b76078 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::getChildrenImpl(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b75c75 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::tryGetChildrenWatch(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b7679a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. zkutil::ZooKeeper::tryGetChildren(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000016b762bf in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. zkutil::ZooKeeper::getChildren(std::__cxx11::basic_string, std::allocator > const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000016b7618d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::DDLWorker::scheduleTasks(bool) @ 0x0000000014ebf5c2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. DB::DDLWorker::runMainThread() @ 0x0000000014ebbf2e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::{lambda()#1}::operator()() @ 0x0000000014ecd995 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. ThreadPoolImpl::worker(std::_List_iterator) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32 16. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 (version 23.8.7.1) 2024.08.27 19:20:10.915166 [ 75 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:10.920913 [ 51 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000ffe19c6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000016bb6e38 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000016bb14ce in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. Coordination::ZooKeeper::list(std::__cxx11::basic_string, std::allocator > const&, Coordination::ListRequestType, std::function, std::shared_ptr >) @ 0x0000000016bb37d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(std::__cxx11::basic_string, std::allocator > const&, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b76078 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::getChildrenImpl(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b75c75 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::tryGetChildrenWatch(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b7679a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. zkutil::ZooKeeper::getChildrenWatch(std::__cxx11::basic_string, std::allocator > const&, Coordination::Stat*, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b76660 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr, std::shared_ptr >) @ 0x00000000159cb716 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000001560a701 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000014a568cf in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. DB::BackgroundSchedulePool::threadFunction() @ 0x0000000014a5967e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. std::_Function_handler::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_1>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_1&&)::{lambda()#1}>::_M_invoke(std::_Any_data const&) @ 0x0000000014a59dd8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. ThreadPoolImpl::worker(std::_List_iterator) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 16. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32 17. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 (version 23.8.7.1) 2024.08.27 19:20:10.925377 [ 75 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:10.925430 [ 75 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue 2024.08.27 19:20:10.930036 [ 107 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000ffe19c6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000016bb6e38 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000016bb14ce in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. Coordination::ZooKeeper::get(std::__cxx11::basic_string, std::allocator > const&, std::function, std::shared_ptr >) @ 0x0000000016bb2f2d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::asyncTryGetNoThrow(std::__cxx11::basic_string, std::allocator > const&, std::function) @ 0x0000000016b78d10 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::getImpl(std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator >&, Coordination::Stat*, std::function) @ 0x0000000016b788e1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::tryGetWatch(std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator >&, Coordination::Stat*, std::function, Coordination::Error*) @ 0x0000000016b79266 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. zkutil::ZooKeeper::get(std::__cxx11::basic_string, std::allocator > const&, Coordination::Stat*, std::shared_ptr const&) @ 0x0000000016b78ea0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::ReplicatedMergeTreeQueue::pullLogsToQueue(std::shared_ptr, std::function, DB::ReplicatedMergeTreeQueue::PullLogsReason) @ 0x00000000159c640b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001560a3a5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000014a568cf in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. DB::BackgroundSchedulePool::threadFunction() @ 0x0000000014a5967e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. std::_Function_handler::ThreadFromGlobalPoolImpl, StrongTypedef, char const*)::$_1>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef, StrongTypedef, char const*)::$_1&&)::{lambda()#1}>::_M_invoke(std::_Any_data const&) @ 0x0000000014a59dd8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. ThreadPoolImpl::worker(std::_List_iterator) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 16. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32 17. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 (version 23.8.7.1) 2024.08.27 19:20:10.930715 [ 75 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:10.931086 [ 167 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Threads finished 2024.08.27 19:20:10.931134 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:10.935200 [ 75 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:10.935230 [ 179 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:10.936009 [ 179 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:10.936046 [ 179 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue 2024.08.27 19:20:10.936461 [ 175 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:10.939729 [ 173 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:10.939764 [ 179 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:10.939800 [ 175 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:10.939876 [ 175 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue 2024.08.27 19:20:10.943740 [ 173 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:10.943755 [ 179 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:10.943817 [ 173 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue 2024.08.27 19:20:10.944619 [ 175 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:10.944738 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:10.944798 [ 173 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:10.945075 [ 175 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:10.945170 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:10.945196 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue 2024.08.27 19:20:10.945330 [ 173 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:10.945645 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:10.946193 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:10.946297 [ 75 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:10.946402 [ 51 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:10.946428 [ 51 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 12110ms 2024.08.27 19:20:10.947800 [ 133 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks 2024.08.27 19:20:10.947912 [ 179 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:10.948043 [ 185 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:10.948075 [ 185 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 12179ms 2024.08.27 19:20:10.948439 [ 175 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:10.948668 [ 75 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:10.948877 [ 173 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:10.948897 [ 75 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 10119ms 2024.08.27 19:20:10.948948 [ 102 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 9637ms 2024.08.27 19:20:10.949587 [ 133 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 8198ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:10.950177 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:10.950347 [ 41 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks 2024.08.27 19:20:10.950370 [ 47 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/timeseries_schema_local/blocks 2024.08.27 19:20:10.950316 [ 75 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:10.950534 [ 75 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 12324ms 2024.08.27 19:20:10.950811 [ 175 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 8671ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:10.951287 [ 47 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 7457ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:10.951521 [ 41 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 7884ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:10.951548 [ 173 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks 2024.08.27 19:20:10.952108 [ 173 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 8496ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:10.955879 [ 173 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:20:10.955922 [ 173 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:20:11.001098 [ 246 ] {} AsynchronousMetrics: MemoryTracking: was 123.82 MiB, peak 129.88 MiB, free memory in arenas 0.00 B, will set to 129.93 MiB (RSS), difference: 6.11 MiB 2024.08.27 19:20:11.771641 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000002 - log-0000000002 2024.08.27 19:20:11.776530 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_2_2_0] 2024.08.27 19:20:11.776579 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:11.778647 [ 239 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetching part all_2_2_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 2024.08.27 19:20:11.779366 [ 239 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_2_2_0&client_protocol_version=8&compress=false 2024.08.27 19:20:11.786434 [ 239 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:11.786495 [ 239 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:11.786508 [ 239 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:11.786535 [ 239 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Downloading part all_2_2_0 onto disk default. 2024.08.27 19:20:11.788564 [ 239 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Download of part all_2_2_0 onto disk default finished. 2024.08.27 19:20:11.788605 [ 239 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Renaming temporary part tmp-fetch_all_2_2_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:11.788712 [ 239 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Committing part all_2_2_0 to zookeeper 2024.08.27 19:20:11.797067 [ 239 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Part all_2_2_0 committed to zookeeper 2024.08.27 19:20:11.797179 [ 239 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetched part all_2_2_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3 2024.08.27 19:20:11.797281 [ 107 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:11.797315 [ 107 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 14827ms 2024.08.27 19:20:11.909592 [ 244 ] {} DDLWorker: Initializing DDLWorker thread 2024.08.27 19:20:11.913538 [ 244 ] {} DDLWorker: Initialized DDLWorker thread 2024.08.27 19:20:11.913607 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:11.913621 [ 244 ] {} DDLWorker: Have 1 unfinished tasks, will check them 2024.08.27 19:20:11.913645 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:11.914200 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000019, last_skipped_entry_name=none 2024.08.27 19:20:11.914235 [ 244 ] {} DDLWorker: No tasks to schedule 2024.08.27 19:20:11.914245 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:12.083921 [ 247 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.08.27 19:20:12.085744 [ 247 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.08.27 19:20:12.086828 [ 247 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.08.27 19:20:12.095852 [ 245 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml' 2024.08.27 19:20:12.097008 [ 245 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration 2024.08.27 19:20:12.097621 [ 245 ] {} Application: Setting max_server_memory_usage was set to 28.79 GiB (31.99 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.08.27 19:20:12.097635 [ 245 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 16.00 GiB (31.99 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.08.27 19:20:12.097647 [ 245 ] {} Application: Merges and mutations memory limit is set to 16.00 GiB 2024.08.27 19:20:12.098002 [ 245 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor 2024.08.27 19:20:12.098021 [ 245 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor 2024.08.27 19:20:12.098031 [ 245 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor 2024.08.27 19:20:12.098040 [ 245 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor 2024.08.27 19:20:12.098074 [ 245 ] {} ZooKeeperClient: Finalizing session 8. finalization_started: false, queue_finished: false, reason: 'Config changed' 2024.08.27 19:20:12.098217 [ 245 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:12.098268 [ 245 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:12.098296 [ 245 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:12.098307 [ 107 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:12.098351 [ 245 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:12.098331 [ 41 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:12.098412 [ 245 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:12.098402 [ 107 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/2/is_active since session has been expired 2024.08.27 19:20:12.098437 [ 41 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/is_active since session has been expired 2024.08.27 19:20:12.098445 [ 107 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Waiting for threads to finish 2024.08.27 19:20:12.098390 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:12.098465 [ 41 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Waiting for threads to finish 2024.08.27 19:20:12.098516 [ 173 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/2/is_active since session has been expired 2024.08.27 19:20:12.098492 [ 172 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:12.098550 [ 173 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Waiting for threads to finish 2024.08.27 19:20:12.098581 [ 172 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/2/is_active since session has been expired 2024.08.27 19:20:12.098610 [ 172 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Waiting for threads to finish 2024.08.27 19:20:12.098604 [ 47 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:12.098673 [ 47 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/2/is_active since session has been expired 2024.08.27 19:20:12.098682 [ 47 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Waiting for threads to finish 2024.08.27 19:20:12.098810 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:12.098838 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:12.099136 [ 244 ] {} DDLWorker: Lost ZooKeeper connection, will try to connect again: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000ffe19c6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000016bb6e38 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000016bb14ce in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. Coordination::ZooKeeper::list(std::__cxx11::basic_string, std::allocator > const&, Coordination::ListRequestType, std::function, std::shared_ptr >) @ 0x0000000016bb37d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(std::__cxx11::basic_string, std::allocator > const&, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b76078 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::getChildrenImpl(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b75c75 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::tryGetChildrenWatch(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b7679a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. zkutil::ZooKeeper::tryGetChildren(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000016b762bf in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. zkutil::ZooKeeper::getChildren(std::__cxx11::basic_string, std::allocator > const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000016b7618d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::DDLWorker::scheduleTasks(bool) @ 0x0000000014ebf5c2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. DB::DDLWorker::runMainThread() @ 0x0000000014ebbf2e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::{lambda()#1}::operator()() @ 0x0000000014ecd995 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. ThreadPoolImpl::worker(std::_List_iterator) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32 16. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 (version 23.8.7.1) 2024.08.27 19:20:12.099207 [ 107 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Threads finished 2024.08.27 19:20:12.099704 [ 47 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Threads finished 2024.08.27 19:20:12.099991 [ 172 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Threads finished 2024.08.27 19:20:12.100730 [ 173 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Threads finished 2024.08.27 19:20:12.101237 [ 41 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Threads finished 2024.08.27 19:20:12.104082 [ 245 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19003 with session_id 11 2024.08.27 19:20:12.104459 [ 245 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.08.27 19:20:12.104480 [ 245 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.08.27 19:20:12.104490 [ 245 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.08.27 19:20:12.104500 [ 245 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19003 2024.08.27 19:20:12.104573 [ 41 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:12.104614 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:12.104645 [ 172 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:12.104696 [ 47 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:12.104731 [ 245 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.08.27 19:20:12.104743 [ 107 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:12.104766 [ 245 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.08.27 19:20:12.105153 [ 245 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.08.27 19:20:12.105195 [ 245 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration 2024.08.27 19:20:12.114282 [ 41 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:12.114319 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:12.114383 [ 172 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:12.114395 [ 47 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:12.114612 [ 107 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:12.114645 [ 41 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:12.114683 [ 41 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue 2024.08.27 19:20:12.114705 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:12.114745 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue 2024.08.27 19:20:12.114764 [ 172 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:12.114814 [ 47 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:12.114826 [ 172 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue 2024.08.27 19:20:12.114846 [ 47 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue 2024.08.27 19:20:12.115201 [ 107 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:12.115205 [ 41 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:12.115221 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:12.115258 [ 172 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:12.115257 [ 107 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue 2024.08.27 19:20:12.115333 [ 47 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:12.115612 [ 41 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:12.115719 [ 107 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:12.115866 [ 172 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:12.115895 [ 47 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:12.115988 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:12.116126 [ 107 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:12.118436 [ 172 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:12.118464 [ 47 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:12.118771 [ 65 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:12.118886 [ 65 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 15526ms 2024.08.27 19:20:12.119579 [ 41 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:12.119713 [ 73 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:12.119712 [ 110 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:12.119794 [ 110 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 15055ms 2024.08.27 19:20:12.119740 [ 73 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 13241ms 2024.08.27 19:20:12.120303 [ 107 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:12.120346 [ 173 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:12.120475 [ 61 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 11695ms 2024.08.27 19:20:12.120657 [ 41 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:12.120742 [ 41 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 19454ms 2024.08.27 19:20:12.121787 [ 47 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1170ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:12.121809 [ 167 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1169ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:12.121877 [ 106 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1170ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:12.122198 [ 158 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks 2024.08.27 19:20:12.122420 [ 107 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1172ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:12.122993 [ 158 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1174ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:12.524214 [ 5 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51482, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:12.524351 [ 5 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F2&part=all_2_2_0&client_protocol_version=8&compress=false 2024.08.27 19:20:12.524378 [ 5 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Replicated PartsService): Sending part all_2_2_0 2024.08.27 19:20:12.525179 [ 5 ] {} InterserverIOHTTPHandler: Done processing query 2024.08.27 19:20:13.000495 [ 246 ] {} AsynchronousMetrics: MemoryTracking: was 136.43 MiB, peak 137.43 MiB, free memory in arenas 0.00 B, will set to 129.98 MiB (RSS), difference: -6.45 MiB 2024.08.27 19:20:13.099358 [ 244 ] {} DDLWorker: Initializing DDLWorker thread 2024.08.27 19:20:13.710838 [ 244 ] {} DDLWorker: Initialized DDLWorker thread 2024.08.27 19:20:13.710893 [ 244 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:13.710907 [ 244 ] {} DDLWorker: Have 1 unfinished tasks, will check them 2024.08.27 19:20:13.710927 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:13.711441 [ 244 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000019, last_skipped_entry_name=none 2024.08.27 19:20:13.711471 [ 244 ] {} DDLWorker: No tasks to schedule 2024.08.27 19:20:13.711482 [ 244 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:14.000415 [ 246 ] {} AsynchronousMetrics: MemoryTracking: was 125.97 MiB, peak 137.43 MiB, free memory in arenas 0.00 B, will set to 129.98 MiB (RSS), difference: 4.00 MiB 2024.08.27 19:20:23.815774 [ 75 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 14212ms 2024.08.27 19:20:25.361128 [ 106 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803183104, merge_with_ttl_allowedtrue) 2024.08.27 19:20:25.361224 [ 106 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 17143ms 2024.08.27 19:20:25.956108 [ 106 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:20:25.956197 [ 106 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:20:27.175030 [ 133 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803183104, merge_with_ttl_allowedtrue) 2024.08.27 19:20:27.175067 [ 133 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 18308ms 2024.08.27 19:20:27.645179 [ 133 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803183104, merge_with_ttl_allowedtrue) 2024.08.27 19:20:27.645217 [ 133 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 20460ms 2024.08.27 19:20:31.575101 [ 106 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803604992, merge_with_ttl_allowedtrue) 2024.08.27 19:20:31.575229 [ 106 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 25536ms 2024.08.27 19:20:38.028226 [ 167 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 18109ms 2024.08.27 19:20:40.956554 [ 73 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:20:40.956727 [ 73 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:20:42.504475 [ 172 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71801022464, merge_with_ttl_allowedtrue) 2024.08.27 19:20:42.504531 [ 172 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 22351ms 2024.08.27 19:20:45.483344 [ 172 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71799371776, merge_with_ttl_allowedtrue) 2024.08.27 19:20:45.483409 [ 172 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 23778ms 2024.08.27 19:20:48.105478 [ 73 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71799371776, merge_with_ttl_allowedtrue) 2024.08.27 19:20:48.105518 [ 73 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 25827ms 2024.08.27 19:20:55.956930 [ 61 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:20:55.957129 [ 61 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:20:56.137776 [ 61 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 23408ms 2024.08.27 19:20:57.111758 [ 61 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814950912, merge_with_ttl_allowedtrue) 2024.08.27 19:20:57.111858 [ 61 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 32136ms 2024.08.27 19:21:04.855879 [ 41 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71813126144, merge_with_ttl_allowedtrue) 2024.08.27 19:21:04.855991 [ 41 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 29492ms 2024.08.27 19:21:09.261702 [ 41 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71811354624, merge_with_ttl_allowedtrue) 2024.08.27 19:21:09.261798 [ 41 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 30041ms 2024.08.27 19:21:10.957721 [ 156 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:21:10.957891 [ 156 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:21:13.932753 [ 156 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71811354624, merge_with_ttl_allowedtrue) 2024.08.27 19:21:13.932836 [ 156 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 33485ms 2024.08.27 19:21:19.546094 [ 110 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 28517ms 2024.08.27 19:21:25.958069 [ 156 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:21:25.958225 [ 156 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:21:29.248220 [ 31 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814907904, merge_with_ttl_allowedtrue) 2024.08.27 19:21:29.248324 [ 31 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 39612ms 2024.08.27 19:21:34.348247 [ 31 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814109184, merge_with_ttl_allowedtrue) 2024.08.27 19:21:34.348308 [ 31 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 37353ms 2024.08.27 19:21:39.302998 [ 31 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71812505600, merge_with_ttl_allowedtrue) 2024.08.27 19:21:39.303048 [ 31 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 37519ms 2024.08.27 19:21:40.958477 [ 31 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:21:40.958596 [ 31 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:21:47.418171 [ 141 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71811112960, merge_with_ttl_allowedtrue) 2024.08.27 19:21:47.418263 [ 141 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 43628ms 2024.08.27 19:21:48.063354 [ 141 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 35400ms 2024.08.27 19:21:55.958762 [ 152 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:21:55.958853 [ 152 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:21:57.001180 [ 246 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000394289 sec. 2024.08.27 19:22:08.860687 [ 152 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71805247488, merge_with_ttl_allowedtrue) 2024.08.27 19:22:08.860790 [ 152 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 50074ms 2024.08.27 19:22:10.959029 [ 152 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:22:10.959117 [ 152 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:22:11.701618 [ 152 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71804381184, merge_with_ttl_allowedtrue) 2024.08.27 19:22:11.701704 [ 152 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 47814ms 2024.08.27 19:22:16.822450 [ 160 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71802933248, merge_with_ttl_allowedtrue) 2024.08.27 19:22:16.822564 [ 160 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 47882ms 2024.08.27 19:22:23.463695 [ 162 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 45272ms 2024.08.27 19:22:25.959242 [ 162 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:22:25.959318 [ 162 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:22:31.046600 [ 162 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71798589440, merge_with_ttl_allowedtrue) 2024.08.27 19:22:31.046703 [ 162 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 52385ms 2024.08.27 19:22:40.959439 [ 162 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:22:40.959519 [ 162 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:22:55.959648 [ 91 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:22:55.959739 [ 91 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:22:58.935081 [ 99 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71791093760, merge_with_ttl_allowedtrue) 2024.08.27 19:22:58.935130 [ 99 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:22:59.515958 [ 99 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71790032896, merge_with_ttl_allowedtrue) 2024.08.27 19:22:59.516130 [ 99 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 58845ms 2024.08.27 19:23:04.704854 [ 91 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71788423168, merge_with_ttl_allowedtrue) 2024.08.27 19:23:04.704924 [ 91 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:23:08.735996 [ 118 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 56952ms 2024.08.27 19:23:10.959907 [ 118 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:23:10.959994 [ 118 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:23:23.432132 [ 112 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71784536064, merge_with_ttl_allowedtrue) 2024.08.27 19:23:23.432236 [ 112 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:23:25.960237 [ 112 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:23:25.960411 [ 112 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:23:40.960575 [ 112 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:23:40.960706 [ 112 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:23:55.960858 [ 39 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:23:55.961068 [ 39 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:23:57.001273 [ 246 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000413258 sec. 2024.08.27 19:23:58.361486 [ 39 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71774910464, merge_with_ttl_allowedtrue) 2024.08.27 19:23:58.361552 [ 39 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:23:58.935356 [ 39 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71774910464, merge_with_ttl_allowedtrue) 2024.08.27 19:23:58.935398 [ 39 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:24:04.705193 [ 39 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71772272640, merge_with_ttl_allowedtrue) 2024.08.27 19:24:04.705262 [ 39 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:24:05.688342 [ 43 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:24:10.961205 [ 43 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:24:10.961324 [ 43 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:24:23.432542 [ 49 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71768123392, merge_with_ttl_allowedtrue) 2024.08.27 19:24:23.432659 [ 49 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:24:25.961573 [ 49 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:24:25.961724 [ 49 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:24:40.961952 [ 55 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:24:40.962108 [ 55 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:24:55.962318 [ 49 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:24:55.962458 [ 49 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:24:58.361913 [ 100 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71759237120, merge_with_ttl_allowedtrue) 2024.08.27 19:24:58.362012 [ 100 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:24:58.935674 [ 100 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71759237120, merge_with_ttl_allowedtrue) 2024.08.27 19:24:58.935734 [ 100 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:25:04.705528 [ 103 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71756374016, merge_with_ttl_allowedtrue) 2024.08.27 19:25:04.705592 [ 103 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:25:05.688719 [ 103 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:25:10.962633 [ 103 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:25:10.962713 [ 103 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:25:12.873869 [ 109 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 300752ms, ratio: 0, points per minute: 0) 2024.08.27 19:25:13.705624 [ 109 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301584ms, ratio: 0, points per minute: 0) 2024.08.27 19:25:13.972146 [ 109 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301851ms, ratio: 0, points per minute: 0) 2024.08.27 19:25:16.159341 [ 109 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304036ms, ratio: 0, points per minute: 0) 2024.08.27 19:25:18.785284 [ 103 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 306663ms, ratio: 0, points per minute: 0) 2024.08.27 19:25:23.432879 [ 103 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71752450048, merge_with_ttl_allowedtrue) 2024.08.27 19:25:23.432953 [ 103 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:25:25.962899 [ 103 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:25:25.962977 [ 103 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:25:40.963142 [ 116 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:25:40.963258 [ 116 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:25:55.963408 [ 104 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:25:55.963519 [ 104 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:25:57.001335 [ 246 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000601654 sec. 2024.08.27 19:25:58.362285 [ 124 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71742001152, merge_with_ttl_allowedtrue) 2024.08.27 19:25:58.362345 [ 124 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:25:58.935998 [ 124 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71742001152, merge_with_ttl_allowedtrue) 2024.08.27 19:25:58.936053 [ 124 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:26:04.705839 [ 104 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71739009024, merge_with_ttl_allowedtrue) 2024.08.27 19:26:04.705903 [ 104 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:26:05.689003 [ 124 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:26:10.963701 [ 128 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:26:10.963811 [ 128 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:26:23.433297 [ 135 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71734446080, merge_with_ttl_allowedtrue) 2024.08.27 19:26:23.433399 [ 135 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:26:25.964067 [ 124 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:26:25.964205 [ 124 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:26:40.964325 [ 124 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:26:40.964393 [ 124 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:26:55.964547 [ 29 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:26:55.964648 [ 29 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:26:58.362570 [ 29 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71722999808, merge_with_ttl_allowedtrue) 2024.08.27 19:26:58.362651 [ 29 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:26:58.936378 [ 29 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71722999808, merge_with_ttl_allowedtrue) 2024.08.27 19:26:58.936457 [ 29 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:27:04.706230 [ 148 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71719892992, merge_with_ttl_allowedtrue) 2024.08.27 19:27:04.706311 [ 148 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:27:05.689342 [ 148 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:27:10.964814 [ 144 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:27:10.964960 [ 144 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:27:23.433658 [ 148 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71715762176, merge_with_ttl_allowedtrue) 2024.08.27 19:27:23.433715 [ 148 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:27:25.965139 [ 148 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:27:25.965223 [ 148 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:27:40.965419 [ 59 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:27:40.965529 [ 59 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:27:55.965675 [ 148 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:27:55.965945 [ 148 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:27:57.000930 [ 246 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000347556 sec. 2024.08.27 19:27:58.362920 [ 148 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71703603200, merge_with_ttl_allowedtrue) 2024.08.27 19:27:58.362957 [ 148 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:27:58.936706 [ 148 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71703603200, merge_with_ttl_allowedtrue) 2024.08.27 19:27:58.936753 [ 148 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:28:04.706838 [ 35 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71798714368, merge_with_ttl_allowedtrue) 2024.08.27 19:28:04.706939 [ 35 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:28:05.689824 [ 35 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:28:10.966464 [ 35 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:28:10.966628 [ 35 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:28:23.434297 [ 142 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814303744, merge_with_ttl_allowedtrue) 2024.08.27 19:28:23.434401 [ 142 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:28:25.966872 [ 142 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:28:25.967017 [ 142 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:28:40.967445 [ 149 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:28:40.967629 [ 149 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:28:55.967879 [ 149 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:28:55.968016 [ 149 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:28:58.363502 [ 149 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814299648, merge_with_ttl_allowedtrue) 2024.08.27 19:28:58.363584 [ 149 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:28:58.937305 [ 149 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814299648, merge_with_ttl_allowedtrue) 2024.08.27 19:28:58.937389 [ 149 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:29:04.707489 [ 37 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814318080, merge_with_ttl_allowedtrue) 2024.08.27 19:29:04.707597 [ 37 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:29:05.690489 [ 37 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:29:10.968440 [ 37 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:29:10.968597 [ 37 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:29:23.435036 [ 63 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814498304, merge_with_ttl_allowedtrue) 2024.08.27 19:29:23.435168 [ 63 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:29:25.968876 [ 63 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:29:25.969050 [ 63 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:29:40.969520 [ 63 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:29:40.969671 [ 63 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:29:55.969899 [ 63 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:29:55.970037 [ 63 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:29:57.001459 [ 246 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000598719 sec. 2024.08.27 19:29:58.363909 [ 63 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814330368, merge_with_ttl_allowedtrue) 2024.08.27 19:29:58.363988 [ 63 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:29:58.937974 [ 63 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814330368, merge_with_ttl_allowedtrue) 2024.08.27 19:29:58.938064 [ 63 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:30:04.708179 [ 79 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814522880, merge_with_ttl_allowedtrue) 2024.08.27 19:30:04.708276 [ 79 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:30:05.691103 [ 79 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:30:10.970274 [ 79 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:30:10.970411 [ 79 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:30:15.504519 [ 79 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 302631ms, ratio: 0, points per minute: 0) 2024.08.27 19:30:16.684124 [ 79 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 302712ms, ratio: 0, points per minute: 0) 2024.08.27 19:30:21.863110 [ 143 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 308158ms, ratio: 0, points per minute: 0) 2024.08.27 19:30:23.435769 [ 81 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814518784, merge_with_ttl_allowedtrue) 2024.08.27 19:30:23.435851 [ 81 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:30:23.591397 [ 81 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304806ms, ratio: 0, points per minute: 0) 2024.08.27 19:30:25.618636 [ 81 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309459ms, ratio: 0, points per minute: 0) 2024.08.27 19:30:25.970844 [ 81 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:30:25.970996 [ 81 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:30:40.971231 [ 170 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:30:40.971401 [ 170 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:30:55.971816 [ 174 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:30:55.972002 [ 174 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:30:58.364521 [ 81 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814565888, merge_with_ttl_allowedtrue) 2024.08.27 19:30:58.364602 [ 81 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:30:58.938420 [ 81 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814565888, merge_with_ttl_allowedtrue) 2024.08.27 19:30:58.938516 [ 81 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:31:04.708870 [ 33 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814588416, merge_with_ttl_allowedtrue) 2024.08.27 19:31:04.708968 [ 33 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:31:05.691726 [ 33 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:31:10.972424 [ 81 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:31:10.972571 [ 81 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:31:23.436468 [ 182 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814604800, merge_with_ttl_allowedtrue) 2024.08.27 19:31:23.436599 [ 182 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:31:25.972808 [ 182 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:31:25.972939 [ 182 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:31:40.973392 [ 182 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:31:40.973528 [ 182 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:31:55.973751 [ 155 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:31:55.973918 [ 155 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:31:57.001328 [ 246 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000492135 sec. 2024.08.27 19:31:58.364898 [ 155 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814668288, merge_with_ttl_allowedtrue) 2024.08.27 19:31:58.364995 [ 155 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:31:58.938890 [ 155 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814668288, merge_with_ttl_allowedtrue) 2024.08.27 19:31:58.938979 [ 155 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:32:04.709551 [ 155 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814668288, merge_with_ttl_allowedtrue) 2024.08.27 19:32:04.709664 [ 155 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:32:05.692232 [ 155 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:32:10.974316 [ 155 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:32:10.974458 [ 155 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:32:23.436988 [ 95 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814686720, merge_with_ttl_allowedtrue) 2024.08.27 19:32:23.437102 [ 95 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:32:25.974923 [ 95 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:32:25.975054 [ 95 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:32:40.975313 [ 96 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:32:40.975495 [ 96 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:32:55.975687 [ 139 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:32:55.975851 [ 139 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:32:58.365346 [ 84 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815532544, merge_with_ttl_allowedtrue) 2024.08.27 19:32:58.365429 [ 84 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:32:58.939513 [ 139 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815532544, merge_with_ttl_allowedtrue) 2024.08.27 19:32:58.939595 [ 139 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:33:04.710019 [ 139 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815194624, merge_with_ttl_allowedtrue) 2024.08.27 19:33:04.710120 [ 139 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:33:05.692799 [ 139 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:33:10.976350 [ 171 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:33:10.976557 [ 171 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:33:23.437529 [ 105 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815526400, merge_with_ttl_allowedtrue) 2024.08.27 19:33:23.437635 [ 105 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:33:25.977024 [ 105 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:33:25.977185 [ 105 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:33:40.977619 [ 139 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:33:40.977768 [ 139 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:33:55.978263 [ 159 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:33:55.978435 [ 159 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:33:57.001174 [ 246 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000373137 sec. 2024.08.27 19:33:58.365959 [ 139 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815929856, merge_with_ttl_allowedtrue) 2024.08.27 19:33:58.366041 [ 139 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:33:58.940261 [ 139 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815929856, merge_with_ttl_allowedtrue) 2024.08.27 19:33:58.940353 [ 139 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:34:04.710485 [ 163 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815909376, merge_with_ttl_allowedtrue) 2024.08.27 19:34:04.710589 [ 163 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:34:05.693417 [ 163 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:34:10.978713 [ 159 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:34:10.978887 [ 159 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:34:23.438223 [ 161 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815915520, merge_with_ttl_allowedtrue) 2024.08.27 19:34:23.438320 [ 161 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:34:25.979116 [ 161 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:34:25.979251 [ 161 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:34:40.979502 [ 136 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:34:40.979676 [ 136 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:34:55.980137 [ 134 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:34:55.980309 [ 134 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:34:58.366318 [ 161 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815763968, merge_with_ttl_allowedtrue) 2024.08.27 19:34:58.366394 [ 161 ] {} oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms 2024.08.27 19:34:58.940645 [ 161 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815763968, merge_with_ttl_allowedtrue) 2024.08.27 19:34:58.940729 [ 161 ] {} oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms 2024.08.27 19:35:04.711149 [ 134 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816062976, merge_with_ttl_allowedtrue) 2024.08.27 19:35:04.711262 [ 134 ] {} oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms 2024.08.27 19:35:05.694006 [ 134 ] {} oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:35:10.980714 [ 134 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:35:10.980847 [ 134 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:35:20.133476 [ 134 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304629ms, ratio: 0, points per minute: 0) 2024.08.27 19:35:21.387457 [ 134 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304703ms, ratio: 0, points per minute: 0) 2024.08.27 19:35:23.438855 [ 127 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816249344, merge_with_ttl_allowedtrue) 2024.08.27 19:35:23.438923 [ 127 ] {} oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms 2024.08.27 19:35:23.990333 [ 127 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 302127ms, ratio: 0, points per minute: 0)