Max level shown:
1 2024.08.27 19:19:55.389892 [ 1 ] {} <Information> Application: Forked a child process to watch
2 2024.08.27 19:19:55.401412 [ 1 ] {} <Information> Application: Will watch for the process with pid 21032
3 2024.08.27 19:19:55.644032 [ 1 ] {} <Information> Application: Starting ClickHouse 23.8.7.1 (revision: 54477, git hash: b6a391579f09dde47a1aa5602e154e7fcde80d1e, build id: <unknown>), PID 21032
4 2024.08.27 19:19:55.644550 [ 1 ] {} <Information> Application: starting up
5 2024.08.27 19:19:55.644725 [ 1 ] {} <Information> Application: OS name: SunOS, version: 5.11, architecture: i86pc
6 2024.08.27 19:19:55.695624 [ 1 ] {} <Information> Application: Available RAM: 31.99 GiB; physical cores: 8; logical cores: 8.
7 2024.08.27 19:19:55.706533 [ 1 ] {} <Debug> Application: rlimit on number of file descriptors is 65536
8 2024.08.27 19:19:55.706682 [ 1 ] {} <Debug> Application: Initializing DateLUT.
9 2024.08.27 19:19:55.706797 [ 1 ] {} <Trace> Application: Initialized DateLUT with time zone 'UTC'.
10 2024.08.27 19:19:55.706962 [ 1 ] {} <Debug> Context: Setting up /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/data/tmp/ to store temporary data in it
11 2024.08.27 19:19:55.707665 [ 1 ] {} <Debug> Application: Initializing interserver credentials.
12 2024.08.27 19:19:55.708990 [ 1 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml'
13 2024.08.27 19:19:55.710372 [ 1 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration
14 2024.08.27 19:19:55.711002 [ 1 ] {} <Information> Application: Setting max_server_memory_usage was set to 28.79 GiB (31.99 GiB available * 0.90 max_server_memory_usage_to_ram_ratio)
15 2024.08.27 19:19:55.711017 [ 1 ] {} <Information> Application: Setting merges_mutations_memory_usage_soft_limit was set to 16.00 GiB (31.99 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio)
16 2024.08.27 19:19:55.711029 [ 1 ] {} <Information> Application: Merges and mutations memory limit is set to 16.00 GiB
17 2024.08.27 19:19:55.721969 [ 1 ] {} <Information> BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads
18 2024.08.27 19:19:55.723537 [ 1 ] {} <Information> BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads
19 2024.08.27 19:19:55.739012 [ 1 ] {} <Information> BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads
20 2024.08.27 19:19:55.739898 [ 1 ] {} <Information> BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads
21 2024.08.27 19:19:55.740864 [ 1 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again.
22 2024.08.27 19:19:55.740942 [ 1 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration
23 2024.08.27 19:19:55.741752 [ 1 ] {} <Information> Application: Listening for replica communication (interserver): http://[::1]:19402
24 2024.08.27 19:19:55.762793 [ 1 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml'
25 2024.08.27 19:19:55.765431 [ 1 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration
26 2024.08.27 19:19:55.787803 [ 1 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration
27 2024.08.27 19:19:55.789235 [ 1 ] {} <Debug> Access(user directories): Added users_xml access storage 'users_xml', path: /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml
28 2024.08.27 19:19:55.948453 [ 1 ] {} <Information> Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin
29 2024.08.27 19:19:55.949996 [ 1 ] {} <Information> Context: Initialized background executor for move operations with num_threads=8, num_tasks=8
30 2024.08.27 19:19:55.950563 [ 1 ] {} <Information> Context: Initialized background executor for fetches with num_threads=8, num_tasks=8
31 2024.08.27 19:19:55.951064 [ 1 ] {} <Information> Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8
32 2024.08.27 19:19:55.952294 [ 1 ] {} <Information> DNSCacheUpdater: Update period 15 seconds
33 2024.08.27 19:19:55.952323 [ 1 ] {} <Information> Application: Loading metadata from /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/data/
34 2024.08.27 19:19:55.955510 [ 57 ] {} <Debug> DNSResolver: Updating DNS cache
35 2024.08.27 19:19:55.955585 [ 57 ] {} <Debug> DNSResolver: Updated DNS cache
36 2024.08.27 19:19:55.971767 [ 1 ] {} <Information> DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total.
37 2024.08.27 19:19:55.971828 [ 1 ] {} <Information> TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.000351614 sec
38 2024.08.27 19:19:55.971902 [ 1 ] {} <Trace> ReferentialDeps: No tables
39 2024.08.27 19:19:55.971917 [ 1 ] {} <Trace> LoadingDeps: No tables
40 2024.08.27 19:19:55.972057 [ 1 ] {} <Information> DatabaseAtomic (system): Starting up tables.
41 2024.08.27 19:19:55.972146 [ 1 ] {} <Debug> SystemLog: Not creating system.query_log since corresponding section 'query_log' is missing from config
42 2024.08.27 19:19:55.972159 [ 1 ] {} <Debug> SystemLog: Not creating system.query_thread_log since corresponding section 'query_thread_log' is missing from config
43 2024.08.27 19:19:55.972199 [ 1 ] {} <Debug> SystemLog: Not creating system.part_log since corresponding section 'part_log' is missing from config
44 2024.08.27 19:19:55.972208 [ 1 ] {} <Debug> SystemLog: Not creating system.trace_log since corresponding section 'trace_log' is missing from config
45 2024.08.27 19:19:55.972217 [ 1 ] {} <Debug> SystemLog: Not creating system.crash_log since corresponding section 'crash_log' is missing from config
46 2024.08.27 19:19:55.972251 [ 1 ] {} <Debug> SystemLog: Not creating system.text_log since corresponding section 'text_log' is missing from config
47 2024.08.27 19:19:55.972265 [ 1 ] {} <Debug> SystemLog: Not creating system.metric_log since corresponding section 'metric_log' is missing from config
48 2024.08.27 19:19:55.972275 [ 1 ] {} <Debug> SystemLog: Not creating system.filesystem_cache_log since corresponding section 'filesystem_cache_log' is missing from config
49 2024.08.27 19:19:55.972308 [ 1 ] {} <Debug> SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config
50 2024.08.27 19:19:55.972323 [ 1 ] {} <Debug> SystemLog: Not creating system.asynchronous_metric_log since corresponding section 'asynchronous_metric_log' is missing from config
51 2024.08.27 19:19:55.972332 [ 1 ] {} <Debug> SystemLog: Not creating system.opentelemetry_span_log since corresponding section 'opentelemetry_span_log' is missing from config
52 2024.08.27 19:19:55.972341 [ 1 ] {} <Debug> SystemLog: Not creating system.query_views_log since corresponding section 'query_views_log' is missing from config
53 2024.08.27 19:19:55.972367 [ 1 ] {} <Debug> SystemLog: Not creating system.zookeeper_log since corresponding section 'zookeeper_log' is missing from config
54 2024.08.27 19:19:55.972376 [ 1 ] {} <Debug> SystemLog: Not creating system.session_log since corresponding section 'session_log' is missing from config
55 2024.08.27 19:19:55.972409 [ 1 ] {} <Debug> SystemLog: Not creating system.transactions_info_log since corresponding section 'transactions_info_log' is missing from config
56 2024.08.27 19:19:55.972424 [ 1 ] {} <Debug> SystemLog: Not creating system.processors_profile_log since corresponding section 'processors_profile_log' is missing from config
57 2024.08.27 19:19:55.972433 [ 1 ] {} <Debug> SystemLog: Not creating system.asynchronous_insert_log since corresponding section 'asynchronous_insert_log' is missing from config
58 2024.08.27 19:19:56.028399 [ 1 ] {} <Information> DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal.
59 2024.08.27 19:19:56.054298 [ 1 ] {} <Information> DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total.
60 2024.08.27 19:19:56.054337 [ 1 ] {} <Information> TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.000134018 sec
61 2024.08.27 19:19:56.054348 [ 1 ] {} <Trace> ReferentialDeps: No tables
62 2024.08.27 19:19:56.054356 [ 1 ] {} <Trace> LoadingDeps: No tables
63 2024.08.27 19:19:56.054396 [ 1 ] {} <Information> DatabaseAtomic (default): Starting up tables.
64 2024.08.27 19:19:56.054958 [ 1 ] {} <Information> UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/data/user_defined/
65 2024.08.27 19:19:56.055055 [ 1 ] {} <Debug> UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded
66 2024.08.27 19:19:56.055069 [ 1 ] {} <Debug> Application: Loaded metadata.
67 2024.08.27 19:19:56.055088 [ 1 ] {} <Information> Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe).
68 2024.08.27 19:19:56.055097 [ 1 ] {} <Information> Application: TaskStats is not implemented for this OS. IO accounting will be disabled.
69 2024.08.27 19:19:56.055320 [ 1 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again.
70 2024.08.27 19:19:56.055642 [ 1 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 9.99 MiB, peak 16.18 MiB, free memory in arenas 0.00 B, will set to 98.03 MiB (RSS), difference: 88.04 MiB
71 2024.08.27 19:19:56.056344 [ 1 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000110271 sec.
72 2024.08.27 19:19:56.057188 [ 1 ] {} <Information> Application: Listening for http://[::1]:19302
73 2024.08.27 19:19:56.057283 [ 1 ] {} <Information> Application: Listening for native protocol (tcp): [::1]:19202
74 2024.08.27 19:19:56.057296 [ 1 ] {} <Information> Application: Ready for connections.
75 2024.08.27 19:19:56.070304 [ 249 ] {} <Debug> DDLWorker: Started DDLWorker cleanup thread
76 2024.08.27 19:19:56.073531 [ 244 ] {} <Debug> DDLWorker: Starting DDLWorker thread
77 2024.08.27 19:19:56.073590 [ 244 ] {} <Debug> DDLWorker: Initializing DDLWorker thread
78 2024.08.27 19:19:56.846826 [ 3 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: GET, Address: [::1]:65512, User-Agent: (none), Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
79 2024.08.27 19:19:57.080070 [ 244 ] {} <Debug> ZooKeeperClient: Connected to a suboptimal ZooKeeper host ([::1]:19002, index 1). To preserve balance in ZooKeeper usage, this ZooKeeper session will expire in 16235 seconds
80 2024.08.27 19:19:57.080152 [ 244 ] {} <Information> ZooKeeperClient: Connected to ZooKeeper at [::1]:19002 with session_id 2
81 Poco::Exception. Code: 1000, e.code() = 0, Timeout: connect timed out: [::1]:19001 (version 23.8.7.1), [::1]:19001
82 2024.08.27 19:19:57.082868 [ 244 ] {} <Information> ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled
83 2024.08.27 19:19:57.082910 [ 244 ] {} <Information> ZooKeeperClient: Keeper feature flag MULTI_READ: enabled
84 2024.08.27 19:19:57.082923 [ 244 ] {} <Information> ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled
85 2024.08.27 19:19:57.082962 [ 244 ] {} <Trace> ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003
86 2024.08.27 19:19:57.106122 [ 244 ] {} <Debug> DDLWorker: Initialized DDLWorker thread
87 2024.08.27 19:19:57.106178 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
88 2024.08.27 19:19:57.106187 [ 244 ] {} <Trace> DDLWorker: Don't have unfinished tasks after restarting
89 2024.08.27 19:19:57.106229 [ 249 ] {} <Debug> DDLWorker: Cleaning queue
90 2024.08.27 19:19:57.106671 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=0, queue_size=0, entries=none..none, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none
91 2024.08.27 19:19:57.106704 [ 244 ] {} <Debug> DDLWorker: No tasks to schedule
92 2024.08.27 19:19:57.106714 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
93 2024.08.27 19:19:57.486188 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
94 2024.08.27 19:19:57.486220 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
95 2024.08.27 19:19:57.487592 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=1, queue_size=1, entries=query-0000000000..query-0000000000, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none
96 2024.08.27 19:19:57.487702 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000000
97 2024.08.27 19:19:57.487723 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000000
98 2024.08.27 19:19:57.491288 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000000 (CREATE DATABASE IF NOT EXISTS oximeter UUID '4e169194-bd2b-407c-8d78-081075618ab9')
99 2024.08.27 19:19:57.495127 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID '4e169194-bd2b-407c-8d78-081075618ab9'
100 2024.08.27 19:19:57.495484 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: be97acaf-9db9-4e7c-b4e3-5559d009900b) /* ddl_entry=query-0000000000 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '4e169194-bd2b-407c-8d78-081075618ab9' (stage: Complete)
101 2024.08.27 19:19:57.496960 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} <Information> DatabaseAtomic (oximeter): Metadata processed, database oximeter has 0 tables and 0 dictionaries in total.
102 2024.08.27 19:19:57.496984 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} <Information> TablesLoader: Parsed metadata of 0 tables in 1 databases in 8.2856e-05 sec
103 2024.08.27 19:19:57.496995 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} <Trace> ReferentialDeps: No tables
104 2024.08.27 19:19:57.497014 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} <Trace> LoadingDeps: No tables
105 2024.08.27 19:19:57.497039 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} <Information> DatabaseAtomic (oximeter): Starting up tables.
106 2024.08.27 19:19:57.497159 [ 244 ] {9560b5f0-c610-4829-9138-ac830707f249} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000000 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '4e169194-bd2b-407c-8d78-081075618ab9'
107 2024.08.27 19:19:57.500403 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
108 2024.08.27 19:20:02.177754 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
109 2024.08.27 19:20:02.177770 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
110 2024.08.27 19:20:02.178184 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=2, queue_size=2, entries=query-0000000000..query-0000000001, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000000, last_skipped_entry_name=none
111 2024.08.27 19:20:02.178221 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000001
112 2024.08.27 19:20:02.178230 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000001
113 2024.08.27 19:20:02.182332 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000001 (CREATE TABLE IF NOT EXISTS oximeter.version UUID 'a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp))
114 2024.08.27 19:20:02.185977 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID 'a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)
115 2024.08.27 19:20:02.186229 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b1a3482e-4a05-424b-a61a-9a61af385a27) /* ddl_entry=query-0000000001 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete)
116 2024.08.27 19:20:02.189163 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1
117 2024.08.27 19:20:02.190420 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Debug> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Loading data parts
118 2024.08.27 19:20:02.191361 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Debug> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): There are no data parts
119 2024.08.27 19:20:02.207883 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Debug> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Creating table /clickhouse/tables/1/version
120 2024.08.27 19:20:02.246330 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Debug> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Creating shared ID for table oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e)
121 2024.08.27 19:20:02.249286 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Debug> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Shared ID for table oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e) doesn't exist in ZooKeeper on path /clickhouse/tables/1/version/table_shared_id
122 2024.08.27 19:20:02.249323 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Debug> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Got candidate ID a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e, will try to create it in ZooKeeper on path /clickhouse/tables/1/version/table_shared_id
123 2024.08.27 19:20:02.252396 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Debug> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Initializing table shared ID with a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e
124 2024.08.27 19:20:02.253753 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Starting up table
125 2024.08.27 19:20:02.257145 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Information> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Became leader
126 2024.08.27 19:20:02.257174 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Trace> oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
127 2024.08.27 19:20:02.257217 [ 93 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Activating replica.
128 2024.08.27 19:20:02.257299 [ 93 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up
129 2024.08.27 19:20:02.264339 [ 93 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue
130 2024.08.27 19:20:02.264714 [ 93 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Queue initialized
131 2024.08.27 19:20:02.264789 [ 93 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue
132 2024.08.27 19:20:02.265122 [ 93 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
133 2024.08.27 19:20:02.265622 [ 93 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Loaded queue
134 2024.08.27 19:20:02.271495 [ 93 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully
135 2024.08.27 19:20:02.271635 [ 97 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 6048ms
136 2024.08.27 19:20:02.271806 [ 244 ] {225228a1-4548-47dc-97be-095504fd37b6} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000001 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)
137 2024.08.27 19:20:02.278287 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
138 2024.08.27 19:20:02.350396 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
139 2024.08.27 19:20:02.350415 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
140 2024.08.27 19:20:02.351016 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=3, queue_size=3, entries=query-0000000000..query-0000000002, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000001, last_skipped_entry_name=none
141 2024.08.27 19:20:02.351044 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000002
142 2024.08.27 19:20:02.351066 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000002
143 2024.08.27 19:20:02.355417 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000002 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '5a85093b-c21a-4b08-bf37-6af0108427b6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30))
144 2024.08.27 19:20:02.359559 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '5a85093b-c21a-4b08-bf37-6af0108427b6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)
145 2024.08.27 19:20:02.360209 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0b56b027-8b9f-4d5b-bc1f-279770028326) /* ddl_entry=query-0000000002 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '5a85093b-c21a-4b08-bf37-6af0108427b6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete)
146 2024.08.27 19:20:02.364659 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Loading data parts
147 2024.08.27 19:20:02.365283 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): There are no data parts
148 2024.08.27 19:20:02.369858 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Creating table /clickhouse/tables/1/measurements_cumulativef64_local
149 2024.08.27 19:20:02.429554 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Creating shared ID for table oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6)
150 2024.08.27 19:20:02.430008 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Initializing table shared ID with 5a85093b-c21a-4b08-bf37-6af0108427b6
151 2024.08.27 19:20:02.431360 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Starting up table
152 2024.08.27 19:20:02.435171 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} <Information> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Became leader
153 2024.08.27 19:20:02.435243 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
154 2024.08.27 19:20:02.435373 [ 87 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Activating replica.
155 2024.08.27 19:20:02.435410 [ 87 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
156 2024.08.27 19:20:02.439857 [ 87 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
157 2024.08.27 19:20:02.440229 [ 87 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized
158 2024.08.27 19:20:02.440273 [ 87 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue
159 2024.08.27 19:20:02.440611 [ 87 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
160 2024.08.27 19:20:02.441074 [ 87 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue
161 2024.08.27 19:20:02.452135 [ 87 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
162 2024.08.27 19:20:02.452187 [ 169 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 6104ms
163 2024.08.27 19:20:02.452498 [ 244 ] {a5d53b6e-2050-411e-a724-0140573bb702} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000002 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID '5a85093b-c21a-4b08-bf37-6af0108427b6' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)
164 2024.08.27 19:20:02.455852 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
165 2024.08.27 19:20:02.520244 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
166 2024.08.27 19:20:02.520279 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
167 2024.08.27 19:20:02.521164 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=4, queue_size=4, entries=query-0000000000..query-0000000003, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000002, last_skipped_entry_name=none
168 2024.08.27 19:20:02.521205 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000003
169 2024.08.27 19:20:02.521216 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000003
170 2024.08.27 19:20:02.525392 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000003 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'bb1f6542-3e31-405f-bfaa-a78e4b1d3083' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])))
171 2024.08.27 19:20:02.528524 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'bb1f6542-3e31-405f-bfaa-a78e4b1d3083' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
172 2024.08.27 19:20:02.528759 [ 244 ] {b3567f78-03b6-4d49-afef-8b4c7a18d9b6} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8db40eed-8365-49a4-a4bb-213e762f5861) /* ddl_entry=query-0000000003 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'bb1f6542-3e31-405f-bfaa-a78e4b1d3083' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
173 2024.08.27 19:20:02.529939 [ 244 ] {b3567f78-03b6-4d49-afef-8b4c7a18d9b6} <Debug> StorageDistributed (measurements_cumulativef64): Auto-increment is 0
174 2024.08.27 19:20:02.531431 [ 244 ] {b3567f78-03b6-4d49-afef-8b4c7a18d9b6} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000003 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID 'bb1f6542-3e31-405f-bfaa-a78e4b1d3083' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
175 2024.08.27 19:20:02.536359 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
176 2024.08.27 19:20:02.644926 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
177 2024.08.27 19:20:02.644940 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
178 2024.08.27 19:20:02.648554 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=5, queue_size=5, entries=query-0000000000..query-0000000004, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000003, last_skipped_entry_name=none
179 2024.08.27 19:20:02.648594 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000004
180 2024.08.27 19:20:02.648607 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000004
181 2024.08.27 19:20:02.650042 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000004 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cf08e0ee-71a3-4243-81ae-d52967c1399a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30))
182 2024.08.27 19:20:02.653948 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cf08e0ee-71a3-4243-81ae-d52967c1399a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
183 2024.08.27 19:20:02.655345 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 95e19506-23b5-475e-b73d-b39f4ccabc7e) /* ddl_entry=query-0000000004 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cf08e0ee-71a3-4243-81ae-d52967c1399a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete)
184 2024.08.27 19:20:02.658551 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Loading data parts
185 2024.08.27 19:20:02.659519 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): There are no data parts
186 2024.08.27 19:20:02.668105 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Creating table /clickhouse/tables/1/fields_i64_local
187 2024.08.27 19:20:02.706568 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Creating shared ID for table oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a)
188 2024.08.27 19:20:02.707216 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Shared ID for table oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) doesn't exist in ZooKeeper on path /clickhouse/tables/1/fields_i64_local/table_shared_id
189 2024.08.27 19:20:02.707261 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Got candidate ID cf08e0ee-71a3-4243-81ae-d52967c1399a, will try to create it in ZooKeeper on path /clickhouse/tables/1/fields_i64_local/table_shared_id
190 2024.08.27 19:20:02.710972 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Initializing table shared ID with cf08e0ee-71a3-4243-81ae-d52967c1399a
191 2024.08.27 19:20:02.712491 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Starting up table
192 2024.08.27 19:20:02.724222 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Information> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Became leader
193 2024.08.27 19:20:02.724319 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
194 2024.08.27 19:20:02.724384 [ 89 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Activating replica.
195 2024.08.27 19:20:02.724404 [ 89 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
196 2024.08.27 19:20:02.732673 [ 89 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
197 2024.08.27 19:20:02.733123 [ 89 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized
198 2024.08.27 19:20:02.733167 [ 89 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue
199 2024.08.27 19:20:02.733962 [ 89 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
200 2024.08.27 19:20:02.734553 [ 89 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue
201 2024.08.27 19:20:02.746002 [ 89 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
202 2024.08.27 19:20:02.746047 [ 77 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 6378ms
203 2024.08.27 19:20:02.746610 [ 244 ] {99f270f0-e4ea-44d5-9e1e-47463785f046} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000004 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cf08e0ee-71a3-4243-81ae-d52967c1399a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
204 2024.08.27 19:20:02.751066 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
205 2024.08.27 19:20:02.829883 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
206 2024.08.27 19:20:02.829909 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
207 2024.08.27 19:20:02.830539 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=6, queue_size=6, entries=query-0000000000..query-0000000005, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000004, last_skipped_entry_name=none
208 2024.08.27 19:20:02.830582 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000005
209 2024.08.27 19:20:02.830593 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000005
210 2024.08.27 19:20:02.835150 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000005 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2bcf3967-e0ba-4c8e-93cc-a7d49d0063ff' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])))
211 2024.08.27 19:20:02.838285 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2bcf3967-e0ba-4c8e-93cc-a7d49d0063ff' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
212 2024.08.27 19:20:02.838604 [ 244 ] {4dc9be3d-e731-42de-a2f0-993fd9a7cd41} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 13bf1d3d-d4ba-4e5d-9651-1ceee17e4ed0) /* ddl_entry=query-0000000005 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2bcf3967-e0ba-4c8e-93cc-a7d49d0063ff' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
213 2024.08.27 19:20:02.839876 [ 244 ] {4dc9be3d-e731-42de-a2f0-993fd9a7cd41} <Debug> StorageDistributed (fields_i64): Auto-increment is 0
214 2024.08.27 19:20:02.841187 [ 244 ] {4dc9be3d-e731-42de-a2f0-993fd9a7cd41} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000005 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '2bcf3967-e0ba-4c8e-93cc-a7d49d0063ff' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
215 2024.08.27 19:20:02.844760 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
216 2024.08.27 19:20:02.914466 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
217 2024.08.27 19:20:02.914543 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
218 2024.08.27 19:20:02.915216 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=7, queue_size=7, entries=query-0000000000..query-0000000006, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000005, last_skipped_entry_name=none
219 2024.08.27 19:20:02.915268 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000006
220 2024.08.27 19:20:02.915280 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000006
221 2024.08.27 19:20:02.920796 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000006 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a9e89244-7177-439d-9410-6c84872c1664' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30))
222 2024.08.27 19:20:02.925074 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a9e89244-7177-439d-9410-6c84872c1664' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
223 2024.08.27 19:20:02.925753 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 5ef8b8c4-a644-449b-8690-8760d69fa872) /* ddl_entry=query-0000000006 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a9e89244-7177-439d-9410-6c84872c1664' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete)
224 2024.08.27 19:20:02.929731 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Loading data parts
225 2024.08.27 19:20:02.930210 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): There are no data parts
226 2024.08.27 19:20:02.938920 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Creating table /clickhouse/tables/1/fields_uuid_local
227 2024.08.27 19:20:02.947748 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Information> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): It looks like the table /clickhouse/tables/1/fields_uuid_local was created by another server at the same moment, will retry
228 2024.08.27 19:20:02.948990 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): This table /clickhouse/tables/1/fields_uuid_local is already created, will add new replica
229 2024.08.27 19:20:02.957714 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Creating replica /clickhouse/tables/1/fields_uuid_local/replicas/2
230 2024.08.27 19:20:03.000695 [ 246 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 102.06 MiB, peak 102.06 MiB, free memory in arenas 0.00 B, will set to 104.77 MiB (RSS), difference: 2.71 MiB
231 2024.08.27 19:20:03.029192 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Creating shared ID for table oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664)
232 2024.08.27 19:20:03.030153 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Initializing table shared ID with a9e89244-7177-439d-9410-6c84872c1664
233 2024.08.27 19:20:03.031909 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Starting up table
234 2024.08.27 19:20:03.034971 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Information> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Became leader
235 2024.08.27 19:20:03.035001 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
236 2024.08.27 19:20:03.035059 [ 97 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Activating replica.
237 2024.08.27 19:20:03.035129 [ 97 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
238 2024.08.27 19:20:03.043529 [ 97 ] {} <Information> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Replica 1 has log pointer '0', approximate 1 queue lag and 0 queue size
239 2024.08.27 19:20:03.043587 [ 97 ] {} <Information> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Will mimic 1
240 2024.08.27 19:20:03.053777 [ 97 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Queued 0 parts to be fetched, 0 parts ignored
241 2024.08.27 19:20:03.053836 [ 97 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Copied 0 queue entries, 0 entries ignored
242 2024.08.27 19:20:03.054398 [ 97 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Parts in ZooKeeper after mimic:
243 2024.08.27 19:20:03.054455 [ 97 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Enqueued fetches after mimic:
244 2024.08.27 19:20:03.058159 [ 97 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue
245 2024.08.27 19:20:03.058549 [ 97 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized
246 2024.08.27 19:20:03.058585 [ 97 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue
247 2024.08.27 19:20:03.059076 [ 97 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
248 2024.08.27 19:20:03.059472 [ 97 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue
249 2024.08.27 19:20:03.062380 [ 97 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully
250 2024.08.27 19:20:03.062420 [ 77 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 6159ms
251 2024.08.27 19:20:03.062835 [ 244 ] {21a18048-8907-4bde-9c3b-c1708114d242} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000006 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'a9e89244-7177-439d-9410-6c84872c1664' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
252 2024.08.27 19:20:03.066682 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
253 2024.08.27 19:20:03.206600 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
254 2024.08.27 19:20:03.206605 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
255 2024.08.27 19:20:03.207417 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=8, queue_size=8, entries=query-0000000000..query-0000000007, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000006, last_skipped_entry_name=none
256 2024.08.27 19:20:03.207465 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000007
257 2024.08.27 19:20:03.207477 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000007
258 2024.08.27 19:20:03.212424 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000007 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID 'e9919c3e-527e-45d0-bc14-c1846f7d72bb' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])))
259 2024.08.27 19:20:03.219168 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID 'e9919c3e-527e-45d0-bc14-c1846f7d72bb' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))
260 2024.08.27 19:20:03.219662 [ 244 ] {988b4e86-1ffd-464d-8022-25817d76a898} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 48779d3d-3b83-4b05-afaa-eea90bbbfa75) /* ddl_entry=query-0000000007 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID 'e9919c3e-527e-45d0-bc14-c1846f7d72bb' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
261 2024.08.27 19:20:03.221168 [ 244 ] {988b4e86-1ffd-464d-8022-25817d76a898} <Debug> StorageDistributed (fields_uuid): Auto-increment is 0
262 2024.08.27 19:20:03.223281 [ 244 ] {988b4e86-1ffd-464d-8022-25817d76a898} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000007 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID 'e9919c3e-527e-45d0-bc14-c1846f7d72bb' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))
263 2024.08.27 19:20:03.228326 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
264 2024.08.27 19:20:03.348210 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
265 2024.08.27 19:20:03.350073 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=9, queue_size=9, entries=query-0000000000..query-0000000008, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000007, last_skipped_entry_name=none
266 2024.08.27 19:20:03.350112 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000008
267 2024.08.27 19:20:03.350126 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000008
268 2024.08.27 19:20:03.350884 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
269 2024.08.27 19:20:03.356343 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000008 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '95e71a20-0d77-40b6-ae4f-41a6e9863749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name))
270 2024.08.27 19:20:03.362618 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '95e71a20-0d77-40b6-ae4f-41a6e9863749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)
271 2024.08.27 19:20:03.363093 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 2c58ba80-f1c2-4463-a133-ca2f604b1fef) /* ddl_entry=query-0000000008 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '95e71a20-0d77-40b6-ae4f-41a6e9863749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete)
272 2024.08.27 19:20:03.365766 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Loading data parts
273 2024.08.27 19:20:03.366316 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): There are no data parts
274 2024.08.27 19:20:03.376869 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Creating table /clickhouse/tables/1/timeseries_schema_local
275 2024.08.27 19:20:03.452468 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Creating shared ID for table oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749)
276 2024.08.27 19:20:03.453011 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Shared ID for table oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) doesn't exist in ZooKeeper on path /clickhouse/tables/1/timeseries_schema_local/table_shared_id
277 2024.08.27 19:20:03.453073 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Got candidate ID 95e71a20-0d77-40b6-ae4f-41a6e9863749, will try to create it in ZooKeeper on path /clickhouse/tables/1/timeseries_schema_local/table_shared_id
278 2024.08.27 19:20:03.459111 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Initializing table shared ID with 95e71a20-0d77-40b6-ae4f-41a6e9863749
279 2024.08.27 19:20:03.460542 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Starting up table
280 2024.08.27 19:20:03.467971 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Information> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Became leader
281 2024.08.27 19:20:03.468002 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
282 2024.08.27 19:20:03.468272 [ 181 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Activating replica.
283 2024.08.27 19:20:03.468317 [ 181 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
284 2024.08.27 19:20:03.473801 [ 181 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue
285 2024.08.27 19:20:03.474420 [ 181 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized
286 2024.08.27 19:20:03.474451 [ 181 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue
287 2024.08.27 19:20:03.474857 [ 181 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
288 2024.08.27 19:20:03.478626 [ 181 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue
289 2024.08.27 19:20:03.485280 [ 181 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully
290 2024.08.27 19:20:03.485377 [ 77 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 6407ms
291 2024.08.27 19:20:03.485919 [ 244 ] {c1b6c397-d07e-4dc1-8644-d5b549241fcb} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000008 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID '95e71a20-0d77-40b6-ae4f-41a6e9863749' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)
292 2024.08.27 19:20:03.494160 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
293 2024.08.27 19:20:03.638249 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
294 2024.08.27 19:20:03.638291 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
295 2024.08.27 19:20:03.639013 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=10, queue_size=10, entries=query-0000000000..query-0000000009, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000008, last_skipped_entry_name=none
296 2024.08.27 19:20:03.639062 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000009
297 2024.08.27 19:20:03.639072 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000009
298 2024.08.27 19:20:03.649775 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000009 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '0a9c4888-9434-4e55-8004-ef2c1a6760f2' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])))
299 2024.08.27 19:20:03.661754 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '0a9c4888-9434-4e55-8004-ef2c1a6760f2' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))
300 2024.08.27 19:20:03.662296 [ 244 ] {67e15156-b1e6-422c-8ff5-c8491e141ccf} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d5618f2a-ecd1-4f2e-bd07-034fd0ad7816) /* ddl_entry=query-0000000009 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '0a9c4888-9434-4e55-8004-ef2c1a6760f2' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
301 2024.08.27 19:20:03.664139 [ 244 ] {67e15156-b1e6-422c-8ff5-c8491e141ccf} <Debug> StorageDistributed (timeseries_schema): Auto-increment is 0
302 2024.08.27 19:20:03.666291 [ 244 ] {67e15156-b1e6-422c-8ff5-c8491e141ccf} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000009 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID '0a9c4888-9434-4e55-8004-ef2c1a6760f2' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))
303 2024.08.27 19:20:03.671275 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
304 2024.08.27 19:20:03.765903 [ 3 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 93, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
305 2024.08.27 19:20:03.766168 [ 3 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
306 2024.08.27 19:20:03.766212 [ 3 ] {} <Debug> HTTP-Session: 67a3ed93-3475-4961-a062-c81ea0e2724f Authenticating user 'default' from [::1]:65512
307 2024.08.27 19:20:03.766336 [ 3 ] {} <Debug> HTTP-Session: 67a3ed93-3475-4961-a062-c81ea0e2724f Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
308 2024.08.27 19:20:03.766361 [ 3 ] {} <Debug> HTTP-Session: 67a3ed93-3475-4961-a062-c81ea0e2724f Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
309 2024.08.27 19:20:03.766513 [ 3 ] {} <Trace> ContextAccess (default): Settings: readonly = 0, allow_ddl = true, allow_introspection_functions = false
310 2024.08.27 19:20:03.766577 [ 3 ] {} <Trace> ContextAccess (default): List of all grants: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.*
311 2024.08.27 19:20:03.766612 [ 3 ] {} <Trace> ContextAccess (default): List of all grants including implicit: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.*
312 2024.08.27 19:20:03.766700 [ 3 ] {} <Trace> HTTP-Session: 67a3ed93-3475-4961-a062-c81ea0e2724f Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
313 2024.08.27 19:20:03.767247 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} <Debug> executeQuery: (from [::1]:65512) SELECT name FROM system.tables WHERE database = 'oximeter' AND engine = 'ReplicatedMergeTree' (stage: Complete)
314 2024.08.27 19:20:03.768278 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} <Trace> ContextAccess (default): Access granted: SELECT(database, name, engine) ON system.tables
315 2024.08.27 19:20:03.768862 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
316 2024.08.27 19:20:03.769871 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} <Trace> ContextAccess (default): Access granted: SHOW TABLES ON *.*
317 2024.08.27 19:20:03.771404 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} <Debug> executeQuery: Read 9 rows, 631.00 B in 0.004303 sec., 2091.564025098768 rows/sec., 143.20 KiB/sec.
318 2024.08.27 19:20:03.772194 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} <Debug> DynamicQueryHandler: Done processing query
319 2024.08.27 19:20:03.772225 [ 3 ] {60dbce08-79bb-46cd-8d1a-f1b7f678369e} <Debug> MemoryTracker: Peak memory usage (for query): 4.00 MiB.
320 2024.08.27 19:20:03.772240 [ 3 ] {} <Debug> HTTP-Session: 67a3ed93-3475-4961-a062-c81ea0e2724f Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
321 2024.08.27 19:20:04.000452 [ 246 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 105.16 MiB, peak 110.13 MiB, free memory in arenas 0.00 B, will set to 106.23 MiB (RSS), difference: 1.07 MiB
322 2024.08.27 19:20:04.837374 [ 89 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000
323 2024.08.27 19:20:04.842015 [ 89 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0]
324 2024.08.27 19:20:04.842125 [ 89 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
325 2024.08.27 19:20:04.846976 [ 193 ] {} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Fetching part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/1
326 2024.08.27 19:20:04.850703 [ 193 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ftimeseries_schema_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false
327 2024.08.27 19:20:04.850977 [ 193 ] {} <Trace> HTTPSessionAdapter: Created HTTP(S) session with ::1:19401 (::1:19401)
328 2024.08.27 19:20:04.853241 [ 193 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Trying to reserve 1.00 MiB using storage policy from min volume index 0
329 2024.08.27 19:20:04.853340 [ 193 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB.
330 2024.08.27 19:20:04.853362 [ 193 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
331 2024.08.27 19:20:04.853425 [ 193 ] {} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (Fetcher): Downloading part all_0_0_0 onto disk default.
332 2024.08.27 19:20:04.856485 [ 193 ] {} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (Fetcher): Download of part all_0_0_0 onto disk default finished.
333 2024.08.27 19:20:04.856542 [ 193 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
334 2024.08.27 19:20:04.856728 [ 193 ] {} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Committing part all_0_0_0 to zookeeper
335 2024.08.27 19:20:04.860284 [ 193 ] {} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Part all_0_0_0 committed to zookeeper
336 2024.08.27 19:20:04.860411 [ 193 ] {} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Fetched part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/1
337 2024.08.27 19:20:04.860592 [ 87 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue)
338 2024.08.27 19:20:04.860652 [ 87 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 7716ms
339 2024.08.27 19:20:04.878504 [ 87 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000
340 2024.08.27 19:20:04.881920 [ 87 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0]
341 2024.08.27 19:20:04.881951 [ 87 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
342 2024.08.27 19:20:04.886638 [ 194 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1
343 2024.08.27 19:20:04.890120 [ 194 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false
344 2024.08.27 19:20:04.892854 [ 194 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Trying to reserve 1.00 MiB using storage policy from min volume index 0
345 2024.08.27 19:20:04.892929 [ 194 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB.
346 2024.08.27 19:20:04.892946 [ 194 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
347 2024.08.27 19:20:04.892974 [ 194 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Downloading part all_0_0_0 onto disk default.
348 2024.08.27 19:20:04.895594 [ 194 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Download of part all_0_0_0 onto disk default finished.
349 2024.08.27 19:20:04.895712 [ 194 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
350 2024.08.27 19:20:04.895844 [ 194 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Committing part all_0_0_0 to zookeeper
351 2024.08.27 19:20:04.905443 [ 194 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Part all_0_0_0 committed to zookeeper
352 2024.08.27 19:20:04.905723 [ 194 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1
353 2024.08.27 19:20:04.905802 [ 87 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue)
354 2024.08.27 19:20:04.905866 [ 87 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 7874ms
355 2024.08.27 19:20:04.914504 [ 87 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000
356 2024.08.27 19:20:04.921952 [ 87 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0]
357 2024.08.27 19:20:04.922042 [ 87 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
358 2024.08.27 19:20:04.928749 [ 193 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1
359 2024.08.27 19:20:04.933059 [ 193 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false
360 2024.08.27 19:20:04.934708 [ 193 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Trying to reserve 1.00 MiB using storage policy from min volume index 0
361 2024.08.27 19:20:04.934787 [ 193 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB.
362 2024.08.27 19:20:04.934822 [ 193 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
363 2024.08.27 19:20:04.934939 [ 193 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Downloading part all_0_0_0 onto disk default.
364 2024.08.27 19:20:04.937440 [ 193 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Download of part all_0_0_0 onto disk default finished.
365 2024.08.27 19:20:04.937525 [ 193 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
366 2024.08.27 19:20:04.937730 [ 193 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Committing part all_0_0_0 to zookeeper
367 2024.08.27 19:20:04.942294 [ 193 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Part all_0_0_0 committed to zookeeper
368 2024.08.27 19:20:04.942379 [ 89 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000000 - log-0000000000
369 2024.08.27 19:20:04.942400 [ 193 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1
370 2024.08.27 19:20:04.942516 [ 87 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue)
371 2024.08.27 19:20:04.942591 [ 87 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 8085ms
372 2024.08.27 19:20:04.951886 [ 89 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0]
373 2024.08.27 19:20:04.951942 [ 89 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
374 2024.08.27 19:20:04.964262 [ 196 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Fetching part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1
375 2024.08.27 19:20:04.964866 [ 196 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false
376 2024.08.27 19:20:04.968933 [ 196 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Trying to reserve 1.00 MiB using storage policy from min volume index 0
377 2024.08.27 19:20:04.969014 [ 196 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB.
378 2024.08.27 19:20:04.969050 [ 196 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
379 2024.08.27 19:20:04.969085 [ 196 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Downloading part all_0_0_0 onto disk default.
380 2024.08.27 19:20:04.971806 [ 196 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Download of part all_0_0_0 onto disk default finished.
381 2024.08.27 19:20:04.971912 [ 196 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
382 2024.08.27 19:20:04.972024 [ 196 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Committing part all_0_0_0 to zookeeper
383 2024.08.27 19:20:04.975403 [ 196 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Part all_0_0_0 committed to zookeeper
384 2024.08.27 19:20:04.975520 [ 196 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Fetched part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1
385 2024.08.27 19:20:04.975622 [ 77 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue)
386 2024.08.27 19:20:04.975683 [ 77 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 7522ms
387 2024.08.27 19:20:05.001149 [ 246 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 106.23 MiB, peak 110.13 MiB, free memory in arenas 0.00 B, will set to 107.61 MiB (RSS), difference: 1.38 MiB
388 2024.08.27 19:20:05.037259 [ 3 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 60, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
389 2024.08.27 19:20:05.037386 [ 3 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
390 2024.08.27 19:20:05.037408 [ 3 ] {} <Debug> HTTP-Session: 56bdfc97-924b-49c6-bc4a-5c5dcb548255 Authenticating user 'default' from [::1]:65512
391 2024.08.27 19:20:05.037452 [ 3 ] {} <Debug> HTTP-Session: 56bdfc97-924b-49c6-bc4a-5c5dcb548255 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
392 2024.08.27 19:20:05.037464 [ 3 ] {} <Debug> HTTP-Session: 56bdfc97-924b-49c6-bc4a-5c5dcb548255 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
393 2024.08.27 19:20:05.037527 [ 3 ] {} <Trace> HTTP-Session: 56bdfc97-924b-49c6-bc4a-5c5dcb548255 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
394 2024.08.27 19:20:05.037895 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Debug> executeQuery: (from [::1]:65512) SELECT * FROM oximeter.timeseries_schema FORMAT JSONEachRow; (stage: Complete)
395 2024.08.27 19:20:05.038364 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema
396 2024.08.27 19:20:05.038713 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema
397 2024.08.27 19:20:05.039434 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local
398 2024.08.27 19:20:05.039716 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
399 2024.08.27 19:20:05.039904 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Trace> InterpreterSelectQuery: Complete -> Complete
400 2024.08.27 19:20:05.040333 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (SelectExecutor): Key condition: unknown
401 2024.08.27 19:20:05.040452 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Debug> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges
402 2024.08.27 19:20:05.040519 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (SelectExecutor): Spreading mark ranges among streams (default reading)
403 2024.08.27 19:20:05.040638 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0
404 2024.08.27 19:20:05.045207 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Debug> executeQuery: Read 1 rows, 126.00 B in 0.007414 sec., 134.87995683841382 rows/sec., 16.60 KiB/sec.
405 2024.08.27 19:20:05.046023 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Debug> DynamicQueryHandler: Done processing query
406 2024.08.27 19:20:05.046064 [ 3 ] {e1c30a2b-6bf8-49b6-9a51-2fb3ec6faf01} <Debug> MemoryTracker: Peak memory usage (for query): 4.00 MiB.
407 2024.08.27 19:20:05.046138 [ 3 ] {} <Debug> HTTP-Session: 56bdfc97-924b-49c6-bc4a-5c5dcb548255 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
408 2024.08.27 19:20:05.048965 [ 3 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
409 2024.08.27 19:20:05.049131 [ 3 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
410 2024.08.27 19:20:05.049186 [ 3 ] {} <Debug> HTTP-Session: 96e4e428-4693-4521-93b5-b5e809e7f954 Authenticating user 'default' from [::1]:65512
411 2024.08.27 19:20:05.049213 [ 3 ] {} <Debug> HTTP-Session: 96e4e428-4693-4521-93b5-b5e809e7f954 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
412 2024.08.27 19:20:05.049223 [ 3 ] {} <Debug> HTTP-Session: 96e4e428-4693-4521-93b5-b5e809e7f954 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
413 2024.08.27 19:20:05.049301 [ 3 ] {} <Trace> HTTP-Session: 96e4e428-4693-4521-93b5-b5e809e7f954 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
414 2024.08.27 19:20:05.049934 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> executeQuery: (from [::1]:65512) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete)
415 2024.08.27 19:20:05.050689 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
416 2024.08.27 19:20:05.051174 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
417 2024.08.27 19:20:05.051620 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
418 2024.08.27 19:20:05.052550 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
419 2024.08.27 19:20:05.054919 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
420 2024.08.27 19:20:05.055219 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> HashJoin: (0x1e6f74f0) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
421 2024.08.27 19:20:05.055262 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> HashJoin: (0x1e6f74f0) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
422 2024.08.27 19:20:05.055485 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> HashJoin: (0x1e6f74f0) Join data is being destroyed, 12288 bytes and 0 rows in hash table
423 2024.08.27 19:20:05.057254 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
424 2024.08.27 19:20:05.058272 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
425 2024.08.27 19:20:05.058429 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> HashJoin: (0x1e6f2e60) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
426 2024.08.27 19:20:05.058463 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> HashJoin: (0x1e6f2e60) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
427 2024.08.27 19:20:05.059575 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
428 2024.08.27 19:20:05.059974 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
429 2024.08.27 19:20:05.060397 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
430 2024.08.27 19:20:05.060439 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
431 2024.08.27 19:20:05.060710 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local
432 2024.08.27 19:20:05.060794 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
433 2024.08.27 19:20:05.061071 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: Complete -> Complete
434 2024.08.27 19:20:05.061297 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> HashJoin: (0x1e7191b0) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0)
435 2024.08.27 19:20:05.061323 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> HashJoin: (0x1e7191b0) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)]
436 2024.08.27 19:20:05.062071 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
437 2024.08.27 19:20:05.063189 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
438 2024.08.27 19:20:05.063672 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
439 2024.08.27 19:20:05.064076 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
440 2024.08.27 19:20:05.064110 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
441 2024.08.27 19:20:05.064385 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local
442 2024.08.27 19:20:05.064462 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
443 2024.08.27 19:20:05.064528 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: Complete -> Complete
444 2024.08.27 19:20:05.064637 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> HashJoin: (0x1e74f450) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
445 2024.08.27 19:20:05.064654 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> HashJoin: (0x1e74f450) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
446 2024.08.27 19:20:05.064832 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> HashJoin: (0x1e6f2e60) Join data is being destroyed, 12288 bytes and 0 rows in hash table
447 2024.08.27 19:20:05.065333 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
448 2024.08.27 19:20:05.065782 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
449 2024.08.27 19:20:05.066171 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
450 2024.08.27 19:20:05.066204 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
451 2024.08.27 19:20:05.066468 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local
452 2024.08.27 19:20:05.066548 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
453 2024.08.27 19:20:05.066615 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: Complete -> Complete
454 2024.08.27 19:20:05.066628 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
455 2024.08.27 19:20:05.066671 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)'
456 2024.08.27 19:20:05.066769 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)'
457 2024.08.27 19:20:05.066840 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
458 2024.08.27 19:20:05.066870 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)'
459 2024.08.27 19:20:05.066902 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)'
460 2024.08.27 19:20:05.067480 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
461 2024.08.27 19:20:05.067535 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
462 2024.08.27 19:20:05.067590 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (LEFT) boundary mark: 0
463 2024.08.27 19:20:05.067615 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (RIGHT) boundary mark: 2
464 2024.08.27 19:20:05.067629 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found continuous range in 2 steps
465 2024.08.27 19:20:05.067668 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges
466 2024.08.27 19:20:05.067685 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Spreading mark ranges among streams (default reading)
467 2024.08.27 19:20:05.067826 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
468 2024.08.27 19:20:05.067858 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 8 rows starting from 0
469 2024.08.27 19:20:05.068081 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
470 2024.08.27 19:20:05.068130 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
471 2024.08.27 19:20:05.068173 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0
472 2024.08.27 19:20:05.068208 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 1
473 2024.08.27 19:20:05.068225 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps
474 2024.08.27 19:20:05.068265 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges
475 2024.08.27 19:20:05.068279 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Spreading mark ranges among streams (default reading)
476 2024.08.27 19:20:05.068369 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
477 2024.08.27 19:20:05.068402 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0
478 2024.08.27 19:20:05.068497 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)'
479 2024.08.27 19:20:05.068535 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)'
480 2024.08.27 19:20:05.068673 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
481 2024.08.27 19:20:05.068710 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
482 2024.08.27 19:20:05.068729 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0
483 2024.08.27 19:20:05.068748 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 2
484 2024.08.27 19:20:05.068761 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps
485 2024.08.27 19:20:05.068784 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges
486 2024.08.27 19:20:05.068807 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Spreading mark ranges among streams (default reading)
487 2024.08.27 19:20:05.068894 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
488 2024.08.27 19:20:05.068924 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0
489 2024.08.27 19:20:05.069001 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)'
490 2024.08.27 19:20:05.069036 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)'
491 2024.08.27 19:20:05.072637 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> executeQuery: Read 40 rows, 2.89 KiB in 0.023113 sec., 1730.6277852290918 rows/sec., 125.06 KiB/sec.
492 2024.08.27 19:20:05.072952 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> HashJoin: (0x1e74f450) Join data is being destroyed, 12800 bytes and 8 rows in hash table
493 2024.08.27 19:20:05.073132 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Trace> HashJoin: (0x1e7191b0) Join data is being destroyed, 12544 bytes and 8 rows in hash table
494 2024.08.27 19:20:05.073858 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> DynamicQueryHandler: Done processing query
495 2024.08.27 19:20:05.073888 [ 3 ] {f1cb6a0d-b3a4-4b32-b4b5-07f27074ec9b} <Debug> MemoryTracker: Peak memory usage (for query): 4.00 MiB.
496 2024.08.27 19:20:05.073904 [ 3 ] {} <Debug> HTTP-Session: 96e4e428-4693-4521-93b5-b5e809e7f954 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
497 2024.08.27 19:20:05.075551 [ 3 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 409, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
498 2024.08.27 19:20:05.075659 [ 3 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
499 2024.08.27 19:20:05.075681 [ 3 ] {} <Debug> HTTP-Session: c9ae3c7a-de20-4e46-a82f-d23525dd1cd0 Authenticating user 'default' from [::1]:65512
500 2024.08.27 19:20:05.075721 [ 3 ] {} <Debug> HTTP-Session: c9ae3c7a-de20-4e46-a82f-d23525dd1cd0 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
501 2024.08.27 19:20:05.075732 [ 3 ] {} <Debug> HTTP-Session: c9ae3c7a-de20-4e46-a82f-d23525dd1cd0 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
502 2024.08.27 19:20:05.075790 [ 3 ] {} <Trace> HTTP-Session: c9ae3c7a-de20-4e46-a82f-d23525dd1cd0 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
503 2024.08.27 19:20:05.076152 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Debug> executeQuery: (from [::1]:65512) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (627643266003148065,4866144566314509062,5109363932695672526,6133729158133445591,6418373900407287174,7614030865733607559,9495597746874019221,15640909565249536871)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete)
504 2024.08.27 19:20:05.077047 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64
505 2024.08.27 19:20:05.077639 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64
506 2024.08.27 19:20:05.078128 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
507 2024.08.27 19:20:05.078174 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (627643266003148065, 4866144566314509062, 5109363932695672526, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 15640909565249536871)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
508 2024.08.27 19:20:05.078548 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local
509 2024.08.27 19:20:05.078647 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
510 2024.08.27 19:20:05.078763 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Trace> InterpreterSelectQuery: Complete -> Complete
511 2024.08.27 19:20:05.079111 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Key condition: (column 1 in 8-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
512 2024.08.27 19:20:05.079171 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps
513 2024.08.27 19:20:05.079221 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges
514 2024.08.27 19:20:05.079243 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Spreading ranges among streams with order
515 2024.08.27 19:20:05.079402 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (627643266003148065, 4866144566314509062, 5109363932695672526, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 15640909565249536871))", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
516 2024.08.27 19:20:05.079442 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0
517 2024.08.27 19:20:05.082200 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Debug> executeQuery: Read 400 rows, 25.78 KiB in 0.006253 sec., 63969.29473852551 rows/sec., 4.03 MiB/sec.
518 2024.08.27 19:20:05.082852 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Debug> DynamicQueryHandler: Done processing query
519 2024.08.27 19:20:05.082889 [ 3 ] {6a4e4871-22e9-427b-bc33-5e45b988ec1a} <Debug> MemoryTracker: Peak memory usage (for query): 3.99 MiB.
520 2024.08.27 19:20:05.082903 [ 3 ] {} <Debug> HTTP-Session: c9ae3c7a-de20-4e46-a82f-d23525dd1cd0 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
521 2024.08.27 19:20:06.000509 [ 246 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 107.76 MiB, peak 112.72 MiB, free memory in arenas 0.00 B, will set to 110.14 MiB (RSS), difference: 2.38 MiB
522 2024.08.27 19:20:06.079439 [ 247 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml'
523 2024.08.27 19:20:06.080741 [ 247 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration
524 2024.08.27 19:20:06.081510 [ 247 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration
525 2024.08.27 19:20:06.086984 [ 245 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml'
526 2024.08.27 19:20:06.088353 [ 245 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration
527 2024.08.27 19:20:06.089182 [ 245 ] {} <Information> Application: Setting max_server_memory_usage was set to 28.79 GiB (31.99 GiB available * 0.90 max_server_memory_usage_to_ram_ratio)
528 2024.08.27 19:20:06.089200 [ 245 ] {} <Information> Application: Setting merges_mutations_memory_usage_soft_limit was set to 16.00 GiB (31.99 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio)
529 2024.08.27 19:20:06.089225 [ 245 ] {} <Information> Application: Merges and mutations memory limit is set to 16.00 GiB
530 2024.08.27 19:20:06.089643 [ 245 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor
531 2024.08.27 19:20:06.089690 [ 245 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor
532 2024.08.27 19:20:06.089703 [ 245 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor
533 2024.08.27 19:20:06.089731 [ 245 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor
534 2024.08.27 19:20:06.090193 [ 245 ] {} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1
535 2024.08.27 19:20:06.090239 [ 245 ] {} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1
536 2024.08.27 19:20:06.093532 [ 245 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again.
537 2024.08.27 19:20:06.094306 [ 245 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration
538 2024.08.27 19:20:06.556486 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
539 2024.08.27 19:20:06.556517 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
540 2024.08.27 19:20:06.557423 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=11, queue_size=11, entries=query-0000000000..query-0000000010, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000009, last_skipped_entry_name=none
541 2024.08.27 19:20:06.557456 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000010
542 2024.08.27 19:20:06.557465 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000010
543 2024.08.27 19:20:06.561660 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000010 (CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b')
544 2024.08.27 19:20:06.567391 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b'
545 2024.08.27 19:20:06.567523 [ 244 ] {50c9aaae-93f2-4adf-bf5d-76a204cd968a} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 00225401-2519-48fa-8153-0a4188d42636) /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b' (stage: Complete)
546 2024.08.27 19:20:06.567687 [ 244 ] {50c9aaae-93f2-4adf-bf5d-76a204cd968a} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b'
547 2024.08.27 19:20:06.578751 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
548 2024.08.27 19:20:06.692139 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
549 2024.08.27 19:20:06.692256 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
550 2024.08.27 19:20:06.695666 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=12, queue_size=12, entries=query-0000000000..query-0000000011, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000010, last_skipped_entry_name=none
551 2024.08.27 19:20:06.695743 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000011
552 2024.08.27 19:20:06.695785 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000011
553 2024.08.27 19:20:06.697023 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000011 (CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp))
554 2024.08.27 19:20:06.700245 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)
555 2024.08.27 19:20:06.700467 [ 244 ] {aa71291c-7c9e-442d-a88d-ca0d5bad0fab} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6f6c813b-85a8-4f90-b375-647f513add95) /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete)
556 2024.08.27 19:20:06.700687 [ 244 ] {aa71291c-7c9e-442d-a88d-ca0d5bad0fab} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)
557 2024.08.27 19:20:06.711901 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
558 2024.08.27 19:20:06.818250 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
559 2024.08.27 19:20:06.818292 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
560 2024.08.27 19:20:06.819011 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=13, queue_size=13, entries=query-0000000000..query-0000000012, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000011, last_skipped_entry_name=none
561 2024.08.27 19:20:06.819077 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000012
562 2024.08.27 19:20:06.819088 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000012
563 2024.08.27 19:20:06.822945 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000012 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30))
564 2024.08.27 19:20:06.829048 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)
565 2024.08.27 19:20:06.829423 [ 244 ] {e6a0e741-516e-4fc3-8470-d3dbe95d13d1} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 60e1672f-1a93-42f4-bdb3-23817d9077bf) /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete)
566 2024.08.27 19:20:06.829736 [ 244 ] {e6a0e741-516e-4fc3-8470-d3dbe95d13d1} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)
567 2024.08.27 19:20:06.835820 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
568 2024.08.27 19:20:07.000271 [ 246 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 110.19 MiB, peak 123.14 MiB, free memory in arenas 0.00 B, will set to 123.58 MiB (RSS), difference: 13.39 MiB
569 2024.08.27 19:20:07.001855 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
570 2024.08.27 19:20:07.001895 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
571 2024.08.27 19:20:07.002292 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=14, queue_size=14, entries=query-0000000000..query-0000000013, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000012, last_skipped_entry_name=none
572 2024.08.27 19:20:07.002325 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000013
573 2024.08.27 19:20:07.002362 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000013
574 2024.08.27 19:20:07.006588 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000013 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])))
575 2024.08.27 19:20:07.017237 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
576 2024.08.27 19:20:07.017649 [ 244 ] {d3311414-7a74-49c3-8efe-99573e907cc2} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ee8e23ad-46b3-40df-b03c-32b65df97ae1) /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
577 2024.08.27 19:20:07.018007 [ 244 ] {d3311414-7a74-49c3-8efe-99573e907cc2} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
578 2024.08.27 19:20:07.023334 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
579 2024.08.27 19:20:07.130562 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
580 2024.08.27 19:20:07.130583 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
581 2024.08.27 19:20:07.134914 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=15, queue_size=15, entries=query-0000000000..query-0000000014, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000013, last_skipped_entry_name=none
582 2024.08.27 19:20:07.134984 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000014
583 2024.08.27 19:20:07.135025 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000014
584 2024.08.27 19:20:07.140949 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000014 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30))
585 2024.08.27 19:20:07.148398 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
586 2024.08.27 19:20:07.148797 [ 244 ] {9bbbcea1-0588-473c-aba5-e6f791ae6d65} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: eaf35fa9-e032-40af-9452-955864320874) /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete)
587 2024.08.27 19:20:07.149253 [ 244 ] {9bbbcea1-0588-473c-aba5-e6f791ae6d65} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
588 2024.08.27 19:20:07.155227 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
589 2024.08.27 19:20:07.273862 [ 4 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:44467, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
590 2024.08.27 19:20:07.274068 [ 4 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false
591 2024.08.27 19:20:07.274116 [ 4 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Replicated PartsService): Sending part all_0_0_0
592 2024.08.27 19:20:07.274997 [ 4 ] {} <Debug> InterserverIOHTTPHandler: Done processing query
593 2024.08.27 19:20:07.304258 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
594 2024.08.27 19:20:07.304287 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
595 2024.08.27 19:20:07.305076 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=16, queue_size=16, entries=query-0000000000..query-0000000015, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000014, last_skipped_entry_name=none
596 2024.08.27 19:20:07.305101 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000015
597 2024.08.27 19:20:07.305139 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000015
598 2024.08.27 19:20:07.310278 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000015 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])))
599 2024.08.27 19:20:07.313755 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
600 2024.08.27 19:20:07.314034 [ 244 ] {a1ca1924-2d39-4e9d-a7a9-726c146f0011} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8f0c970b-a421-4abd-b2da-5fbaf796d1ae) /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
601 2024.08.27 19:20:07.314435 [ 244 ] {a1ca1924-2d39-4e9d-a7a9-726c146f0011} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
602 2024.08.27 19:20:07.325773 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
603 2024.08.27 19:20:07.432954 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
604 2024.08.27 19:20:07.432964 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
605 2024.08.27 19:20:07.437198 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=17, queue_size=17, entries=query-0000000000..query-0000000016, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000015, last_skipped_entry_name=none
606 2024.08.27 19:20:07.437282 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000016
607 2024.08.27 19:20:07.437315 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000016
608 2024.08.27 19:20:07.439053 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000016 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30))
609 2024.08.27 19:20:07.447301 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
610 2024.08.27 19:20:07.447648 [ 244 ] {95d74268-12a9-4c34-b824-87d9c11cdbe5} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 35f235fc-dba9-407f-b58a-0f191ba3745f) /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete)
611 2024.08.27 19:20:07.448065 [ 244 ] {95d74268-12a9-4c34-b824-87d9c11cdbe5} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
612 2024.08.27 19:20:07.454471 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
613 2024.08.27 19:20:07.605863 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
614 2024.08.27 19:20:07.605883 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
615 2024.08.27 19:20:07.606316 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=18, queue_size=18, entries=query-0000000000..query-0000000017, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000016, last_skipped_entry_name=none
616 2024.08.27 19:20:07.606351 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000017
617 2024.08.27 19:20:07.606361 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000017
618 2024.08.27 19:20:07.607342 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000017 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])))
619 2024.08.27 19:20:07.619603 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))
620 2024.08.27 19:20:07.619944 [ 244 ] {25a2f02e-4608-461a-9203-e71fbbea5d98} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8) /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
621 2024.08.27 19:20:07.620446 [ 244 ] {25a2f02e-4608-461a-9203-e71fbbea5d98} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))
622 2024.08.27 19:20:07.629360 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
623 2024.08.27 19:20:07.742981 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
624 2024.08.27 19:20:07.743043 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
625 2024.08.27 19:20:07.743415 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=19, queue_size=19, entries=query-0000000000..query-0000000018, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000017, last_skipped_entry_name=none
626 2024.08.27 19:20:07.743451 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000018
627 2024.08.27 19:20:07.743459 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000018
628 2024.08.27 19:20:07.747797 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000018 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name))
629 2024.08.27 19:20:07.752586 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)
630 2024.08.27 19:20:07.753915 [ 244 ] {db2e785c-5f1c-4aff-b970-8f0273512e81} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6d401fb3-1fb6-4626-9ac6-8c45c8759efc) /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete)
631 2024.08.27 19:20:07.755420 [ 244 ] {db2e785c-5f1c-4aff-b970-8f0273512e81} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)
632 2024.08.27 19:20:07.759974 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
633 2024.08.27 19:20:07.902013 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
634 2024.08.27 19:20:07.902038 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
635 2024.08.27 19:20:07.902476 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000018, last_skipped_entry_name=none
636 2024.08.27 19:20:07.902504 [ 244 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000019
637 2024.08.27 19:20:07.902512 [ 244 ] {} <Trace> DDLWorker: Checking task query-0000000019
638 2024.08.27 19:20:07.906960 [ 244 ] {} <Debug> DDLWorker: Processing task query-0000000019 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])))
639 2024.08.27 19:20:07.910073 [ 244 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))
640 2024.08.27 19:20:07.910644 [ 244 ] {deba4f4d-bd3e-4ef0-a861-1e9937f3ff83} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d848e6a3-a4e5-4966-94fc-a41a0fa3e828) /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
641 2024.08.27 19:20:07.911601 [ 244 ] {deba4f4d-bd3e-4ef0-a861-1e9937f3ff83} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))
642 2024.08.27 19:20:07.917115 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
643 2024.08.27 19:20:08.319916 [ 108 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 7385ms
644 2024.08.27 19:20:09.113720 [ 108 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001
645 2024.08.27 19:20:09.118691 [ 108 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0]
646 2024.08.27 19:20:09.118730 [ 108 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
647 2024.08.27 19:20:09.125883 [ 241 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetching part all_1_1_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3
648 2024.08.27 19:20:09.129204 [ 241 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false
649 2024.08.27 19:20:09.129434 [ 241 ] {} <Trace> HTTPSessionAdapter: Created HTTP(S) session with ::1:19403 (::1:19403)
650 2024.08.27 19:20:09.130730 [ 241 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Trying to reserve 1.00 MiB using storage policy from min volume index 0
651 2024.08.27 19:20:09.130830 [ 241 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB.
652 2024.08.27 19:20:09.130845 [ 241 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
653 2024.08.27 19:20:09.130875 [ 241 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Downloading part all_1_1_0 onto disk default.
654 2024.08.27 19:20:09.145205 [ 241 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Download of part all_1_1_0 onto disk default finished.
655 2024.08.27 19:20:09.145301 [ 241 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
656 2024.08.27 19:20:09.145464 [ 241 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Committing part all_1_1_0 to zookeeper
657 2024.08.27 19:20:09.162426 [ 167 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001
658 2024.08.27 19:20:09.169991 [ 241 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Part all_1_1_0 committed to zookeeper
659 2024.08.27 19:20:09.170258 [ 241 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetched part all_1_1_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3
660 2024.08.27 19:20:09.170415 [ 108 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71804254208, merge_with_ttl_allowedtrue)
661 2024.08.27 19:20:09.170694 [ 108 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 10002ms
662 2024.08.27 19:20:09.184558 [ 167 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0]
663 2024.08.27 19:20:09.184606 [ 167 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
664 2024.08.27 19:20:09.199084 [ 196 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Fetching part all_1_1_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3
665 2024.08.27 19:20:09.199791 [ 196 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false
666 2024.08.27 19:20:09.200278 [ 167 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001
667 2024.08.27 19:20:09.201753 [ 196 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Trying to reserve 1.00 MiB using storage policy from min volume index 0
668 2024.08.27 19:20:09.201817 [ 196 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB.
669 2024.08.27 19:20:09.201841 [ 196 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
670 2024.08.27 19:20:09.201881 [ 196 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Downloading part all_1_1_0 onto disk default.
671 2024.08.27 19:20:09.204643 [ 167 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0]
672 2024.08.27 19:20:09.204699 [ 167 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
673 2024.08.27 19:20:09.205211 [ 196 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Fetcher): Download of part all_1_1_0 onto disk default finished.
674 2024.08.27 19:20:09.205268 [ 196 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
675 2024.08.27 19:20:09.205474 [ 196 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Committing part all_1_1_0 to zookeeper
676 2024.08.27 19:20:09.213860 [ 196 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Part all_1_1_0 committed to zookeeper
677 2024.08.27 19:20:09.213966 [ 196 ] {} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Fetched part all_1_1_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/3
678 2024.08.27 19:20:09.214110 [ 193 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Fetching part all_1_1_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/3
679 2024.08.27 19:20:09.214175 [ 98 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
680 2024.08.27 19:20:09.214212 [ 98 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 9936ms
681 2024.08.27 19:20:09.220093 [ 193 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false
682 2024.08.27 19:20:09.221447 [ 193 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Trying to reserve 1.00 MiB using storage policy from min volume index 0
683 2024.08.27 19:20:09.221511 [ 193 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB.
684 2024.08.27 19:20:09.221530 [ 193 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
685 2024.08.27 19:20:09.221561 [ 193 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Downloading part all_1_1_0 onto disk default.
686 2024.08.27 19:20:09.223577 [ 193 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Fetcher): Download of part all_1_1_0 onto disk default finished.
687 2024.08.27 19:20:09.223628 [ 193 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Renaming temporary part tmp-fetch_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
688 2024.08.27 19:20:09.223744 [ 193 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Committing part all_1_1_0 to zookeeper
689 2024.08.27 19:20:09.232357 [ 193 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Part all_1_1_0 committed to zookeeper
690 2024.08.27 19:20:09.232462 [ 193 ] {} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Fetched part all_1_1_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/3
691 2024.08.27 19:20:09.232586 [ 98 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
692 2024.08.27 19:20:09.232614 [ 98 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 9831ms
693 2024.08.27 19:20:09.325197 [ 3 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
694 2024.08.27 19:20:09.325391 [ 3 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
695 2024.08.27 19:20:09.325424 [ 3 ] {} <Debug> HTTP-Session: ae209baf-3efa-44ab-8436-23d4434d66de Authenticating user 'default' from [::1]:65512
696 2024.08.27 19:20:09.325461 [ 3 ] {} <Debug> HTTP-Session: ae209baf-3efa-44ab-8436-23d4434d66de Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
697 2024.08.27 19:20:09.325472 [ 3 ] {} <Debug> HTTP-Session: ae209baf-3efa-44ab-8436-23d4434d66de Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
698 2024.08.27 19:20:09.325548 [ 3 ] {} <Trace> HTTP-Session: ae209baf-3efa-44ab-8436-23d4434d66de Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
699 2024.08.27 19:20:09.326248 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> executeQuery: (from [::1]:65512) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete)
700 2024.08.27 19:20:09.327058 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
701 2024.08.27 19:20:09.327657 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
702 2024.08.27 19:20:09.328283 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
703 2024.08.27 19:20:09.329004 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
704 2024.08.27 19:20:09.330122 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
705 2024.08.27 19:20:09.330537 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> HashJoin: (0x1e6ef840) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
706 2024.08.27 19:20:09.330576 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> HashJoin: (0x1e6ef840) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
707 2024.08.27 19:20:09.330832 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> HashJoin: (0x1e6ef840) Join data is being destroyed, 12288 bytes and 0 rows in hash table
708 2024.08.27 19:20:09.331669 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
709 2024.08.27 19:20:09.332664 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
710 2024.08.27 19:20:09.332840 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> HashJoin: (0x1e6fe920) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
711 2024.08.27 19:20:09.332860 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> HashJoin: (0x1e6fe920) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
712 2024.08.27 19:20:09.335059 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
713 2024.08.27 19:20:09.336240 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
714 2024.08.27 19:20:09.336931 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
715 2024.08.27 19:20:09.337023 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
716 2024.08.27 19:20:09.337392 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local
717 2024.08.27 19:20:09.337502 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
718 2024.08.27 19:20:09.337587 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: Complete -> Complete
719 2024.08.27 19:20:09.337727 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> HashJoin: (0x1e754bb0) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0)
720 2024.08.27 19:20:09.337744 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> HashJoin: (0x1e754bb0) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)]
721 2024.08.27 19:20:09.338586 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
722 2024.08.27 19:20:09.339708 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
723 2024.08.27 19:20:09.340180 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
724 2024.08.27 19:20:09.340631 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
725 2024.08.27 19:20:09.340963 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
726 2024.08.27 19:20:09.341271 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local
727 2024.08.27 19:20:09.341410 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
728 2024.08.27 19:20:09.341502 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: Complete -> Complete
729 2024.08.27 19:20:09.341681 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> HashJoin: (0x1e77db50) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
730 2024.08.27 19:20:09.341701 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> HashJoin: (0x1e77db50) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
731 2024.08.27 19:20:09.341915 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> HashJoin: (0x1e6fe920) Join data is being destroyed, 12288 bytes and 0 rows in hash table
732 2024.08.27 19:20:09.342593 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
733 2024.08.27 19:20:09.343303 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
734 2024.08.27 19:20:09.343783 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
735 2024.08.27 19:20:09.343838 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
736 2024.08.27 19:20:09.344183 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local
737 2024.08.27 19:20:09.344300 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
738 2024.08.27 19:20:09.344431 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: Complete -> Complete
739 2024.08.27 19:20:09.344453 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
740 2024.08.27 19:20:09.344480 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)'
741 2024.08.27 19:20:09.344526 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)'
742 2024.08.27 19:20:09.344570 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
743 2024.08.27 19:20:09.344622 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)'
744 2024.08.27 19:20:09.344650 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)'
745 2024.08.27 19:20:09.345271 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
746 2024.08.27 19:20:09.345464 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
747 2024.08.27 19:20:09.345540 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (LEFT) boundary mark: 0
748 2024.08.27 19:20:09.345542 [ 260 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks)
749 2024.08.27 19:20:09.345595 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (RIGHT) boundary mark: 2
750 2024.08.27 19:20:09.345647 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found continuous range in 2 steps
751 2024.08.27 19:20:09.345912 [ 260 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (LEFT) boundary mark: 0
752 2024.08.27 19:20:09.345968 [ 260 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found (RIGHT) boundary mark: 2
753 2024.08.27 19:20:09.345981 [ 260 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Found continuous range in 2 steps
754 2024.08.27 19:20:09.346261 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges
755 2024.08.27 19:20:09.346300 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Spreading mark ranges among streams (default reading)
756 2024.08.27 19:20:09.346611 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> MergeTreeReadPool: min_marks_for_concurrent_read=24
757 2024.08.27 19:20:09.346660 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (SelectExecutor): Reading approx. 16 rows with 2 streams
758 2024.08.27 19:20:09.346757 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
759 2024.08.27 19:20:09.346851 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
760 2024.08.27 19:20:09.347079 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
761 2024.08.27 19:20:09.347207 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
762 2024.08.27 19:20:09.347249 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks)
763 2024.08.27 19:20:09.347264 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0
764 2024.08.27 19:20:09.347317 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0
765 2024.08.27 19:20:09.347332 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 1
766 2024.08.27 19:20:09.347356 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 1
767 2024.08.27 19:20:09.347407 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps
768 2024.08.27 19:20:09.347403 [ 259 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps
769 2024.08.27 19:20:09.347753 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges
770 2024.08.27 19:20:09.347785 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Spreading mark ranges among streams (default reading)
771 2024.08.27 19:20:09.347981 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> MergeTreeReadPool: min_marks_for_concurrent_read=24
772 2024.08.27 19:20:09.348006 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Reading approx. 32 rows with 2 streams
773 2024.08.27 19:20:09.348115 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
774 2024.08.27 19:20:09.348207 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
775 2024.08.27 19:20:09.348332 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)'
776 2024.08.27 19:20:09.348467 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)'
777 2024.08.27 19:20:09.348641 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
778 2024.08.27 19:20:09.348833 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
779 2024.08.27 19:20:09.348873 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0
780 2024.08.27 19:20:09.348887 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 2
781 2024.08.27 19:20:09.348900 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps
782 2024.08.27 19:20:09.348934 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks)
783 2024.08.27 19:20:09.348961 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (LEFT) boundary mark: 0
784 2024.08.27 19:20:09.348970 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found (RIGHT) boundary mark: 2
785 2024.08.27 19:20:09.348981 [ 255 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Found continuous range in 2 steps
786 2024.08.27 19:20:09.349142 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges
787 2024.08.27 19:20:09.349172 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Spreading mark ranges among streams (default reading)
788 2024.08.27 19:20:09.349373 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> MergeTreeReadPool: min_marks_for_concurrent_read=24
789 2024.08.27 19:20:09.349396 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (SelectExecutor): Reading approx. 32 rows with 2 streams
790 2024.08.27 19:20:09.349486 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
791 2024.08.27 19:20:09.349576 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
792 2024.08.27 19:20:09.349698 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)'
793 2024.08.27 19:20:09.349729 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)'
794 2024.08.27 19:20:09.356791 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> executeQuery: Read 80 rows, 5.78 KiB in 0.031 sec., 2580.6451612903224 rows/sec., 186.49 KiB/sec.
795 2024.08.27 19:20:09.357148 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> HashJoin: (0x1e77db50) Join data is being destroyed, 13312 bytes and 16 rows in hash table
796 2024.08.27 19:20:09.357356 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Trace> HashJoin: (0x1e754bb0) Join data is being destroyed, 12800 bytes and 16 rows in hash table
797 2024.08.27 19:20:09.358095 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> DynamicQueryHandler: Done processing query
798 2024.08.27 19:20:09.358125 [ 3 ] {e3633416-e222-4bf7-ae3c-5bd2fcb3a445} <Debug> MemoryTracker: Peak memory usage (for query): 5.16 MiB.
799 2024.08.27 19:20:09.358150 [ 3 ] {} <Debug> HTTP-Session: ae209baf-3efa-44ab-8436-23d4434d66de Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
800 2024.08.27 19:20:09.360118 [ 3 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:65512, User-Agent: (none), Length: 574, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
801 2024.08.27 19:20:09.360225 [ 3 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
802 2024.08.27 19:20:09.360248 [ 3 ] {} <Debug> HTTP-Session: 32818862-6341-4f6f-9f1d-666b4e25119e Authenticating user 'default' from [::1]:65512
803 2024.08.27 19:20:09.360285 [ 3 ] {} <Debug> HTTP-Session: 32818862-6341-4f6f-9f1d-666b4e25119e Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
804 2024.08.27 19:20:09.360296 [ 3 ] {} <Debug> HTTP-Session: 32818862-6341-4f6f-9f1d-666b4e25119e Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
805 2024.08.27 19:20:09.360366 [ 3 ] {} <Trace> HTTP-Session: 32818862-6341-4f6f-9f1d-666b4e25119e Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
806 2024.08.27 19:20:09.360769 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Debug> executeQuery: (from [::1]:65512) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (627643266003148065,875477573237006945,4866144566314509062,5109363932695672526,5458299684297804759,6133729158133445591,6418373900407287174,7614030865733607559,9495597746874019221,10554623360235070440,15640909565249536871,15773007174814909684,16012973074142820055,16258445060165149256,17045523200003126967,18285850980281983665)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete)
807 2024.08.27 19:20:09.361567 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64
808 2024.08.27 19:20:09.362221 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64
809 2024.08.27 19:20:09.362849 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
810 2024.08.27 19:20:09.362898 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (627643266003148065, 875477573237006945, 4866144566314509062, 5109363932695672526, 5458299684297804759, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 10554623360235070440, 15640909565249536871, 15773007174814909684, 16012973074142820055, 16258445060165149256, 17045523200003126967, 18285850980281983665)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
811 2024.08.27 19:20:09.363389 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local
812 2024.08.27 19:20:09.363496 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
813 2024.08.27 19:20:09.363614 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> InterpreterSelectQuery: Complete -> Complete
814 2024.08.27 19:20:09.363927 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Key condition: (column 1 in 16-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
815 2024.08.27 19:20:09.364090 [ 259 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps
816 2024.08.27 19:20:09.364178 [ 261 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Used generic exclusion search over index for part all_1_1_0 with 1 steps
817 2024.08.27 19:20:09.364420 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Debug> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges
818 2024.08.27 19:20:09.364456 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (SelectExecutor): Spreading ranges among streams with order
819 2024.08.27 19:20:09.364602 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (627643266003148065, 875477573237006945, 4866144566314509062, 5109363932695672526, 5458299684297804759, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 10554623360235070440, 15640909565249536871, 15773007174814909684, 16012973074142820055, 16258445060165149256, 17045523200003126967, 18285850980281983665))", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
820 2024.08.27 19:20:09.364629 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_1_1_0, approx. 400 rows starting from 0
821 2024.08.27 19:20:09.364732 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (627643266003148065, 875477573237006945, 4866144566314509062, 5109363932695672526, 5458299684297804759, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 10554623360235070440, 15640909565249536871, 15773007174814909684, 16012973074142820055, 16258445060165149256, 17045523200003126967, 18285850980281983665))", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
822 2024.08.27 19:20:09.364762 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0
823 2024.08.27 19:20:09.368305 [ 258 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Debug> MergingSortedTransform: Merge sorted 1 blocks, 800 rows in 0.003263082 sec., 245166.99243230786 rows/sec., 9.88 MiB/sec
824 2024.08.27 19:20:09.370201 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Debug> executeQuery: Read 800 rows, 51.56 KiB in 0.009605 sec., 83289.95314940135 rows/sec., 5.24 MiB/sec.
825 2024.08.27 19:20:09.371529 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Debug> DynamicQueryHandler: Done processing query
826 2024.08.27 19:20:09.371571 [ 3 ] {1bbe32cf-daec-421a-8d8a-636ed0b1eede} <Debug> MemoryTracker: Peak memory usage (for query): 4.14 MiB.
827 2024.08.27 19:20:09.371599 [ 3 ] {} <Debug> HTTP-Session: 32818862-6341-4f6f-9f1d-666b4e25119e Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
828 2024.08.27 19:20:10.464584 [ 5 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51482, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
829 2024.08.27 19:20:10.464740 [ 5 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F2&part=all_1_1_0&client_protocol_version=8&compress=false
830 2024.08.27 19:20:10.464803 [ 5 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (Replicated PartsService): Sending part all_1_1_0
831 2024.08.27 19:20:10.466024 [ 5 ] {} <Debug> InterserverIOHTTPHandler: Done processing query
832 2024.08.27 19:20:10.474051 [ 5 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51482, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
833 2024.08.27 19:20:10.474154 [ 5 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F2&part=all_1_1_0&client_protocol_version=8&compress=false
834 2024.08.27 19:20:10.474177 [ 5 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (Replicated PartsService): Sending part all_1_1_0
835 2024.08.27 19:20:10.474991 [ 5 ] {} <Debug> InterserverIOHTTPHandler: Done processing query
836 2024.08.27 19:20:10.892185 [ 252 ] {} <Error> ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below):
837 
838 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
839 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
840 2. DB::Exception::Exception<unsigned long&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type, std::type_identity<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >::type>, unsigned long&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&&) @ 0x000000000ac3631e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
841 3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000ac360fa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
842 4. Coordination::ZooKeeper::receiveEvent() @ 0x0000000016bafed2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
843 5. Coordination::ZooKeeper::receiveThread() @ 0x0000000016baf7d8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
844 6. std::_Function_handler<void (), ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node> > const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)> >&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node> > const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)> >&&)::$_1&&)::{lambda()#1}>::_M_invoke(std::_Any_data const&) @ 0x0000000016bb4b98 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
845 7. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
846 8. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32
847 9. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1
848 (version 23.8.7.1)
849 2024.08.27 19:20:10.892300 [ 252 ] {} <Information> ZooKeeperClient: Finalizing session 2. finalization_started: false, queue_finished: false, reason: 'Exception in receiveThread'
850 2024.08.27 19:20:10.892515 [ 252 ] {} <Trace> oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
851 2024.08.27 19:20:10.892584 [ 252 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
852 2024.08.27 19:20:10.892616 [ 252 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
853 2024.08.27 19:20:10.892660 [ 252 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
854 2024.08.27 19:20:10.892705 [ 252 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
855 2024.08.27 19:20:10.892627 [ 173 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
856 2024.08.27 19:20:10.892693 [ 75 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
857 2024.08.27 19:20:10.892730 [ 175 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
858 2024.08.27 19:20:10.892797 [ 173 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/2/is_active since session has been expired
859 2024.08.27 19:20:10.892810 [ 75 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/2/is_active since session has been expired
860 2024.08.27 19:20:10.892854 [ 173 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Waiting for threads to finish
861 2024.08.27 19:20:10.892873 [ 75 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Waiting for threads to finish
862 2024.08.27 19:20:10.892806 [ 179 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
863 2024.08.27 19:20:10.892856 [ 175 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/2/is_active since session has been expired
864 2024.08.27 19:20:10.892937 [ 175 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Waiting for threads to finish
865 2024.08.27 19:20:10.892911 [ 252 ] {} <Error> ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 134, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below):
866 
867 (version 23.8.7.1)
868 2024.08.27 19:20:10.892931 [ 179 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/2/is_active since session has been expired
869 2024.08.27 19:20:10.892994 [ 179 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Waiting for threads to finish
870 2024.08.27 19:20:10.892649 [ 167 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
871 2024.08.27 19:20:10.893113 [ 167 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/is_active since session has been expired
872 2024.08.27 19:20:10.893165 [ 167 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Waiting for threads to finish
873 2024.08.27 19:20:10.893190 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
874 2024.08.27 19:20:10.893235 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
875 2024.08.27 19:20:10.894008 [ 75 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Threads finished
876 2024.08.27 19:20:10.894040 [ 75 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper
877 2024.08.27 19:20:10.899241 [ 75 ] {} <Debug> ZooKeeperClient: Connected to a suboptimal ZooKeeper host ([::1]:19001, index 1). To preserve balance in ZooKeeper usage, this ZooKeeper session will expire in 17613 seconds
878 2024.08.27 19:20:10.899283 [ 75 ] {} <Information> ZooKeeperClient: Connected to ZooKeeper at [::1]:19001 with session_id 8
879 Poco::Exception. Code: 1000, e.code() = 146, Connection refused: [::1]:19002 (version 23.8.7.1), [::1]:19002
880 2024.08.27 19:20:10.900129 [ 75 ] {} <Information> ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled
881 2024.08.27 19:20:10.900149 [ 75 ] {} <Information> ZooKeeperClient: Keeper feature flag MULTI_READ: enabled
882 2024.08.27 19:20:10.900156 [ 75 ] {} <Information> ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled
883 2024.08.27 19:20:10.900168 [ 75 ] {} <Trace> ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003
884 2024.08.27 19:20:10.900187 [ 75 ] {} <Debug> Context: Establishing a new connection with ZooKeeper took 6 ms
885 2024.08.27 19:20:10.900197 [ 75 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
886 2024.08.27 19:20:10.903819 [ 179 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Threads finished
887 2024.08.27 19:20:10.903867 [ 179 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
888 2024.08.27 19:20:10.904017 [ 175 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Threads finished
889 2024.08.27 19:20:10.904059 [ 175 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
890 2024.08.27 19:20:10.904214 [ 173 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Threads finished
891 2024.08.27 19:20:10.904249 [ 173 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up
892 2024.08.27 19:20:10.909381 [ 244 ] {} <Information> DDLWorker: Lost ZooKeeper connection, will try to connect again: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):
893 
894 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
895 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
896 2. DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x000000000ffe19c6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
897 3. Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x0000000016bb6e38 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
898 4. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000016bb14ce in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
899 5. Coordination::ZooKeeper::list(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, Coordination::ListRequestType, std::function<void (Coordination::ListResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >) @ 0x0000000016bb37d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
900 6. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >, Coordination::ListRequestType) @ 0x0000000016b76078 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
901 7. zkutil::ZooKeeper::getChildrenImpl(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >, Coordination::ListRequestType) @ 0x0000000016b75c75 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
902 8. zkutil::ZooKeeper::tryGetChildrenWatch(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >, Coordination::ListRequestType) @ 0x0000000016b7679a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
903 9. zkutil::ZooKeeper::tryGetChildren(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::ListRequestType) @ 0x0000000016b762bf in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
904 10. zkutil::ZooKeeper::getChildren(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::ListRequestType) @ 0x0000000016b7618d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
905 11. DB::DDLWorker::scheduleTasks(bool) @ 0x0000000014ebf5c2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
906 12. DB::DDLWorker::runMainThread() @ 0x0000000014ebbf2e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
907 13. ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::{lambda()#1}::operator()() @ 0x0000000014ecd995 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
908 14. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
909 15. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32
910 16. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1
911 (version 23.8.7.1)
912 2024.08.27 19:20:10.915166 [ 75 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
913 2024.08.27 19:20:10.920913 [ 51 ] {} <Error> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): void DB::StorageReplicatedMergeTree::mutationsUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):
914 
915 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
916 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
917 2. DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x000000000ffe19c6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
918 3. Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x0000000016bb6e38 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
919 4. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000016bb14ce in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
920 5. Coordination::ZooKeeper::list(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, Coordination::ListRequestType, std::function<void (Coordination::ListResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >) @ 0x0000000016bb37d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
921 6. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >, Coordination::ListRequestType) @ 0x0000000016b76078 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
922 7. zkutil::ZooKeeper::getChildrenImpl(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >, Coordination::ListRequestType) @ 0x0000000016b75c75 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
923 8. zkutil::ZooKeeper::tryGetChildrenWatch(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >, Coordination::ListRequestType) @ 0x0000000016b7679a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
924 9. zkutil::ZooKeeper::getChildrenWatch(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >, Coordination::ListRequestType) @ 0x0000000016b76660 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
925 10. DB::ReplicatedMergeTreeQueue::updateMutations(std::shared_ptr<zkutil::ZooKeeper>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >) @ 0x00000000159cb716 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
926 11. DB::StorageReplicatedMergeTree::mutationsUpdatingTask() @ 0x000000001560a701 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
927 12. DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000014a568cf in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
928 13. DB::BackgroundSchedulePool::threadFunction() @ 0x0000000014a5967e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
929 14. std::_Function_handler<void (), ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_1>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_1&&)::{lambda()#1}>::_M_invoke(std::_Any_data const&) @ 0x0000000014a59dd8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
930 15. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
931 16. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32
932 17. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1
933 (version 23.8.7.1)
934 2024.08.27 19:20:10.925377 [ 75 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized
935 2024.08.27 19:20:10.925430 [ 75 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue
936 2024.08.27 19:20:10.930036 [ 107 ] {} <Error> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): void DB::StorageReplicatedMergeTree::queueUpdatingTask(): Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):
937 
938 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
939 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
940 2. DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x000000000ffe19c6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
941 3. Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x0000000016bb6e38 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
942 4. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000016bb14ce in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
943 5. Coordination::ZooKeeper::get(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::function<void (Coordination::GetResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >) @ 0x0000000016bb2f2d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
944 6. zkutil::ZooKeeper::asyncTryGetNoThrow(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::function<void (Coordination::WatchResponse const&)>) @ 0x0000000016b78d10 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
945 7. zkutil::ZooKeeper::getImpl(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>) @ 0x0000000016b788e1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
946 8. zkutil::ZooKeeper::tryGetWatch(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, Coordination::Stat*, std::function<void (Coordination::WatchResponse const&)>, Coordination::Error*) @ 0x0000000016b79266 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
947 9. zkutil::ZooKeeper::get(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&) @ 0x0000000016b78ea0 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
948 10. DB::ReplicatedMergeTreeQueue::pullLogsToQueue(std::shared_ptr<zkutil::ZooKeeper>, std::function<void (Coordination::WatchResponse const&)>, DB::ReplicatedMergeTreeQueue::PullLogsReason) @ 0x00000000159c640b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
949 11. DB::StorageReplicatedMergeTree::queueUpdatingTask() @ 0x000000001560a3a5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
950 12. DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x0000000014a568cf in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
951 13. DB::BackgroundSchedulePool::threadFunction() @ 0x0000000014a5967e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
952 14. std::_Function_handler<void (), ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_1>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_1&&)::{lambda()#1}>::_M_invoke(std::_Any_data const&) @ 0x0000000014a59dd8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
953 15. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
954 16. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32
955 17. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1
956 (version 23.8.7.1)
957 2024.08.27 19:20:10.930715 [ 75 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
958 2024.08.27 19:20:10.931086 [ 167 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Threads finished
959 2024.08.27 19:20:10.931134 [ 167 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
960 2024.08.27 19:20:10.935200 [ 75 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue
961 2024.08.27 19:20:10.935230 [ 179 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue
962 2024.08.27 19:20:10.936009 [ 179 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized
963 2024.08.27 19:20:10.936046 [ 179 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue
964 2024.08.27 19:20:10.936461 [ 175 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue
965 2024.08.27 19:20:10.939729 [ 173 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue
966 2024.08.27 19:20:10.939764 [ 179 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
967 2024.08.27 19:20:10.939800 [ 175 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized
968 2024.08.27 19:20:10.939876 [ 175 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue
969 2024.08.27 19:20:10.943740 [ 173 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Queue initialized
970 2024.08.27 19:20:10.943755 [ 179 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue
971 2024.08.27 19:20:10.943817 [ 173 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue
972 2024.08.27 19:20:10.944619 [ 175 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
973 2024.08.27 19:20:10.944738 [ 167 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
974 2024.08.27 19:20:10.944798 [ 173 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
975 2024.08.27 19:20:10.945075 [ 175 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue
976 2024.08.27 19:20:10.945170 [ 167 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized
977 2024.08.27 19:20:10.945196 [ 167 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue
978 2024.08.27 19:20:10.945330 [ 173 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Loaded queue
979 2024.08.27 19:20:10.945645 [ 167 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
980 2024.08.27 19:20:10.946193 [ 167 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue
981 2024.08.27 19:20:10.946297 [ 75 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
982 2024.08.27 19:20:10.946402 [ 51 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
983 2024.08.27 19:20:10.946428 [ 51 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 12110ms
984 2024.08.27 19:20:10.947800 [ 133 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks
985 2024.08.27 19:20:10.947912 [ 179 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully
986 2024.08.27 19:20:10.948043 [ 185 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
987 2024.08.27 19:20:10.948075 [ 185 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 12179ms
988 2024.08.27 19:20:10.948439 [ 175 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully
989 2024.08.27 19:20:10.948668 [ 75 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
990 2024.08.27 19:20:10.948877 [ 173 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully
991 2024.08.27 19:20:10.948897 [ 75 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 10119ms
992 2024.08.27 19:20:10.948948 [ 102 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 9637ms
993 2024.08.27 19:20:10.949587 [ 133 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 8198ms, ratio: 0, points per minute: 0)
994 2024.08.27 19:20:10.950177 [ 167 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
995 2024.08.27 19:20:10.950347 [ 41 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks
996 2024.08.27 19:20:10.950370 [ 47 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/timeseries_schema_local/blocks
997 2024.08.27 19:20:10.950316 [ 75 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
998 2024.08.27 19:20:10.950534 [ 75 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 12324ms
999 2024.08.27 19:20:10.950811 [ 175 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 8671ms, ratio: 0, points per minute: 0)
1000 2024.08.27 19:20:10.951287 [ 47 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 7457ms, ratio: 0, points per minute: 0)
1001 2024.08.27 19:20:10.951521 [ 41 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 7884ms, ratio: 0, points per minute: 0)
1002 2024.08.27 19:20:10.951548 [ 173 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks
1003 2024.08.27 19:20:10.952108 [ 173 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 8496ms, ratio: 0, points per minute: 0)
1004 2024.08.27 19:20:10.955879 [ 173 ] {} <Debug> DNSResolver: Updating DNS cache
1005 2024.08.27 19:20:10.955922 [ 173 ] {} <Debug> DNSResolver: Updated DNS cache
1006 2024.08.27 19:20:11.001098 [ 246 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 123.82 MiB, peak 129.88 MiB, free memory in arenas 0.00 B, will set to 129.93 MiB (RSS), difference: 6.11 MiB
1007 2024.08.27 19:20:11.771641 [ 173 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000002 - log-0000000002
1008 2024.08.27 19:20:11.776530 [ 173 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_2_2_0]
1009 2024.08.27 19:20:11.776579 [ 173 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
1010 2024.08.27 19:20:11.778647 [ 239 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetching part all_2_2_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3
1011 2024.08.27 19:20:11.779366 [ 239 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19403/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_2_2_0&client_protocol_version=8&compress=false
1012 2024.08.27 19:20:11.786434 [ 239 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Trying to reserve 1.00 MiB using storage policy from min volume index 0
1013 2024.08.27 19:20:11.786495 [ 239 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB.
1014 2024.08.27 19:20:11.786508 [ 239 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
1015 2024.08.27 19:20:11.786535 [ 239 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Downloading part all_2_2_0 onto disk default.
1016 2024.08.27 19:20:11.788564 [ 239 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Fetcher): Download of part all_2_2_0 onto disk default finished.
1017 2024.08.27 19:20:11.788605 [ 239 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Renaming temporary part tmp-fetch_all_2_2_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
1018 2024.08.27 19:20:11.788712 [ 239 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Committing part all_2_2_0 to zookeeper
1019 2024.08.27 19:20:11.797067 [ 239 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Part all_2_2_0 committed to zookeeper
1020 2024.08.27 19:20:11.797179 [ 239 ] {} <Debug> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Fetched part all_2_2_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/3
1021 2024.08.27 19:20:11.797281 [ 107 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
1022 2024.08.27 19:20:11.797315 [ 107 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 14827ms
1023 2024.08.27 19:20:11.909592 [ 244 ] {} <Debug> DDLWorker: Initializing DDLWorker thread
1024 2024.08.27 19:20:11.913538 [ 244 ] {} <Debug> DDLWorker: Initialized DDLWorker thread
1025 2024.08.27 19:20:11.913607 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
1026 2024.08.27 19:20:11.913621 [ 244 ] {} <Information> DDLWorker: Have 1 unfinished tasks, will check them
1027 2024.08.27 19:20:11.913645 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
1028 2024.08.27 19:20:11.914200 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000019, last_skipped_entry_name=none
1029 2024.08.27 19:20:11.914235 [ 244 ] {} <Debug> DDLWorker: No tasks to schedule
1030 2024.08.27 19:20:11.914245 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
1031 2024.08.27 19:20:12.083921 [ 247 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml'
1032 2024.08.27 19:20:12.085744 [ 247 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration
1033 2024.08.27 19:20:12.086828 [ 247 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration
1034 2024.08.27 19:20:12.095852 [ 245 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml'
1035 2024.08.27 19:20:12.097008 [ 245 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performing update on configuration
1036 2024.08.27 19:20:12.097621 [ 245 ] {} <Information> Application: Setting max_server_memory_usage was set to 28.79 GiB (31.99 GiB available * 0.90 max_server_memory_usage_to_ram_ratio)
1037 2024.08.27 19:20:12.097635 [ 245 ] {} <Information> Application: Setting merges_mutations_memory_usage_soft_limit was set to 16.00 GiB (31.99 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio)
1038 2024.08.27 19:20:12.097647 [ 245 ] {} <Information> Application: Merges and mutations memory limit is set to 16.00 GiB
1039 2024.08.27 19:20:12.098002 [ 245 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor
1040 2024.08.27 19:20:12.098021 [ 245 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor
1041 2024.08.27 19:20:12.098031 [ 245 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor
1042 2024.08.27 19:20:12.098040 [ 245 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor
1043 2024.08.27 19:20:12.098074 [ 245 ] {} <Information> ZooKeeperClient: Finalizing session 8. finalization_started: false, queue_finished: false, reason: 'Config changed'
1044 2024.08.27 19:20:12.098217 [ 245 ] {} <Trace> oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
1045 2024.08.27 19:20:12.098268 [ 245 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
1046 2024.08.27 19:20:12.098296 [ 245 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
1047 2024.08.27 19:20:12.098307 [ 107 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
1048 2024.08.27 19:20:12.098351 [ 245 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
1049 2024.08.27 19:20:12.098331 [ 41 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
1050 2024.08.27 19:20:12.098412 [ 245 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
1051 2024.08.27 19:20:12.098402 [ 107 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/2/is_active since session has been expired
1052 2024.08.27 19:20:12.098437 [ 41 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/is_active since session has been expired
1053 2024.08.27 19:20:12.098445 [ 107 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Waiting for threads to finish
1054 2024.08.27 19:20:12.098390 [ 173 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
1055 2024.08.27 19:20:12.098465 [ 41 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Waiting for threads to finish
1056 2024.08.27 19:20:12.098516 [ 173 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/2/is_active since session has been expired
1057 2024.08.27 19:20:12.098492 [ 172 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
1058 2024.08.27 19:20:12.098550 [ 173 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Waiting for threads to finish
1059 2024.08.27 19:20:12.098581 [ 172 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/2/is_active since session has been expired
1060 2024.08.27 19:20:12.098610 [ 172 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Waiting for threads to finish
1061 2024.08.27 19:20:12.098604 [ 47 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
1062 2024.08.27 19:20:12.098673 [ 47 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/2/is_active since session has been expired
1063 2024.08.27 19:20:12.098682 [ 47 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Waiting for threads to finish
1064 2024.08.27 19:20:12.098810 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
1065 2024.08.27 19:20:12.098838 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
1066 2024.08.27 19:20:12.099136 [ 244 ] {} <Information> DDLWorker: Lost ZooKeeper connection, will try to connect again: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):
1067 
1068 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1069 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1070 2. DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x000000000ffe19c6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1071 3. Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x0000000016bb6e38 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1072 4. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000016bb14ce in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1073 5. Coordination::ZooKeeper::list(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, Coordination::ListRequestType, std::function<void (Coordination::ListResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >) @ 0x0000000016bb37d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1074 6. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >, Coordination::ListRequestType) @ 0x0000000016b76078 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1075 7. zkutil::ZooKeeper::getChildrenImpl(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >, Coordination::ListRequestType) @ 0x0000000016b75c75 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1076 8. zkutil::ZooKeeper::tryGetChildrenWatch(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)> >, Coordination::ListRequestType) @ 0x0000000016b7679a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1077 9. zkutil::ZooKeeper::tryGetChildren(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::ListRequestType) @ 0x0000000016b762bf in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1078 10. zkutil::ZooKeeper::getChildren(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::ListRequestType) @ 0x0000000016b7618d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1079 11. DB::DDLWorker::scheduleTasks(bool) @ 0x0000000014ebf5c2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1080 12. DB::DDLWorker::runMainThread() @ 0x0000000014ebbf2e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1081 13. ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::{lambda()#1}::operator()() @ 0x0000000014ecd995 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1082 14. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1083 15. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32
1084 16. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1
1085 (version 23.8.7.1)
1086 2024.08.27 19:20:12.099207 [ 107 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Threads finished
1087 2024.08.27 19:20:12.099704 [ 47 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Threads finished
1088 2024.08.27 19:20:12.099991 [ 172 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Threads finished
1089 2024.08.27 19:20:12.100730 [ 173 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Threads finished
1090 2024.08.27 19:20:12.101237 [ 41 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Threads finished
1091 2024.08.27 19:20:12.104082 [ 245 ] {} <Information> ZooKeeperClient: Connected to ZooKeeper at [::1]:19003 with session_id 11
1092 2024.08.27 19:20:12.104459 [ 245 ] {} <Information> ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled
1093 2024.08.27 19:20:12.104480 [ 245 ] {} <Information> ZooKeeperClient: Keeper feature flag MULTI_READ: enabled
1094 2024.08.27 19:20:12.104490 [ 245 ] {} <Information> ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled
1095 2024.08.27 19:20:12.104500 [ 245 ] {} <Trace> ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19003
1096 2024.08.27 19:20:12.104573 [ 41 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1097 2024.08.27 19:20:12.104614 [ 173 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1098 2024.08.27 19:20:12.104645 [ 172 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1099 2024.08.27 19:20:12.104696 [ 47 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1100 2024.08.27 19:20:12.104731 [ 245 ] {} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1
1101 2024.08.27 19:20:12.104743 [ 107 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1102 2024.08.27 19:20:12.104766 [ 245 ] {} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1
1103 2024.08.27 19:20:12.105153 [ 245 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again.
1104 2024.08.27 19:20:12.105195 [ 245 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-2/clickhouse-config.xml', performed update on configuration
1105 2024.08.27 19:20:12.114282 [ 41 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1106 2024.08.27 19:20:12.114319 [ 173 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1107 2024.08.27 19:20:12.114383 [ 172 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1108 2024.08.27 19:20:12.114395 [ 47 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1109 2024.08.27 19:20:12.114612 [ 107 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue
1110 2024.08.27 19:20:12.114645 [ 41 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized
1111 2024.08.27 19:20:12.114683 [ 41 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/2/queue
1112 2024.08.27 19:20:12.114705 [ 173 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized
1113 2024.08.27 19:20:12.114745 [ 173 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/2/queue
1114 2024.08.27 19:20:12.114764 [ 172 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized
1115 2024.08.27 19:20:12.114814 [ 47 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized
1116 2024.08.27 19:20:12.114826 [ 172 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/2/queue
1117 2024.08.27 19:20:12.114846 [ 47 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/2/queue
1118 2024.08.27 19:20:12.115201 [ 107 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Queue initialized
1119 2024.08.27 19:20:12.115205 [ 41 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1120 2024.08.27 19:20:12.115221 [ 173 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1121 2024.08.27 19:20:12.115258 [ 172 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1122 2024.08.27 19:20:12.115257 [ 107 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/2/queue
1123 2024.08.27 19:20:12.115333 [ 47 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1124 2024.08.27 19:20:12.115612 [ 41 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue
1125 2024.08.27 19:20:12.115719 [ 107 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1126 2024.08.27 19:20:12.115866 [ 172 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue
1127 2024.08.27 19:20:12.115895 [ 47 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue
1128 2024.08.27 19:20:12.115988 [ 173 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue
1129 2024.08.27 19:20:12.116126 [ 107 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Loaded queue
1130 2024.08.27 19:20:12.118436 [ 172 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1131 2024.08.27 19:20:12.118464 [ 47 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1132 2024.08.27 19:20:12.118771 [ 65 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
1133 2024.08.27 19:20:12.118886 [ 65 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 15526ms
1134 2024.08.27 19:20:12.119579 [ 41 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1135 2024.08.27 19:20:12.119713 [ 73 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
1136 2024.08.27 19:20:12.119712 [ 110 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
1137 2024.08.27 19:20:12.119794 [ 110 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 15055ms
1138 2024.08.27 19:20:12.119740 [ 73 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 13241ms
1139 2024.08.27 19:20:12.120303 [ 107 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully
1140 2024.08.27 19:20:12.120346 [ 173 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1141 2024.08.27 19:20:12.120475 [ 61 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 11695ms
1142 2024.08.27 19:20:12.120657 [ 41 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue)
1143 2024.08.27 19:20:12.120742 [ 41 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 19454ms
1144 2024.08.27 19:20:12.121787 [ 47 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1170ms, ratio: 0, points per minute: 0)
1145 2024.08.27 19:20:12.121809 [ 167 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1169ms, ratio: 0, points per minute: 0)
1146 2024.08.27 19:20:12.121877 [ 106 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1170ms, ratio: 0, points per minute: 0)
1147 2024.08.27 19:20:12.122198 [ 158 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks
1148 2024.08.27 19:20:12.122420 [ 107 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1172ms, ratio: 0, points per minute: 0)
1149 2024.08.27 19:20:12.122993 [ 158 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1174ms, ratio: 0, points per minute: 0)
1150 2024.08.27 19:20:12.524214 [ 5 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51482, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
1151 2024.08.27 19:20:12.524351 [ 5 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F2&part=all_2_2_0&client_protocol_version=8&compress=false
1152 2024.08.27 19:20:12.524378 [ 5 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (Replicated PartsService): Sending part all_2_2_0
1153 2024.08.27 19:20:12.525179 [ 5 ] {} <Debug> InterserverIOHTTPHandler: Done processing query
1154 2024.08.27 19:20:13.000495 [ 246 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 136.43 MiB, peak 137.43 MiB, free memory in arenas 0.00 B, will set to 129.98 MiB (RSS), difference: -6.45 MiB
1155 2024.08.27 19:20:13.099358 [ 244 ] {} <Debug> DDLWorker: Initializing DDLWorker thread
1156 2024.08.27 19:20:13.710838 [ 244 ] {} <Debug> DDLWorker: Initialized DDLWorker thread
1157 2024.08.27 19:20:13.710893 [ 244 ] {} <Debug> DDLWorker: Scheduling tasks
1158 2024.08.27 19:20:13.710907 [ 244 ] {} <Information> DDLWorker: Have 1 unfinished tasks, will check them
1159 2024.08.27 19:20:13.710927 [ 249 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
1160 2024.08.27 19:20:13.711441 [ 244 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000019, last_skipped_entry_name=none
1161 2024.08.27 19:20:13.711471 [ 244 ] {} <Debug> DDLWorker: No tasks to schedule
1162 2024.08.27 19:20:13.711482 [ 244 ] {} <Debug> DDLWorker: Waiting for queue updates
1163 2024.08.27 19:20:14.000415 [ 246 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 125.97 MiB, peak 137.43 MiB, free memory in arenas 0.00 B, will set to 129.98 MiB (RSS), difference: 4.00 MiB
1164 2024.08.27 19:20:23.815774 [ 75 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 14212ms
1165 2024.08.27 19:20:25.361128 [ 106 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803183104, merge_with_ttl_allowedtrue)
1166 2024.08.27 19:20:25.361224 [ 106 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 17143ms
1167 2024.08.27 19:20:25.956108 [ 106 ] {} <Debug> DNSResolver: Updating DNS cache
1168 2024.08.27 19:20:25.956197 [ 106 ] {} <Debug> DNSResolver: Updated DNS cache
1169 2024.08.27 19:20:27.175030 [ 133 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803183104, merge_with_ttl_allowedtrue)
1170 2024.08.27 19:20:27.175067 [ 133 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 18308ms
1171 2024.08.27 19:20:27.645179 [ 133 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803183104, merge_with_ttl_allowedtrue)
1172 2024.08.27 19:20:27.645217 [ 133 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 20460ms
1173 2024.08.27 19:20:31.575101 [ 106 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803604992, merge_with_ttl_allowedtrue)
1174 2024.08.27 19:20:31.575229 [ 106 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 25536ms
1175 2024.08.27 19:20:38.028226 [ 167 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 18109ms
1176 2024.08.27 19:20:40.956554 [ 73 ] {} <Debug> DNSResolver: Updating DNS cache
1177 2024.08.27 19:20:40.956727 [ 73 ] {} <Debug> DNSResolver: Updated DNS cache
1178 2024.08.27 19:20:42.504475 [ 172 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71801022464, merge_with_ttl_allowedtrue)
1179 2024.08.27 19:20:42.504531 [ 172 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 22351ms
1180 2024.08.27 19:20:45.483344 [ 172 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71799371776, merge_with_ttl_allowedtrue)
1181 2024.08.27 19:20:45.483409 [ 172 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 23778ms
1182 2024.08.27 19:20:48.105478 [ 73 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71799371776, merge_with_ttl_allowedtrue)
1183 2024.08.27 19:20:48.105518 [ 73 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 25827ms
1184 2024.08.27 19:20:55.956930 [ 61 ] {} <Debug> DNSResolver: Updating DNS cache
1185 2024.08.27 19:20:55.957129 [ 61 ] {} <Debug> DNSResolver: Updated DNS cache
1186 2024.08.27 19:20:56.137776 [ 61 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 23408ms
1187 2024.08.27 19:20:57.111758 [ 61 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814950912, merge_with_ttl_allowedtrue)
1188 2024.08.27 19:20:57.111858 [ 61 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 32136ms
1189 2024.08.27 19:21:04.855879 [ 41 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71813126144, merge_with_ttl_allowedtrue)
1190 2024.08.27 19:21:04.855991 [ 41 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 29492ms
1191 2024.08.27 19:21:09.261702 [ 41 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71811354624, merge_with_ttl_allowedtrue)
1192 2024.08.27 19:21:09.261798 [ 41 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 30041ms
1193 2024.08.27 19:21:10.957721 [ 156 ] {} <Debug> DNSResolver: Updating DNS cache
1194 2024.08.27 19:21:10.957891 [ 156 ] {} <Debug> DNSResolver: Updated DNS cache
1195 2024.08.27 19:21:13.932753 [ 156 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71811354624, merge_with_ttl_allowedtrue)
1196 2024.08.27 19:21:13.932836 [ 156 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 33485ms
1197 2024.08.27 19:21:19.546094 [ 110 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 28517ms
1198 2024.08.27 19:21:25.958069 [ 156 ] {} <Debug> DNSResolver: Updating DNS cache
1199 2024.08.27 19:21:25.958225 [ 156 ] {} <Debug> DNSResolver: Updated DNS cache
1200 2024.08.27 19:21:29.248220 [ 31 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814907904, merge_with_ttl_allowedtrue)
1201 2024.08.27 19:21:29.248324 [ 31 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 39612ms
1202 2024.08.27 19:21:34.348247 [ 31 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814109184, merge_with_ttl_allowedtrue)
1203 2024.08.27 19:21:34.348308 [ 31 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 37353ms
1204 2024.08.27 19:21:39.302998 [ 31 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71812505600, merge_with_ttl_allowedtrue)
1205 2024.08.27 19:21:39.303048 [ 31 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 37519ms
1206 2024.08.27 19:21:40.958477 [ 31 ] {} <Debug> DNSResolver: Updating DNS cache
1207 2024.08.27 19:21:40.958596 [ 31 ] {} <Debug> DNSResolver: Updated DNS cache
1208 2024.08.27 19:21:47.418171 [ 141 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71811112960, merge_with_ttl_allowedtrue)
1209 2024.08.27 19:21:47.418263 [ 141 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 43628ms
1210 2024.08.27 19:21:48.063354 [ 141 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 35400ms
1211 2024.08.27 19:21:55.958762 [ 152 ] {} <Debug> DNSResolver: Updating DNS cache
1212 2024.08.27 19:21:55.958853 [ 152 ] {} <Debug> DNSResolver: Updated DNS cache
1213 2024.08.27 19:21:57.001180 [ 246 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000394289 sec.
1214 2024.08.27 19:22:08.860687 [ 152 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71805247488, merge_with_ttl_allowedtrue)
1215 2024.08.27 19:22:08.860790 [ 152 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 50074ms
1216 2024.08.27 19:22:10.959029 [ 152 ] {} <Debug> DNSResolver: Updating DNS cache
1217 2024.08.27 19:22:10.959117 [ 152 ] {} <Debug> DNSResolver: Updated DNS cache
1218 2024.08.27 19:22:11.701618 [ 152 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71804381184, merge_with_ttl_allowedtrue)
1219 2024.08.27 19:22:11.701704 [ 152 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 47814ms
1220 2024.08.27 19:22:16.822450 [ 160 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71802933248, merge_with_ttl_allowedtrue)
1221 2024.08.27 19:22:16.822564 [ 160 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 47882ms
1222 2024.08.27 19:22:23.463695 [ 162 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 45272ms
1223 2024.08.27 19:22:25.959242 [ 162 ] {} <Debug> DNSResolver: Updating DNS cache
1224 2024.08.27 19:22:25.959318 [ 162 ] {} <Debug> DNSResolver: Updated DNS cache
1225 2024.08.27 19:22:31.046600 [ 162 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71798589440, merge_with_ttl_allowedtrue)
1226 2024.08.27 19:22:31.046703 [ 162 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 52385ms
1227 2024.08.27 19:22:40.959439 [ 162 ] {} <Debug> DNSResolver: Updating DNS cache
1228 2024.08.27 19:22:40.959519 [ 162 ] {} <Debug> DNSResolver: Updated DNS cache
1229 2024.08.27 19:22:55.959648 [ 91 ] {} <Debug> DNSResolver: Updating DNS cache
1230 2024.08.27 19:22:55.959739 [ 91 ] {} <Debug> DNSResolver: Updated DNS cache
1231 2024.08.27 19:22:58.935081 [ 99 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71791093760, merge_with_ttl_allowedtrue)
1232 2024.08.27 19:22:58.935130 [ 99 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1233 2024.08.27 19:22:59.515958 [ 99 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71790032896, merge_with_ttl_allowedtrue)
1234 2024.08.27 19:22:59.516130 [ 99 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 58845ms
1235 2024.08.27 19:23:04.704854 [ 91 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71788423168, merge_with_ttl_allowedtrue)
1236 2024.08.27 19:23:04.704924 [ 91 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1237 2024.08.27 19:23:08.735996 [ 118 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 56952ms
1238 2024.08.27 19:23:10.959907 [ 118 ] {} <Debug> DNSResolver: Updating DNS cache
1239 2024.08.27 19:23:10.959994 [ 118 ] {} <Debug> DNSResolver: Updated DNS cache
1240 2024.08.27 19:23:23.432132 [ 112 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71784536064, merge_with_ttl_allowedtrue)
1241 2024.08.27 19:23:23.432236 [ 112 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1242 2024.08.27 19:23:25.960237 [ 112 ] {} <Debug> DNSResolver: Updating DNS cache
1243 2024.08.27 19:23:25.960411 [ 112 ] {} <Debug> DNSResolver: Updated DNS cache
1244 2024.08.27 19:23:40.960575 [ 112 ] {} <Debug> DNSResolver: Updating DNS cache
1245 2024.08.27 19:23:40.960706 [ 112 ] {} <Debug> DNSResolver: Updated DNS cache
1246 2024.08.27 19:23:55.960858 [ 39 ] {} <Debug> DNSResolver: Updating DNS cache
1247 2024.08.27 19:23:55.961068 [ 39 ] {} <Debug> DNSResolver: Updated DNS cache
1248 2024.08.27 19:23:57.001273 [ 246 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000413258 sec.
1249 2024.08.27 19:23:58.361486 [ 39 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71774910464, merge_with_ttl_allowedtrue)
1250 2024.08.27 19:23:58.361552 [ 39 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1251 2024.08.27 19:23:58.935356 [ 39 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71774910464, merge_with_ttl_allowedtrue)
1252 2024.08.27 19:23:58.935398 [ 39 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1253 2024.08.27 19:24:04.705193 [ 39 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71772272640, merge_with_ttl_allowedtrue)
1254 2024.08.27 19:24:04.705262 [ 39 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1255 2024.08.27 19:24:05.688342 [ 43 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1256 2024.08.27 19:24:10.961205 [ 43 ] {} <Debug> DNSResolver: Updating DNS cache
1257 2024.08.27 19:24:10.961324 [ 43 ] {} <Debug> DNSResolver: Updated DNS cache
1258 2024.08.27 19:24:23.432542 [ 49 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71768123392, merge_with_ttl_allowedtrue)
1259 2024.08.27 19:24:23.432659 [ 49 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1260 2024.08.27 19:24:25.961573 [ 49 ] {} <Debug> DNSResolver: Updating DNS cache
1261 2024.08.27 19:24:25.961724 [ 49 ] {} <Debug> DNSResolver: Updated DNS cache
1262 2024.08.27 19:24:40.961952 [ 55 ] {} <Debug> DNSResolver: Updating DNS cache
1263 2024.08.27 19:24:40.962108 [ 55 ] {} <Debug> DNSResolver: Updated DNS cache
1264 2024.08.27 19:24:55.962318 [ 49 ] {} <Debug> DNSResolver: Updating DNS cache
1265 2024.08.27 19:24:55.962458 [ 49 ] {} <Debug> DNSResolver: Updated DNS cache
1266 2024.08.27 19:24:58.361913 [ 100 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71759237120, merge_with_ttl_allowedtrue)
1267 2024.08.27 19:24:58.362012 [ 100 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1268 2024.08.27 19:24:58.935674 [ 100 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71759237120, merge_with_ttl_allowedtrue)
1269 2024.08.27 19:24:58.935734 [ 100 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1270 2024.08.27 19:25:04.705528 [ 103 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71756374016, merge_with_ttl_allowedtrue)
1271 2024.08.27 19:25:04.705592 [ 103 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1272 2024.08.27 19:25:05.688719 [ 103 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1273 2024.08.27 19:25:10.962633 [ 103 ] {} <Debug> DNSResolver: Updating DNS cache
1274 2024.08.27 19:25:10.962713 [ 103 ] {} <Debug> DNSResolver: Updated DNS cache
1275 2024.08.27 19:25:12.873869 [ 109 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 300752ms, ratio: 0, points per minute: 0)
1276 2024.08.27 19:25:13.705624 [ 109 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301584ms, ratio: 0, points per minute: 0)
1277 2024.08.27 19:25:13.972146 [ 109 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301851ms, ratio: 0, points per minute: 0)
1278 2024.08.27 19:25:16.159341 [ 109 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304036ms, ratio: 0, points per minute: 0)
1279 2024.08.27 19:25:18.785284 [ 103 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 306663ms, ratio: 0, points per minute: 0)
1280 2024.08.27 19:25:23.432879 [ 103 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71752450048, merge_with_ttl_allowedtrue)
1281 2024.08.27 19:25:23.432953 [ 103 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1282 2024.08.27 19:25:25.962899 [ 103 ] {} <Debug> DNSResolver: Updating DNS cache
1283 2024.08.27 19:25:25.962977 [ 103 ] {} <Debug> DNSResolver: Updated DNS cache
1284 2024.08.27 19:25:40.963142 [ 116 ] {} <Debug> DNSResolver: Updating DNS cache
1285 2024.08.27 19:25:40.963258 [ 116 ] {} <Debug> DNSResolver: Updated DNS cache
1286 2024.08.27 19:25:55.963408 [ 104 ] {} <Debug> DNSResolver: Updating DNS cache
1287 2024.08.27 19:25:55.963519 [ 104 ] {} <Debug> DNSResolver: Updated DNS cache
1288 2024.08.27 19:25:57.001335 [ 246 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000601654 sec.
1289 2024.08.27 19:25:58.362285 [ 124 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71742001152, merge_with_ttl_allowedtrue)
1290 2024.08.27 19:25:58.362345 [ 124 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1291 2024.08.27 19:25:58.935998 [ 124 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71742001152, merge_with_ttl_allowedtrue)
1292 2024.08.27 19:25:58.936053 [ 124 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1293 2024.08.27 19:26:04.705839 [ 104 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71739009024, merge_with_ttl_allowedtrue)
1294 2024.08.27 19:26:04.705903 [ 104 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1295 2024.08.27 19:26:05.689003 [ 124 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1296 2024.08.27 19:26:10.963701 [ 128 ] {} <Debug> DNSResolver: Updating DNS cache
1297 2024.08.27 19:26:10.963811 [ 128 ] {} <Debug> DNSResolver: Updated DNS cache
1298 2024.08.27 19:26:23.433297 [ 135 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71734446080, merge_with_ttl_allowedtrue)
1299 2024.08.27 19:26:23.433399 [ 135 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1300 2024.08.27 19:26:25.964067 [ 124 ] {} <Debug> DNSResolver: Updating DNS cache
1301 2024.08.27 19:26:25.964205 [ 124 ] {} <Debug> DNSResolver: Updated DNS cache
1302 2024.08.27 19:26:40.964325 [ 124 ] {} <Debug> DNSResolver: Updating DNS cache
1303 2024.08.27 19:26:40.964393 [ 124 ] {} <Debug> DNSResolver: Updated DNS cache
1304 2024.08.27 19:26:55.964547 [ 29 ] {} <Debug> DNSResolver: Updating DNS cache
1305 2024.08.27 19:26:55.964648 [ 29 ] {} <Debug> DNSResolver: Updated DNS cache
1306 2024.08.27 19:26:58.362570 [ 29 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71722999808, merge_with_ttl_allowedtrue)
1307 2024.08.27 19:26:58.362651 [ 29 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1308 2024.08.27 19:26:58.936378 [ 29 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71722999808, merge_with_ttl_allowedtrue)
1309 2024.08.27 19:26:58.936457 [ 29 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1310 2024.08.27 19:27:04.706230 [ 148 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71719892992, merge_with_ttl_allowedtrue)
1311 2024.08.27 19:27:04.706311 [ 148 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1312 2024.08.27 19:27:05.689342 [ 148 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1313 2024.08.27 19:27:10.964814 [ 144 ] {} <Debug> DNSResolver: Updating DNS cache
1314 2024.08.27 19:27:10.964960 [ 144 ] {} <Debug> DNSResolver: Updated DNS cache
1315 2024.08.27 19:27:23.433658 [ 148 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71715762176, merge_with_ttl_allowedtrue)
1316 2024.08.27 19:27:23.433715 [ 148 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1317 2024.08.27 19:27:25.965139 [ 148 ] {} <Debug> DNSResolver: Updating DNS cache
1318 2024.08.27 19:27:25.965223 [ 148 ] {} <Debug> DNSResolver: Updated DNS cache
1319 2024.08.27 19:27:40.965419 [ 59 ] {} <Debug> DNSResolver: Updating DNS cache
1320 2024.08.27 19:27:40.965529 [ 59 ] {} <Debug> DNSResolver: Updated DNS cache
1321 2024.08.27 19:27:55.965675 [ 148 ] {} <Debug> DNSResolver: Updating DNS cache
1322 2024.08.27 19:27:55.965945 [ 148 ] {} <Debug> DNSResolver: Updated DNS cache
1323 2024.08.27 19:27:57.000930 [ 246 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000347556 sec.
1324 2024.08.27 19:27:58.362920 [ 148 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71703603200, merge_with_ttl_allowedtrue)
1325 2024.08.27 19:27:58.362957 [ 148 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1326 2024.08.27 19:27:58.936706 [ 148 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71703603200, merge_with_ttl_allowedtrue)
1327 2024.08.27 19:27:58.936753 [ 148 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1328 2024.08.27 19:28:04.706838 [ 35 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71798714368, merge_with_ttl_allowedtrue)
1329 2024.08.27 19:28:04.706939 [ 35 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1330 2024.08.27 19:28:05.689824 [ 35 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1331 2024.08.27 19:28:10.966464 [ 35 ] {} <Debug> DNSResolver: Updating DNS cache
1332 2024.08.27 19:28:10.966628 [ 35 ] {} <Debug> DNSResolver: Updated DNS cache
1333 2024.08.27 19:28:23.434297 [ 142 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814303744, merge_with_ttl_allowedtrue)
1334 2024.08.27 19:28:23.434401 [ 142 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1335 2024.08.27 19:28:25.966872 [ 142 ] {} <Debug> DNSResolver: Updating DNS cache
1336 2024.08.27 19:28:25.967017 [ 142 ] {} <Debug> DNSResolver: Updated DNS cache
1337 2024.08.27 19:28:40.967445 [ 149 ] {} <Debug> DNSResolver: Updating DNS cache
1338 2024.08.27 19:28:40.967629 [ 149 ] {} <Debug> DNSResolver: Updated DNS cache
1339 2024.08.27 19:28:55.967879 [ 149 ] {} <Debug> DNSResolver: Updating DNS cache
1340 2024.08.27 19:28:55.968016 [ 149 ] {} <Debug> DNSResolver: Updated DNS cache
1341 2024.08.27 19:28:58.363502 [ 149 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814299648, merge_with_ttl_allowedtrue)
1342 2024.08.27 19:28:58.363584 [ 149 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1343 2024.08.27 19:28:58.937305 [ 149 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814299648, merge_with_ttl_allowedtrue)
1344 2024.08.27 19:28:58.937389 [ 149 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1345 2024.08.27 19:29:04.707489 [ 37 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814318080, merge_with_ttl_allowedtrue)
1346 2024.08.27 19:29:04.707597 [ 37 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1347 2024.08.27 19:29:05.690489 [ 37 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1348 2024.08.27 19:29:10.968440 [ 37 ] {} <Debug> DNSResolver: Updating DNS cache
1349 2024.08.27 19:29:10.968597 [ 37 ] {} <Debug> DNSResolver: Updated DNS cache
1350 2024.08.27 19:29:23.435036 [ 63 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814498304, merge_with_ttl_allowedtrue)
1351 2024.08.27 19:29:23.435168 [ 63 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1352 2024.08.27 19:29:25.968876 [ 63 ] {} <Debug> DNSResolver: Updating DNS cache
1353 2024.08.27 19:29:25.969050 [ 63 ] {} <Debug> DNSResolver: Updated DNS cache
1354 2024.08.27 19:29:40.969520 [ 63 ] {} <Debug> DNSResolver: Updating DNS cache
1355 2024.08.27 19:29:40.969671 [ 63 ] {} <Debug> DNSResolver: Updated DNS cache
1356 2024.08.27 19:29:55.969899 [ 63 ] {} <Debug> DNSResolver: Updating DNS cache
1357 2024.08.27 19:29:55.970037 [ 63 ] {} <Debug> DNSResolver: Updated DNS cache
1358 2024.08.27 19:29:57.001459 [ 246 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000598719 sec.
1359 2024.08.27 19:29:58.363909 [ 63 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814330368, merge_with_ttl_allowedtrue)
1360 2024.08.27 19:29:58.363988 [ 63 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1361 2024.08.27 19:29:58.937974 [ 63 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814330368, merge_with_ttl_allowedtrue)
1362 2024.08.27 19:29:58.938064 [ 63 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1363 2024.08.27 19:30:04.708179 [ 79 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814522880, merge_with_ttl_allowedtrue)
1364 2024.08.27 19:30:04.708276 [ 79 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1365 2024.08.27 19:30:05.691103 [ 79 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1366 2024.08.27 19:30:10.970274 [ 79 ] {} <Debug> DNSResolver: Updating DNS cache
1367 2024.08.27 19:30:10.970411 [ 79 ] {} <Debug> DNSResolver: Updated DNS cache
1368 2024.08.27 19:30:15.504519 [ 79 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 302631ms, ratio: 0, points per minute: 0)
1369 2024.08.27 19:30:16.684124 [ 79 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 302712ms, ratio: 0, points per minute: 0)
1370 2024.08.27 19:30:21.863110 [ 143 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 308158ms, ratio: 0, points per minute: 0)
1371 2024.08.27 19:30:23.435769 [ 81 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814518784, merge_with_ttl_allowedtrue)
1372 2024.08.27 19:30:23.435851 [ 81 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1373 2024.08.27 19:30:23.591397 [ 81 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304806ms, ratio: 0, points per minute: 0)
1374 2024.08.27 19:30:25.618636 [ 81 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309459ms, ratio: 0, points per minute: 0)
1375 2024.08.27 19:30:25.970844 [ 81 ] {} <Debug> DNSResolver: Updating DNS cache
1376 2024.08.27 19:30:25.970996 [ 81 ] {} <Debug> DNSResolver: Updated DNS cache
1377 2024.08.27 19:30:40.971231 [ 170 ] {} <Debug> DNSResolver: Updating DNS cache
1378 2024.08.27 19:30:40.971401 [ 170 ] {} <Debug> DNSResolver: Updated DNS cache
1379 2024.08.27 19:30:55.971816 [ 174 ] {} <Debug> DNSResolver: Updating DNS cache
1380 2024.08.27 19:30:55.972002 [ 174 ] {} <Debug> DNSResolver: Updated DNS cache
1381 2024.08.27 19:30:58.364521 [ 81 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814565888, merge_with_ttl_allowedtrue)
1382 2024.08.27 19:30:58.364602 [ 81 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1383 2024.08.27 19:30:58.938420 [ 81 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814565888, merge_with_ttl_allowedtrue)
1384 2024.08.27 19:30:58.938516 [ 81 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1385 2024.08.27 19:31:04.708870 [ 33 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814588416, merge_with_ttl_allowedtrue)
1386 2024.08.27 19:31:04.708968 [ 33 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1387 2024.08.27 19:31:05.691726 [ 33 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1388 2024.08.27 19:31:10.972424 [ 81 ] {} <Debug> DNSResolver: Updating DNS cache
1389 2024.08.27 19:31:10.972571 [ 81 ] {} <Debug> DNSResolver: Updated DNS cache
1390 2024.08.27 19:31:23.436468 [ 182 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814604800, merge_with_ttl_allowedtrue)
1391 2024.08.27 19:31:23.436599 [ 182 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1392 2024.08.27 19:31:25.972808 [ 182 ] {} <Debug> DNSResolver: Updating DNS cache
1393 2024.08.27 19:31:25.972939 [ 182 ] {} <Debug> DNSResolver: Updated DNS cache
1394 2024.08.27 19:31:40.973392 [ 182 ] {} <Debug> DNSResolver: Updating DNS cache
1395 2024.08.27 19:31:40.973528 [ 182 ] {} <Debug> DNSResolver: Updated DNS cache
1396 2024.08.27 19:31:55.973751 [ 155 ] {} <Debug> DNSResolver: Updating DNS cache
1397 2024.08.27 19:31:55.973918 [ 155 ] {} <Debug> DNSResolver: Updated DNS cache
1398 2024.08.27 19:31:57.001328 [ 246 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000492135 sec.
1399 2024.08.27 19:31:58.364898 [ 155 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814668288, merge_with_ttl_allowedtrue)
1400 2024.08.27 19:31:58.364995 [ 155 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1401 2024.08.27 19:31:58.938890 [ 155 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814668288, merge_with_ttl_allowedtrue)
1402 2024.08.27 19:31:58.938979 [ 155 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1403 2024.08.27 19:32:04.709551 [ 155 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814668288, merge_with_ttl_allowedtrue)
1404 2024.08.27 19:32:04.709664 [ 155 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1405 2024.08.27 19:32:05.692232 [ 155 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1406 2024.08.27 19:32:10.974316 [ 155 ] {} <Debug> DNSResolver: Updating DNS cache
1407 2024.08.27 19:32:10.974458 [ 155 ] {} <Debug> DNSResolver: Updated DNS cache
1408 2024.08.27 19:32:23.436988 [ 95 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814686720, merge_with_ttl_allowedtrue)
1409 2024.08.27 19:32:23.437102 [ 95 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1410 2024.08.27 19:32:25.974923 [ 95 ] {} <Debug> DNSResolver: Updating DNS cache
1411 2024.08.27 19:32:25.975054 [ 95 ] {} <Debug> DNSResolver: Updated DNS cache
1412 2024.08.27 19:32:40.975313 [ 96 ] {} <Debug> DNSResolver: Updating DNS cache
1413 2024.08.27 19:32:40.975495 [ 96 ] {} <Debug> DNSResolver: Updated DNS cache
1414 2024.08.27 19:32:55.975687 [ 139 ] {} <Debug> DNSResolver: Updating DNS cache
1415 2024.08.27 19:32:55.975851 [ 139 ] {} <Debug> DNSResolver: Updated DNS cache
1416 2024.08.27 19:32:58.365346 [ 84 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815532544, merge_with_ttl_allowedtrue)
1417 2024.08.27 19:32:58.365429 [ 84 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1418 2024.08.27 19:32:58.939513 [ 139 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815532544, merge_with_ttl_allowedtrue)
1419 2024.08.27 19:32:58.939595 [ 139 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1420 2024.08.27 19:33:04.710019 [ 139 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815194624, merge_with_ttl_allowedtrue)
1421 2024.08.27 19:33:04.710120 [ 139 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1422 2024.08.27 19:33:05.692799 [ 139 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1423 2024.08.27 19:33:10.976350 [ 171 ] {} <Debug> DNSResolver: Updating DNS cache
1424 2024.08.27 19:33:10.976557 [ 171 ] {} <Debug> DNSResolver: Updated DNS cache
1425 2024.08.27 19:33:23.437529 [ 105 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815526400, merge_with_ttl_allowedtrue)
1426 2024.08.27 19:33:23.437635 [ 105 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1427 2024.08.27 19:33:25.977024 [ 105 ] {} <Debug> DNSResolver: Updating DNS cache
1428 2024.08.27 19:33:25.977185 [ 105 ] {} <Debug> DNSResolver: Updated DNS cache
1429 2024.08.27 19:33:40.977619 [ 139 ] {} <Debug> DNSResolver: Updating DNS cache
1430 2024.08.27 19:33:40.977768 [ 139 ] {} <Debug> DNSResolver: Updated DNS cache
1431 2024.08.27 19:33:55.978263 [ 159 ] {} <Debug> DNSResolver: Updating DNS cache
1432 2024.08.27 19:33:55.978435 [ 159 ] {} <Debug> DNSResolver: Updated DNS cache
1433 2024.08.27 19:33:57.001174 [ 246 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000373137 sec.
1434 2024.08.27 19:33:58.365959 [ 139 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815929856, merge_with_ttl_allowedtrue)
1435 2024.08.27 19:33:58.366041 [ 139 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1436 2024.08.27 19:33:58.940261 [ 139 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815929856, merge_with_ttl_allowedtrue)
1437 2024.08.27 19:33:58.940353 [ 139 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1438 2024.08.27 19:34:04.710485 [ 163 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815909376, merge_with_ttl_allowedtrue)
1439 2024.08.27 19:34:04.710589 [ 163 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1440 2024.08.27 19:34:05.693417 [ 163 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1441 2024.08.27 19:34:10.978713 [ 159 ] {} <Debug> DNSResolver: Updating DNS cache
1442 2024.08.27 19:34:10.978887 [ 159 ] {} <Debug> DNSResolver: Updated DNS cache
1443 2024.08.27 19:34:23.438223 [ 161 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815915520, merge_with_ttl_allowedtrue)
1444 2024.08.27 19:34:23.438320 [ 161 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1445 2024.08.27 19:34:25.979116 [ 161 ] {} <Debug> DNSResolver: Updating DNS cache
1446 2024.08.27 19:34:25.979251 [ 161 ] {} <Debug> DNSResolver: Updated DNS cache
1447 2024.08.27 19:34:40.979502 [ 136 ] {} <Debug> DNSResolver: Updating DNS cache
1448 2024.08.27 19:34:40.979676 [ 136 ] {} <Debug> DNSResolver: Updated DNS cache
1449 2024.08.27 19:34:55.980137 [ 134 ] {} <Debug> DNSResolver: Updating DNS cache
1450 2024.08.27 19:34:55.980309 [ 134 ] {} <Debug> DNSResolver: Updated DNS cache
1451 2024.08.27 19:34:58.366318 [ 161 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815763968, merge_with_ttl_allowedtrue)
1452 2024.08.27 19:34:58.366394 [ 161 ] {} <Trace> oximeter.timeseries_schema_local (95e71a20-0d77-40b6-ae4f-41a6e9863749): Scheduling next merge selecting task after 60000ms
1453 2024.08.27 19:34:58.940645 [ 161 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815763968, merge_with_ttl_allowedtrue)
1454 2024.08.27 19:34:58.940729 [ 161 ] {} <Trace> oximeter.fields_i64_local (cf08e0ee-71a3-4243-81ae-d52967c1399a): Scheduling next merge selecting task after 60000ms
1455 2024.08.27 19:35:04.711149 [ 134 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816062976, merge_with_ttl_allowedtrue)
1456 2024.08.27 19:35:04.711262 [ 134 ] {} <Trace> oximeter.fields_uuid_local (a9e89244-7177-439d-9410-6c84872c1664): Scheduling next merge selecting task after 60000ms
1457 2024.08.27 19:35:05.694006 [ 134 ] {} <Trace> oximeter.version (a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e): Scheduling next merge selecting task after 60000ms
1458 2024.08.27 19:35:10.980714 [ 134 ] {} <Debug> DNSResolver: Updating DNS cache
1459 2024.08.27 19:35:10.980847 [ 134 ] {} <Debug> DNSResolver: Updated DNS cache
1460 2024.08.27 19:35:20.133476 [ 134 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304629ms, ratio: 0, points per minute: 0)
1461 2024.08.27 19:35:21.387457 [ 134 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304703ms, ratio: 0, points per minute: 0)
1462 2024.08.27 19:35:23.438855 [ 127 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816249344, merge_with_ttl_allowedtrue)
1463 2024.08.27 19:35:23.438923 [ 127 ] {} <Trace> oximeter.measurements_cumulativef64_local (5a85093b-c21a-4b08-bf37-6af0108427b6): Scheduling next merge selecting task after 60000ms
1464 2024.08.27 19:35:23.990333 [ 127 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 302127ms, ratio: 0, points per minute: 0)