Max level shown:
1 2024.09.02 19:50:07.774889 [ 207166 ] {} <Information> Application: Will watch for the process with pid 207167
2 2024.09.02 19:50:07.774926 [ 207167 ] {} <Information> Application: Forked a child process to watch
3 2024.09.02 19:50:07.775038 [ 207167 ] {} <Information> SentryWriter: Sending crash reports is disabled
4 2024.09.02 19:50:07.775129 [ 207167 ] {} <Trace> Pipe: Pipe capacity is 1.00 MiB
5 2024.09.02 19:50:07.822132 [ 207167 ] {} <Information> Application: Starting ClickHouse 23.8.7.24 (revision: 54477, git hash: 812b95e14ba8cf744bf1d70e6de607cf130a79fa, build id: 6484B75ECB16F4FF87A88E10249A45E1BDBDE2E5), PID 207167
6 2024.09.02 19:50:07.822190 [ 207167 ] {} <Information> Application: starting up
7 2024.09.02 19:50:07.822215 [ 207167 ] {} <Information> Application: OS name: Linux, version: 5.15.0-1015-aws, architecture: x86_64
8 2024.09.02 19:50:07.825209 [ 207167 ] {} <Information> Application: Available RAM: 30.68 GiB; physical cores: 8; logical cores: 8.
9 2024.09.02 19:50:07.825812 [ 207167 ] {} <Trace> AsynchronousMetrics: Scanning /sys/class/thermal
10 2024.09.02 19:50:07.825829 [ 207167 ] {} <Trace> AsynchronousMetrics: Scanning /sys/block
11 2024.09.02 19:50:07.825867 [ 207167 ] {} <Trace> AsynchronousMetrics: Scanning /sys/devices/system/edac
12 2024.09.02 19:50:07.825880 [ 207167 ] {} <Trace> AsynchronousMetrics: Scanning /sys/class/hwmon
13 2024.09.02 19:50:07.975118 [ 207167 ] {} <Information> Application: Integrity check of the executable successfully passed (checksum: 63E397DB90569A93F13765E06F4A1FBF)
14 2024.09.02 19:50:07.979198 [ 207167 ] {} <Debug> Application: Set max number of file descriptors to 524288 (was 1024).
15 2024.09.02 19:50:07.979212 [ 207167 ] {} <Debug> Application: rlimit on number of threads is 125612
16 2024.09.02 19:50:07.979217 [ 207167 ] {} <Debug> Application: Initializing DateLUT.
17 2024.09.02 19:50:07.979220 [ 207167 ] {} <Trace> Application: Initialized DateLUT with time zone 'UTC'.
18 2024.09.02 19:50:07.979239 [ 207167 ] {} <Debug> Context: Setting up /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/data/tmp/ to store temporary data in it
19 2024.09.02 19:50:07.980089 [ 207167 ] {} <Debug> Application: Initializing interserver credentials.
20 2024.09.02 19:50:07.980582 [ 207167 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml'
21 2024.09.02 19:50:07.981119 [ 207167 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration
22 2024.09.02 19:50:07.981556 [ 207167 ] {} <Information> Application: Setting max_server_memory_usage was set to 27.61 GiB (30.68 GiB available * 0.90 max_server_memory_usage_to_ram_ratio)
23 2024.09.02 19:50:07.981565 [ 207167 ] {} <Information> Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.34 GiB (30.68 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio)
24 2024.09.02 19:50:07.981568 [ 207167 ] {} <Information> Application: Merges and mutations memory limit is set to 15.34 GiB
25 2024.09.02 19:50:07.981789 [ 207167 ] {} <Information> BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads
26 2024.09.02 19:50:07.984495 [ 207167 ] {} <Information> BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads
27 2024.09.02 19:50:08.002264 [ 207167 ] {} <Information> BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads
28 2024.09.02 19:50:08.003049 [ 207167 ] {} <Information> BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads
29 2024.09.02 19:50:08.003725 [ 207167 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again.
30 2024.09.02 19:50:08.003913 [ 207167 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration
31 2024.09.02 19:50:08.010907 [ 207167 ] {} <Information> Application: Listening for replica communication (interserver): http://[::1]:19403
32 2024.09.02 19:50:08.014187 [ 207167 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml'
33 2024.09.02 19:50:08.014917 [ 207167 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration
34 2024.09.02 19:50:08.015858 [ 207167 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration
35 2024.09.02 19:50:08.017463 [ 207167 ] {} <Debug> Access(user directories): Added users_xml access storage 'users_xml', path: /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml
36 2024.09.02 19:50:08.018305 [ 207167 ] {} <Information> Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin
37 2024.09.02 19:50:08.019516 [ 207167 ] {} <Information> Context: Initialized background executor for move operations with num_threads=8, num_tasks=8
38 2024.09.02 19:50:08.019939 [ 207167 ] {} <Information> Context: Initialized background executor for fetches with num_threads=8, num_tasks=8
39 2024.09.02 19:50:08.021100 [ 207167 ] {} <Information> Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8
40 2024.09.02 19:50:08.023353 [ 207167 ] {} <Information> DNSCacheUpdater: Update period 15 seconds
41 2024.09.02 19:50:08.023372 [ 207167 ] {} <Information> Application: Loading metadata from /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/data/
42 2024.09.02 19:50:08.023423 [ 207192 ] {} <Debug> DNSResolver: Updating DNS cache
43 2024.09.02 19:50:08.023460 [ 207192 ] {} <Debug> DNSResolver: Updated DNS cache
44 2024.09.02 19:50:08.041251 [ 207167 ] {} <Information> DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total.
45 2024.09.02 19:50:08.041265 [ 207167 ] {} <Information> TablesLoader: Parsed metadata of 0 tables in 1 databases in 9.14e-05 sec
46 2024.09.02 19:50:08.041270 [ 207167 ] {} <Trace> ReferentialDeps: No tables
47 2024.09.02 19:50:08.041272 [ 207167 ] {} <Trace> LoadingDeps: No tables
48 2024.09.02 19:50:08.041315 [ 207167 ] {} <Information> DatabaseAtomic (system): Starting up tables.
49 2024.09.02 19:50:08.041337 [ 207167 ] {} <Debug> SystemLog: Not creating system.query_log since corresponding section 'query_log' is missing from config
50 2024.09.02 19:50:08.041344 [ 207167 ] {} <Debug> SystemLog: Not creating system.query_thread_log since corresponding section 'query_thread_log' is missing from config
51 2024.09.02 19:50:08.041350 [ 207167 ] {} <Debug> SystemLog: Not creating system.part_log since corresponding section 'part_log' is missing from config
52 2024.09.02 19:50:08.041356 [ 207167 ] {} <Debug> SystemLog: Not creating system.trace_log since corresponding section 'trace_log' is missing from config
53 2024.09.02 19:50:08.041362 [ 207167 ] {} <Debug> SystemLog: Not creating system.crash_log since corresponding section 'crash_log' is missing from config
54 2024.09.02 19:50:08.041370 [ 207167 ] {} <Debug> SystemLog: Not creating system.text_log since corresponding section 'text_log' is missing from config
55 2024.09.02 19:50:08.041377 [ 207167 ] {} <Debug> SystemLog: Not creating system.metric_log since corresponding section 'metric_log' is missing from config
56 2024.09.02 19:50:08.041382 [ 207167 ] {} <Debug> SystemLog: Not creating system.filesystem_cache_log since corresponding section 'filesystem_cache_log' is missing from config
57 2024.09.02 19:50:08.041395 [ 207167 ] {} <Debug> SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config
58 2024.09.02 19:50:08.041401 [ 207167 ] {} <Debug> SystemLog: Not creating system.asynchronous_metric_log since corresponding section 'asynchronous_metric_log' is missing from config
59 2024.09.02 19:50:08.041406 [ 207167 ] {} <Debug> SystemLog: Not creating system.opentelemetry_span_log since corresponding section 'opentelemetry_span_log' is missing from config
60 2024.09.02 19:50:08.041412 [ 207167 ] {} <Debug> SystemLog: Not creating system.query_views_log since corresponding section 'query_views_log' is missing from config
61 2024.09.02 19:50:08.041417 [ 207167 ] {} <Debug> SystemLog: Not creating system.zookeeper_log since corresponding section 'zookeeper_log' is missing from config
62 2024.09.02 19:50:08.041422 [ 207167 ] {} <Debug> SystemLog: Not creating system.session_log since corresponding section 'session_log' is missing from config
63 2024.09.02 19:50:08.041428 [ 207167 ] {} <Debug> SystemLog: Not creating system.transactions_info_log since corresponding section 'transactions_info_log' is missing from config
64 2024.09.02 19:50:08.041435 [ 207167 ] {} <Debug> SystemLog: Not creating system.processors_profile_log since corresponding section 'processors_profile_log' is missing from config
65 2024.09.02 19:50:08.041442 [ 207167 ] {} <Debug> SystemLog: Not creating system.asynchronous_insert_log since corresponding section 'asynchronous_insert_log' is missing from config
66 2024.09.02 19:50:08.054961 [ 207167 ] {} <Information> DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal.
67 2024.09.02 19:50:08.062026 [ 207167 ] {} <Information> DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total.
68 2024.09.02 19:50:08.062044 [ 207167 ] {} <Information> TablesLoader: Parsed metadata of 0 tables in 1 databases in 6.978e-05 sec
69 2024.09.02 19:50:08.062051 [ 207167 ] {} <Trace> ReferentialDeps: No tables
70 2024.09.02 19:50:08.062055 [ 207167 ] {} <Trace> LoadingDeps: No tables
71 2024.09.02 19:50:08.062076 [ 207167 ] {} <Information> DatabaseAtomic (default): Starting up tables.
72 2024.09.02 19:50:08.062174 [ 207167 ] {} <Information> UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/data/user_defined/
73 2024.09.02 19:50:08.062205 [ 207167 ] {} <Debug> UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded
74 2024.09.02 19:50:08.062211 [ 207167 ] {} <Debug> Application: Loaded metadata.
75 2024.09.02 19:50:08.062236 [ 207167 ] {} <Information> Application: Tasks stats provider: procfs
76 2024.09.02 19:50:08.062242 [ 207167 ] {} <Information> Application: It looks like the process has no CAP_SYS_NICE capability, the setting 'os_thread_priority' will have no effect. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_sys_nice=+ep /work/oxidecomputer/omicron/out/clickhouse/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems.
77 2024.09.02 19:50:08.062370 [ 207167 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again.
78 2024.09.02 19:50:08.062880 [ 207167 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 8.56 MiB, peak 13.27 MiB, free memory in arenas 9.68 MiB, will set to 371.73 MiB (RSS), difference: 363.17 MiB
79 2024.09.02 19:50:08.063606 [ 207167 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 2.062e-05 sec.
80 2024.09.02 19:50:08.064052 [ 207167 ] {} <Information> Application: Listening for http://[::1]:19303
81 2024.09.02 19:50:08.064162 [ 207167 ] {} <Information> Application: Listening for native protocol (tcp): [::1]:19203
82 2024.09.02 19:50:08.064172 [ 207412 ] {} <Debug> DDLWorker: Started DDLWorker cleanup thread
83 2024.09.02 19:50:08.064185 [ 207167 ] {} <Information> Application: Ready for connections.
84 2024.09.02 19:50:08.064761 [ 207410 ] {} <Debug> DDLWorker: Starting DDLWorker thread
85 2024.09.02 19:50:08.064993 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: GET, Address: [::1]:48516, User-Agent: (none), Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
86 2024.09.02 19:50:08.066311 [ 207410 ] {} <Debug> DDLWorker: Initializing DDLWorker thread
87 2024.09.02 19:50:08.067146 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 1261, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
88 2024.09.02 19:50:08.067936 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
89 2024.09.02 19:50:08.067963 [ 207169 ] {} <Debug> HTTP-Session: c93c01b5-4fd7-432c-8d34-b2b56b61649b Authenticating user 'default' from [::1]:48516
90 2024.09.02 19:50:08.067976 [ 207169 ] {} <Debug> HTTP-Session: c93c01b5-4fd7-432c-8d34-b2b56b61649b Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
91 2024.09.02 19:50:08.067982 [ 207169 ] {} <Debug> HTTP-Session: c93c01b5-4fd7-432c-8d34-b2b56b61649b Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
92 2024.09.02 19:50:08.068067 [ 207169 ] {} <Trace> ContextAccess (default): Settings: readonly = 0, allow_ddl = true, allow_introspection_functions = false
93 2024.09.02 19:50:08.068082 [ 207169 ] {} <Trace> ContextAccess (default): List of all grants: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.*
94 2024.09.02 19:50:08.068089 [ 207169 ] {} <Trace> ContextAccess (default): List of all grants including implicit: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.*
95 2024.09.02 19:50:08.068116 [ 207169 ] {} <Trace> HTTP-Session: c93c01b5-4fd7-432c-8d34-b2b56b61649b Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
96 2024.09.02 19:50:08.068286 [ 207169 ] {0e334290-cf3b-49db-a6d4-df4fa3a79ce2} <Debug> executeQuery: (from [::1]:48516) /* We purposefully split our DB schema into two *disjoint* files:
97 * `db-init-1.sql` and `db-init-2.sql`. The purpose of this split is to shorten
98 * the duration of our replicated tests. These tests only use a subset of the
99 * tables defined in the full schema. We put the tables used by the replicated
100 * tests in `db-init-1.sql`, and the remainder of the tables in `db-init-2.sql`.
101 * This minimizes test time by reducing the cost to load a schema. In
102 * production, we load `db-init-1.sql` followed by `db-init-2.sql` so we have
103 * the full schema. If we end up needing to use more tables in replicated tests
104 * we can go ahead and move them into `db-init-1.sql`, removing them from
105 * `db-init-2.sql`. Conversely, if we stop using given tables in our tests we
106 * can move them from `db-init-1.sql` into `db-init-2.sql` and keep our test
107 * times minimal.
108 
109 * The reason to keep the two files disjoint is so that we don't have to
110 * maintain consistency between table definitions. All tables are defined
111 * once. However, in order to write a test that ensures the tables are in fact
112 * disjoint, we must create the `oximeter` database in both files so we can load
113 * them in isolation.
114 */
115 CREATE DATABASE IF NOT EXISTS oximeter ON CLUSTER oximeter_cluster (stage: Complete)
116 2024.09.02 19:50:08.068349 [ 207169 ] {0e334290-cf3b-49db-a6d4-df4fa3a79ce2} <Trace> ContextAccess (default): Access granted: CREATE DATABASE ON oximeter.*
117 2024.09.02 19:50:08.072037 [ 207410 ] {} <Information> ZooKeeperClient: Connected to ZooKeeper at [::1]:19002 with session_id 6
118 2024.09.02 19:50:08.072374 [ 207410 ] {} <Information> ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled
119 2024.09.02 19:50:08.072382 [ 207410 ] {} <Information> ZooKeeperClient: Keeper feature flag MULTI_READ: enabled
120 2024.09.02 19:50:08.072385 [ 207410 ] {} <Information> ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled
121 2024.09.02 19:50:08.072389 [ 207410 ] {} <Trace> ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003
122 2024.09.02 19:50:08.077387 [ 207410 ] {} <Debug> DDLWorker: Initialized DDLWorker thread
123 2024.09.02 19:50:08.077415 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
124 2024.09.02 19:50:08.077421 [ 207410 ] {} <Trace> DDLWorker: Don't have unfinished tasks after restarting
125 2024.09.02 19:50:08.077422 [ 207412 ] {} <Debug> DDLWorker: Cleaning queue
126 2024.09.02 19:50:08.082381 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=10, queue_size=10, entries=query-0000000000..query-0000000009, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none
127 2024.09.02 19:50:08.082407 [ 207410 ] {} <Debug> DDLWorker: Will schedule 10 tasks starting from query-0000000000
128 2024.09.02 19:50:08.082413 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000000
129 2024.09.02 19:50:08.082572 [ 207410 ] {} <Debug> DDLWorker: Will not execute task query-0000000000: There is no a local address in host list
130 2024.09.02 19:50:08.082582 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000001
131 2024.09.02 19:50:08.082747 [ 207410 ] {} <Debug> DDLWorker: Will not execute task query-0000000001: There is no a local address in host list
132 2024.09.02 19:50:08.082754 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000002
133 2024.09.02 19:50:08.082906 [ 207410 ] {} <Debug> DDLWorker: Will not execute task query-0000000002: There is no a local address in host list
134 2024.09.02 19:50:08.082916 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000003
135 2024.09.02 19:50:08.083156 [ 207410 ] {} <Debug> DDLWorker: Will not execute task query-0000000003: There is no a local address in host list
136 2024.09.02 19:50:08.083164 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000004
137 2024.09.02 19:50:08.083451 [ 207410 ] {} <Debug> DDLWorker: Will not execute task query-0000000004: There is no a local address in host list
138 2024.09.02 19:50:08.083458 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000005
139 2024.09.02 19:50:08.090378 [ 207410 ] {} <Debug> DDLWorker: Will not execute task query-0000000005: There is no a local address in host list
140 2024.09.02 19:50:08.090395 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000006
141 2024.09.02 19:50:08.104446 [ 207410 ] {} <Debug> DDLWorker: Will not execute task query-0000000006: There is no a local address in host list
142 2024.09.02 19:50:08.104462 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000007
143 2024.09.02 19:50:08.104593 [ 207410 ] {} <Debug> DDLWorker: Will not execute task query-0000000007: There is no a local address in host list
144 2024.09.02 19:50:08.104600 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000008
145 2024.09.02 19:50:08.104803 [ 207410 ] {} <Debug> DDLWorker: Will not execute task query-0000000008: There is no a local address in host list
146 2024.09.02 19:50:08.104815 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000009
147 2024.09.02 19:50:08.105051 [ 207410 ] {} <Debug> DDLWorker: Will not execute task query-0000000009: There is no a local address in host list
148 2024.09.02 19:50:08.105062 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
149 2024.09.02 19:50:08.105070 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
150 2024.09.02 19:50:08.105083 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
151 2024.09.02 19:50:08.106478 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=11, queue_size=11, entries=query-0000000000..query-0000000010, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=query-0000000009
152 2024.09.02 19:50:08.107230 [ 207410 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000010
153 2024.09.02 19:50:08.107238 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000010
154 2024.09.02 19:50:08.113720 [ 207410 ] {} <Debug> DDLWorker: Processing task query-0000000010 (CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3')
155 2024.09.02 19:50:08.120671 [ 207410 ] {} <Debug> DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3'
156 2024.09.02 19:50:08.120812 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0e334290-cf3b-49db-a6d4-df4fa3a79ce2) /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3' (stage: Complete)
157 2024.09.02 19:50:08.125662 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} <Information> DatabaseAtomic (oximeter): Metadata processed, database oximeter has 0 tables and 0 dictionaries in total.
158 2024.09.02 19:50:08.125675 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} <Information> TablesLoader: Parsed metadata of 0 tables in 1 databases in 5.372e-05 sec
159 2024.09.02 19:50:08.125680 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} <Trace> ReferentialDeps: No tables
160 2024.09.02 19:50:08.125683 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} <Trace> LoadingDeps: No tables
161 2024.09.02 19:50:08.125700 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} <Information> DatabaseAtomic (oximeter): Starting up tables.
162 2024.09.02 19:50:08.125779 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3'
163 2024.09.02 19:50:08.131697 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
164 2024.09.02 19:50:08.206505 [ 207169 ] {0e334290-cf3b-49db-a6d4-df4fa3a79ce2} <Debug> executeQuery: Read 3 rows, 141.00 B in 0.138255 sec., 21.699034392969516 rows/sec., 1019.85 B/sec.
165 2024.09.02 19:50:08.207083 [ 207169 ] {0e334290-cf3b-49db-a6d4-df4fa3a79ce2} <Debug> DynamicQueryHandler: Done processing query
166 2024.09.02 19:50:08.209682 [ 207169 ] {0e334290-cf3b-49db-a6d4-df4fa3a79ce2} <Debug> MemoryTracker: Peak memory usage (for query): 3.98 MiB.
167 2024.09.02 19:50:08.209699 [ 207169 ] {} <Debug> HTTP-Session: c93c01b5-4fd7-432c-8d34-b2b56b61649b Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
168 2024.09.02 19:50:08.210323 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 310, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
169 2024.09.02 19:50:08.210366 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
170 2024.09.02 19:50:08.210381 [ 207169 ] {} <Debug> HTTP-Session: 0e5957bf-7457-4dbc-83f1-d4af6a36b8c3 Authenticating user 'default' from [::1]:48516
171 2024.09.02 19:50:08.210418 [ 207169 ] {} <Debug> HTTP-Session: 0e5957bf-7457-4dbc-83f1-d4af6a36b8c3 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
172 2024.09.02 19:50:08.210427 [ 207169 ] {} <Debug> HTTP-Session: 0e5957bf-7457-4dbc-83f1-d4af6a36b8c3 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
173 2024.09.02 19:50:08.210480 [ 207169 ] {} <Trace> HTTP-Session: 0e5957bf-7457-4dbc-83f1-d4af6a36b8c3 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
174 2024.09.02 19:50:08.210768 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} <Debug> executeQuery: (from [::1]:48516) /* The version table contains metadata about the `oximeter` database */
175 CREATE TABLE IF NOT EXISTS oximeter.version ON CLUSTER oximeter_cluster ( value UInt64, timestamp DateTime64(9, 'UTC') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete)
176 2024.09.02 19:50:08.211891 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.version
177 2024.09.02 19:50:08.211981 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.version
178 2024.09.02 19:50:08.220992 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
179 2024.09.02 19:50:08.221020 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
180 2024.09.02 19:50:08.223513 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=12, queue_size=12, entries=query-0000000000..query-0000000011, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000010, last_skipped_entry_name=query-0000000009
181 2024.09.02 19:50:08.223808 [ 207410 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000011
182 2024.09.02 19:50:08.223818 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000011
183 2024.09.02 19:50:08.228620 [ 207410 ] {} <Debug> DDLWorker: Processing task query-0000000011 (CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp))
184 2024.09.02 19:50:08.248435 [ 207410 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)
185 2024.09.02 19:50:08.248604 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 434b2747-fa1d-42bc-94c8-45f3f74f317b) /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete)
186 2024.09.02 19:50:08.249307 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1
187 2024.09.02 19:50:08.253010 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Debug> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Loading data parts
188 2024.09.02 19:50:08.253831 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Debug> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): There are no data parts
189 2024.09.02 19:50:08.257853 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Debug> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): This table /clickhouse/tables/1/version is already created, will add new replica
190 2024.09.02 19:50:08.258706 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Debug> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Creating replica /clickhouse/tables/1/version/replicas/3
191 2024.09.02 19:50:08.310406 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Debug> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Creating shared ID for table oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc)
192 2024.09.02 19:50:08.310553 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Debug> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Initializing table shared ID with 626c1ca5-d8d8-4409-a032-b2aeb18345c3
193 2024.09.02 19:50:08.313449 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Starting up table
194 2024.09.02 19:50:08.313718 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Information> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Became leader
195 2024.09.02 19:50:08.313729 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Trace> oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
196 2024.09.02 19:50:08.313778 [ 207200 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Activating replica.
197 2024.09.02 19:50:08.313798 [ 207200 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up
198 2024.09.02 19:50:08.322731 [ 207200 ] {} <Information> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Replica 2 has log pointer '0', approximate 1 queue lag and 0 queue size
199 2024.09.02 19:50:08.325040 [ 207200 ] {} <Information> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Replica 1 has log pointer '0', approximate 1 queue lag and 0 queue size
200 2024.09.02 19:50:08.325045 [ 207200 ] {} <Information> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Will mimic 2
201 2024.09.02 19:50:08.341086 [ 207200 ] {} <Debug> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Queued 0 parts to be fetched, 0 parts ignored
202 2024.09.02 19:50:08.341817 [ 207200 ] {} <Debug> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Copied 0 queue entries, 0 entries ignored
203 2024.09.02 19:50:08.342075 [ 207200 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Parts in ZooKeeper after mimic:
204 2024.09.02 19:50:08.342088 [ 207200 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Enqueued fetches after mimic:
205 2024.09.02 19:50:08.344609 [ 207200 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue
206 2024.09.02 19:50:08.344714 [ 207200 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Queue initialized
207 2024.09.02 19:50:08.344726 [ 207200 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/3/queue
208 2024.09.02 19:50:08.344848 [ 207200 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
209 2024.09.02 19:50:08.344985 [ 207200 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Loaded queue
210 2024.09.02 19:50:08.345770 [ 207200 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully
211 2024.09.02 19:50:08.345903 [ 207199 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 6548ms
212 2024.09.02 19:50:08.346030 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)
213 2024.09.02 19:50:08.348496 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
214 2024.09.02 19:50:08.393371 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} <Debug> executeQuery: Read 3 rows, 141.00 B in 0.182747 sec., 16.41613815821874 rows/sec., 771.56 B/sec.
215 2024.09.02 19:50:08.393642 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} <Debug> DynamicQueryHandler: Done processing query
216 2024.09.02 19:50:08.393662 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} <Debug> MemoryTracker: Peak memory usage (for query): 4.96 MiB.
217 2024.09.02 19:50:08.393671 [ 207169 ] {} <Debug> HTTP-Session: 0e5957bf-7457-4dbc-83f1-d4af6a36b8c3 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
218 2024.09.02 19:50:08.394688 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 997, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
219 2024.09.02 19:50:08.394751 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
220 2024.09.02 19:50:08.394766 [ 207169 ] {} <Debug> HTTP-Session: bb715a2c-81eb-4700-85b1-79b2b00b7bca Authenticating user 'default' from [::1]:48516
221 2024.09.02 19:50:08.394781 [ 207169 ] {} <Debug> HTTP-Session: bb715a2c-81eb-4700-85b1-79b2b00b7bca Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
222 2024.09.02 19:50:08.394787 [ 207169 ] {} <Debug> HTTP-Session: bb715a2c-81eb-4700-85b1-79b2b00b7bca Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
223 2024.09.02 19:50:08.394832 [ 207169 ] {} <Trace> HTTP-Session: bb715a2c-81eb-4700-85b1-79b2b00b7bca Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
224 2024.09.02 19:50:08.395127 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} <Debug> executeQuery: (from [::1]:48516) /* The measurement tables contain all individual samples from each timeseries.
225 *
226 * Each table stores a single datum type, and otherwise contains nearly the same
227 * structure. The primary sorting key is on the timeseries name, key, and then
228 * timestamp, so that all timeseries from the same schema are grouped, followed
229 * by all samples from the same timeseries.
230 *
231 * This reflects that one usually looks up the _key_ in one or more field table,
232 * and then uses that to index quickly into the measurements tables.
233 */
234 CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local ON CLUSTER oximeter_cluster ( timeseries_name String, timeseries_key UInt64, start_time DateTime64(9, 'UTC'), timestamp DateTime64(9, 'UTC'), datum Nullable(Float64) ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + INTERVAL 30 DAY (stage: Complete)
235 2024.09.02 19:50:08.395621 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64_local
236 2024.09.02 19:50:08.395759 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64_local
237 2024.09.02 19:50:08.403124 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
238 2024.09.02 19:50:08.403156 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
239 2024.09.02 19:50:08.403311 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=13, queue_size=13, entries=query-0000000000..query-0000000012, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000011, last_skipped_entry_name=query-0000000009
240 2024.09.02 19:50:08.403320 [ 207410 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000012
241 2024.09.02 19:50:08.403325 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000012
242 2024.09.02 19:50:08.407450 [ 207410 ] {} <Debug> DDLWorker: Processing task query-0000000012 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30))
243 2024.09.02 19:50:08.411108 [ 207410 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)
244 2024.09.02 19:50:08.411351 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8ace4dfe-7928-4de3-a7d9-e18bb1f26969) /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete)
245 2024.09.02 19:50:08.415732 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Loading data parts
246 2024.09.02 19:50:08.415966 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): There are no data parts
247 2024.09.02 19:50:08.419638 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): This table /clickhouse/tables/1/measurements_cumulativef64_local is already created, will add new replica
248 2024.09.02 19:50:08.420828 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Creating replica /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3
249 2024.09.02 19:50:08.457946 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Creating shared ID for table oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad)
250 2024.09.02 19:50:08.458091 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Initializing table shared ID with 8387b2c6-e147-451e-8e5f-84f4bbeb2c47
251 2024.09.02 19:50:08.463508 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Starting up table
252 2024.09.02 19:50:08.463722 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Information> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Became leader
253 2024.09.02 19:50:08.463732 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
254 2024.09.02 19:50:08.463785 [ 207221 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Activating replica.
255 2024.09.02 19:50:08.463821 [ 207221 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
256 2024.09.02 19:50:08.469132 [ 207221 ] {} <Information> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size
257 2024.09.02 19:50:08.469150 [ 207221 ] {} <Information> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size
258 2024.09.02 19:50:08.469154 [ 207221 ] {} <Information> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Will mimic 2
259 2024.09.02 19:50:08.480830 [ 207221 ] {} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Queued 1 parts to be fetched, 0 parts ignored
260 2024.09.02 19:50:08.480847 [ 207221 ] {} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Copied 0 queue entries, 0 entries ignored
261 2024.09.02 19:50:08.480988 [ 207221 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Parts in ZooKeeper after mimic:
262 2024.09.02 19:50:08.481002 [ 207221 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Enqueued fetches after mimic: all_0_0_0
263 2024.09.02 19:50:08.486616 [ 207221 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
264 2024.09.02 19:50:08.486775 [ 207221 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized
265 2024.09.02 19:50:08.486792 [ 207221 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/queue
266 2024.09.02 19:50:08.486901 [ 207221 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded.
267 2024.09.02 19:50:08.487056 [ 207221 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0]
268 2024.09.02 19:50:08.493249 [ 207221 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue
269 2024.09.02 19:50:08.494231 [ 207221 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
270 2024.09.02 19:50:08.494435 [ 207230 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 6226ms
271 2024.09.02 19:50:08.494865 [ 207195 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks
272 2024.09.02 19:50:08.494934 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)
273 2024.09.02 19:50:08.495105 [ 207379 ] {} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Fetching part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/2
274 2024.09.02 19:50:08.499159 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
275 2024.09.02 19:50:08.499269 [ 207379 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19402/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false
276 2024.09.02 19:50:08.499350 [ 207379 ] {} <Trace> HTTPSessionAdapter: Created HTTP(S) session with ::1:19402 (::1:19402)
277 2024.09.02 19:50:08.501233 [ 207379 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Trying to reserve 1.00 MiB using storage policy from min volume index 0
278 2024.09.02 19:50:08.501255 [ 207379 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.75 GiB.
279 2024.09.02 19:50:08.501269 [ 207379 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
280 2024.09.02 19:50:08.501308 [ 207379 ] {} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Fetcher): Downloading part all_0_0_0 onto disk default.
281 2024.09.02 19:50:08.503663 [ 207379 ] {} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Fetcher): Download of part all_0_0_0 onto disk default finished.
282 2024.09.02 19:50:08.503682 [ 207379 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
283 2024.09.02 19:50:08.503720 [ 207379 ] {} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Committing part all_0_0_0 to zookeeper
284 2024.09.02 19:50:08.508806 [ 207379 ] {} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Part all_0_0_0 committed to zookeeper
285 2024.09.02 19:50:08.508861 [ 207379 ] {} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Fetched part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/2
286 2024.09.02 19:50:08.508951 [ 207228 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89522591744, merge_with_ttl_allowedtrue)
287 2024.09.02 19:50:08.508983 [ 207228 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 7789ms
288 2024.09.02 19:50:08.517586 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} <Debug> executeQuery: Read 3 rows, 141.00 B in 0.122644 sec., 24.461041714229804 rows/sec., 1.12 KiB/sec.
289 2024.09.02 19:50:08.517817 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} <Debug> DynamicQueryHandler: Done processing query
290 2024.09.02 19:50:08.517833 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} <Debug> MemoryTracker: Peak memory usage (for query): 3.98 MiB.
291 2024.09.02 19:50:08.517842 [ 207169 ] {} <Debug> HTTP-Session: bb715a2c-81eb-4700-85b1-79b2b00b7bca Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
292 2024.09.02 19:50:08.518769 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 274, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
293 2024.09.02 19:50:08.519281 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
294 2024.09.02 19:50:08.519292 [ 207169 ] {} <Debug> HTTP-Session: ec379be8-7bb6-435b-ad73-5b32396d19a8 Authenticating user 'default' from [::1]:48516
295 2024.09.02 19:50:08.519303 [ 207169 ] {} <Debug> HTTP-Session: ec379be8-7bb6-435b-ad73-5b32396d19a8 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
296 2024.09.02 19:50:08.519306 [ 207169 ] {} <Debug> HTTP-Session: ec379be8-7bb6-435b-ad73-5b32396d19a8 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
297 2024.09.02 19:50:08.519339 [ 207169 ] {} <Trace> HTTP-Session: ec379be8-7bb6-435b-ad73-5b32396d19a8 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
298 2024.09.02 19:50:08.519508 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} <Debug> executeQuery: (from [::1]:48516) CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 ON CLUSTER oximeter_cluster AS oximeter.measurements_cumulativef64_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
299 2024.09.02 19:50:08.519539 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64
300 2024.09.02 19:50:08.519546 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
301 2024.09.02 19:50:08.519551 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
302 2024.09.02 19:50:08.519625 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64
303 2024.09.02 19:50:08.519631 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
304 2024.09.02 19:50:08.531399 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
305 2024.09.02 19:50:08.531409 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
306 2024.09.02 19:50:08.539602 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=14, queue_size=14, entries=query-0000000000..query-0000000013, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000012, last_skipped_entry_name=query-0000000009
307 2024.09.02 19:50:08.539628 [ 207410 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000013
308 2024.09.02 19:50:08.539633 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000013
309 2024.09.02 19:50:08.543798 [ 207410 ] {} <Debug> DDLWorker: Processing task query-0000000013 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])))
310 2024.09.02 19:50:08.552200 [ 207410 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
311 2024.09.02 19:50:08.552408 [ 207410 ] {56c1f0a4-5a9a-4935-b9e5-fab81728b8c4} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 37189558-ff42-474d-ab2d-4505cd71d619) /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
312 2024.09.02 19:50:08.553004 [ 207410 ] {56c1f0a4-5a9a-4935-b9e5-fab81728b8c4} <Debug> StorageDistributed (measurements_cumulativef64): Auto-increment is 0
313 2024.09.02 19:50:08.560421 [ 207410 ] {56c1f0a4-5a9a-4935-b9e5-fab81728b8c4} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
314 2024.09.02 19:50:08.564299 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
315 2024.09.02 19:50:08.644882 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} <Debug> executeQuery: Read 3 rows, 141.00 B in 0.125447 sec., 23.91448181303658 rows/sec., 1.10 KiB/sec.
316 2024.09.02 19:50:08.645132 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} <Debug> DynamicQueryHandler: Done processing query
317 2024.09.02 19:50:08.645150 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} <Debug> MemoryTracker: Peak memory usage (for query): 3.98 MiB.
318 2024.09.02 19:50:08.645157 [ 207169 ] {} <Debug> HTTP-Session: ec379be8-7bb6-435b-ad73-5b32396d19a8 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
319 2024.09.02 19:50:08.646038 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 1384, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
320 2024.09.02 19:50:08.646789 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
321 2024.09.02 19:50:08.646801 [ 207169 ] {} <Debug> HTTP-Session: 0f3aed3b-ad46-4fa6-bce6-52f45ae377f6 Authenticating user 'default' from [::1]:48516
322 2024.09.02 19:50:08.646814 [ 207169 ] {} <Debug> HTTP-Session: 0f3aed3b-ad46-4fa6-bce6-52f45ae377f6 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
323 2024.09.02 19:50:08.646819 [ 207169 ] {} <Debug> HTTP-Session: 0f3aed3b-ad46-4fa6-bce6-52f45ae377f6 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
324 2024.09.02 19:50:08.646868 [ 207169 ] {} <Trace> HTTP-Session: 0f3aed3b-ad46-4fa6-bce6-52f45ae377f6 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
325 2024.09.02 19:50:08.647143 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} <Debug> executeQuery: (from [::1]:48516) /* The field tables store named dimensions of each timeseries.
326 *
327 * As with the measurement tables, there is one field table for each field data
328 * type. Fields are deduplicated by using the "replacing merge tree", though
329 * this behavior **must not** be relied upon for query correctness.
330 *
331 * The index for the fields differs from the measurements, however. Rows are
332 * sorted by timeseries name, then field name, field value, and finally
333 * timeseries key. This reflects the most common pattern for looking them up:
334 * by field name and possibly value, within a timeseries. The resulting keys are
335 * usually then used to look up measurements.
336 *
337 * NOTE: We may want to consider a secondary index on these tables, sorting by
338 * timeseries name and then key, since it would improve lookups where one
339 * already has the key. Realistically though, these tables are quite small and
340 * so performance benefits will be low in absolute terms.
341 */
342 CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local ON CLUSTER oximeter_cluster ( timeseries_name String, timeseries_key UInt64, field_name String, field_value Int64, last_updated_at DateTime MATERIALIZED now() ) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + INTERVAL 30 DAY (stage: Complete)
343 2024.09.02 19:50:08.647191 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64_local
344 2024.09.02 19:50:08.647394 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64_local
345 2024.09.02 19:50:08.657655 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
346 2024.09.02 19:50:08.657686 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
347 2024.09.02 19:50:08.669079 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=15, queue_size=15, entries=query-0000000000..query-0000000014, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000013, last_skipped_entry_name=query-0000000009
348 2024.09.02 19:50:08.669096 [ 207410 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000014
349 2024.09.02 19:50:08.669102 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000014
350 2024.09.02 19:50:08.669653 [ 207410 ] {} <Debug> DDLWorker: Processing task query-0000000014 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30))
351 2024.09.02 19:50:08.684503 [ 207410 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
352 2024.09.02 19:50:08.684725 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 52e0bd6c-57f7-404b-ac8a-c1c145cb962a) /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete)
353 2024.09.02 19:50:08.692147 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Loading data parts
354 2024.09.02 19:50:08.693300 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): There are no data parts
355 2024.09.02 19:50:08.698680 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): This table /clickhouse/tables/1/fields_i64_local is already created, will add new replica
356 2024.09.02 19:50:08.699681 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Creating replica /clickhouse/tables/1/fields_i64_local/replicas/3
357 2024.09.02 19:50:08.748700 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Creating shared ID for table oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7)
358 2024.09.02 19:50:08.748828 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Initializing table shared ID with 745b0c5d-7345-48e5-92db-352d47dfc7b4
359 2024.09.02 19:50:08.753597 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Starting up table
360 2024.09.02 19:50:08.753837 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Information> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Became leader
361 2024.09.02 19:50:08.755339 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
362 2024.09.02 19:50:08.755395 [ 207240 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Activating replica.
363 2024.09.02 19:50:08.755423 [ 207240 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
364 2024.09.02 19:50:08.762059 [ 207240 ] {} <Information> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size
365 2024.09.02 19:50:08.762075 [ 207240 ] {} <Information> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size
366 2024.09.02 19:50:08.762078 [ 207240 ] {} <Information> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Will mimic 2
367 2024.09.02 19:50:08.781618 [ 207240 ] {} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Queued 1 parts to be fetched, 0 parts ignored
368 2024.09.02 19:50:08.781634 [ 207240 ] {} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Copied 0 queue entries, 0 entries ignored
369 2024.09.02 19:50:08.781827 [ 207240 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Parts in ZooKeeper after mimic:
370 2024.09.02 19:50:08.781839 [ 207240 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Enqueued fetches after mimic: all_0_0_0
371 2024.09.02 19:50:08.787780 [ 207240 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
372 2024.09.02 19:50:08.788733 [ 207240 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized
373 2024.09.02 19:50:08.790241 [ 207240 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/3/queue
374 2024.09.02 19:50:08.790419 [ 207240 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded.
375 2024.09.02 19:50:08.790644 [ 207240 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0]
376 2024.09.02 19:50:08.794530 [ 207240 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue
377 2024.09.02 19:50:08.796990 [ 207240 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
378 2024.09.02 19:50:08.797142 [ 207256 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 6440ms
379 2024.09.02 19:50:08.797663 [ 207373 ] {} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1
380 2024.09.02 19:50:08.798260 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
381 2024.09.02 19:50:08.798342 [ 207373 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false
382 2024.09.02 19:50:08.798352 [ 207258 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks
383 2024.09.02 19:50:08.798422 [ 207373 ] {} <Trace> HTTPSessionAdapter: Created HTTP(S) session with ::1:19401 (::1:19401)
384 2024.09.02 19:50:08.800609 [ 207373 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Trying to reserve 1.00 MiB using storage policy from min volume index 0
385 2024.09.02 19:50:08.800630 [ 207373 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.75 GiB.
386 2024.09.02 19:50:08.800644 [ 207373 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
387 2024.09.02 19:50:08.800656 [ 207373 ] {} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Fetcher): Downloading part all_0_0_0 onto disk default.
388 2024.09.02 19:50:08.802857 [ 207373 ] {} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Fetcher): Download of part all_0_0_0 onto disk default finished.
389 2024.09.02 19:50:08.802884 [ 207373 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
390 2024.09.02 19:50:08.802935 [ 207373 ] {} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Committing part all_0_0_0 to zookeeper
391 2024.09.02 19:50:08.803122 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
392 2024.09.02 19:50:08.809999 [ 207373 ] {} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Part all_0_0_0 committed to zookeeper
393 2024.09.02 19:50:08.810124 [ 207373 ] {} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1
394 2024.09.02 19:50:08.810297 [ 207241 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89521375232, merge_with_ttl_allowedtrue)
395 2024.09.02 19:50:08.810360 [ 207241 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 8418ms
396 2024.09.02 19:50:08.829091 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} <Debug> executeQuery: Read 3 rows, 141.00 B in 0.182088 sec., 16.475550283379466 rows/sec., 774.35 B/sec.
397 2024.09.02 19:50:08.829537 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} <Debug> DynamicQueryHandler: Done processing query
398 2024.09.02 19:50:08.829575 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} <Debug> MemoryTracker: Peak memory usage (for query): 4.96 MiB.
399 2024.09.02 19:50:08.829587 [ 207169 ] {} <Debug> HTTP-Session: 0f3aed3b-ad46-4fa6-bce6-52f45ae377f6 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
400 2024.09.02 19:50:08.830876 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 226, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
401 2024.09.02 19:50:08.831229 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
402 2024.09.02 19:50:08.831247 [ 207169 ] {} <Debug> HTTP-Session: 1dca7690-b287-4daf-8934-55f93df44083 Authenticating user 'default' from [::1]:48516
403 2024.09.02 19:50:08.831264 [ 207169 ] {} <Debug> HTTP-Session: 1dca7690-b287-4daf-8934-55f93df44083 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
404 2024.09.02 19:50:08.831272 [ 207169 ] {} <Debug> HTTP-Session: 1dca7690-b287-4daf-8934-55f93df44083 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
405 2024.09.02 19:50:08.831319 [ 207169 ] {} <Trace> HTTP-Session: 1dca7690-b287-4daf-8934-55f93df44083 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
406 2024.09.02 19:50:08.831661 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} <Debug> executeQuery: (from [::1]:48516) CREATE TABLE IF NOT EXISTS oximeter.fields_i64 ON CLUSTER oximeter_cluster AS oximeter.fields_i64_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
407 2024.09.02 19:50:08.831714 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64
408 2024.09.02 19:50:08.831726 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
409 2024.09.02 19:50:08.831737 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
410 2024.09.02 19:50:08.831839 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64
411 2024.09.02 19:50:08.831850 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
412 2024.09.02 19:50:08.844629 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
413 2024.09.02 19:50:08.844678 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
414 2024.09.02 19:50:08.844958 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=16, queue_size=16, entries=query-0000000000..query-0000000015, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000014, last_skipped_entry_name=query-0000000009
415 2024.09.02 19:50:08.844975 [ 207410 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000015
416 2024.09.02 19:50:08.844981 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000015
417 2024.09.02 19:50:08.848603 [ 207410 ] {} <Debug> DDLWorker: Processing task query-0000000015 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])))
418 2024.09.02 19:50:08.869648 [ 207410 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
419 2024.09.02 19:50:08.869834 [ 207410 ] {bbd4ccf6-328d-4028-b907-0ea05c861daa} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c2d8387b-0b77-4c12-a4d5-0e5372331992) /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
420 2024.09.02 19:50:08.871793 [ 207410 ] {bbd4ccf6-328d-4028-b907-0ea05c861daa} <Debug> StorageDistributed (fields_i64): Auto-increment is 0
421 2024.09.02 19:50:08.878369 [ 207410 ] {bbd4ccf6-328d-4028-b907-0ea05c861daa} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))
422 2024.09.02 19:50:08.883261 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
423 2024.09.02 19:50:08.972900 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} <Debug> executeQuery: Read 3 rows, 141.00 B in 0.141423 sec., 21.212956874058676 rows/sec., 997.01 B/sec.
424 2024.09.02 19:50:08.973156 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} <Debug> DynamicQueryHandler: Done processing query
425 2024.09.02 19:50:08.973172 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} <Debug> MemoryTracker: Peak memory usage (for query): 3.98 MiB.
426 2024.09.02 19:50:08.973180 [ 207169 ] {} <Debug> HTTP-Session: 1dca7690-b287-4daf-8934-55f93df44083 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
427 2024.09.02 19:50:08.974134 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 441, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
428 2024.09.02 19:50:08.975099 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
429 2024.09.02 19:50:08.975111 [ 207169 ] {} <Debug> HTTP-Session: 201614a0-b642-4615-8012-89529ed22b77 Authenticating user 'default' from [::1]:48516
430 2024.09.02 19:50:08.975121 [ 207169 ] {} <Debug> HTTP-Session: 201614a0-b642-4615-8012-89529ed22b77 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
431 2024.09.02 19:50:08.975126 [ 207169 ] {} <Debug> HTTP-Session: 201614a0-b642-4615-8012-89529ed22b77 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
432 2024.09.02 19:50:08.975155 [ 207169 ] {} <Trace> HTTP-Session: 201614a0-b642-4615-8012-89529ed22b77 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
433 2024.09.02 19:50:08.975336 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} <Debug> executeQuery: (from [::1]:48516) CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local ON CLUSTER oximeter_cluster ( timeseries_name String, timeseries_key UInt64, field_name String, field_value UUID, last_updated_at DateTime MATERIALIZED now() ) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + INTERVAL 30 DAY (stage: Complete)
434 2024.09.02 19:50:08.975379 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid_local
435 2024.09.02 19:50:08.975528 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid_local
436 2024.09.02 19:50:08.988069 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
437 2024.09.02 19:50:08.988078 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
438 2024.09.02 19:50:08.999595 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=17, queue_size=17, entries=query-0000000000..query-0000000016, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000015, last_skipped_entry_name=query-0000000009
439 2024.09.02 19:50:09.001323 [ 207410 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000016
440 2024.09.02 19:50:09.001334 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000016
441 2024.09.02 19:50:09.002030 [ 207410 ] {} <Debug> DDLWorker: Processing task query-0000000016 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30))
442 2024.09.02 19:50:09.017013 [ 207410 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
443 2024.09.02 19:50:09.017187 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 29ec56c2-ebf7-4c6a-972e-826e0b263337) /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete)
444 2024.09.02 19:50:09.023651 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Loading data parts
445 2024.09.02 19:50:09.025356 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): There are no data parts
446 2024.09.02 19:50:09.032094 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): This table /clickhouse/tables/1/fields_uuid_local is already created, will add new replica
447 2024.09.02 19:50:09.033297 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Creating replica /clickhouse/tables/1/fields_uuid_local/replicas/3
448 2024.09.02 19:50:09.104546 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Creating shared ID for table oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38)
449 2024.09.02 19:50:09.104716 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Initializing table shared ID with 2a01182b-0909-4138-ac40-9871004f15b4
450 2024.09.02 19:50:09.113461 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Starting up table
451 2024.09.02 19:50:09.113657 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Information> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Became leader
452 2024.09.02 19:50:09.113667 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
453 2024.09.02 19:50:09.113708 [ 207261 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Activating replica.
454 2024.09.02 19:50:09.113730 [ 207261 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
455 2024.09.02 19:50:09.120867 [ 207261 ] {} <Information> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size
456 2024.09.02 19:50:09.120884 [ 207261 ] {} <Information> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size
457 2024.09.02 19:50:09.120887 [ 207261 ] {} <Information> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Will mimic 1
458 2024.09.02 19:50:09.131622 [ 207261 ] {} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Queued 1 parts to be fetched, 0 parts ignored
459 2024.09.02 19:50:09.131636 [ 207261 ] {} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Copied 0 queue entries, 0 entries ignored
460 2024.09.02 19:50:09.131834 [ 207261 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Parts in ZooKeeper after mimic:
461 2024.09.02 19:50:09.131848 [ 207261 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Enqueued fetches after mimic: all_0_0_0
462 2024.09.02 19:50:09.136193 [ 207261 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue
463 2024.09.02 19:50:09.136346 [ 207261 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized
464 2024.09.02 19:50:09.136353 [ 207261 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/3/queue
465 2024.09.02 19:50:09.136475 [ 207261 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded.
466 2024.09.02 19:50:09.136593 [ 207261 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0]
467 2024.09.02 19:50:09.142078 [ 207261 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue
468 2024.09.02 19:50:09.142991 [ 207261 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully
469 2024.09.02 19:50:09.143127 [ 207265 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 6063ms
470 2024.09.02 19:50:09.143588 [ 207375 ] {} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/2
471 2024.09.02 19:50:09.144498 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)
472 2024.09.02 19:50:09.144741 [ 207375 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19402/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false
473 2024.09.02 19:50:09.146923 [ 207375 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Trying to reserve 1.00 MiB using storage policy from min volume index 0
474 2024.09.02 19:50:09.146943 [ 207375 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.74 GiB.
475 2024.09.02 19:50:09.146957 [ 207375 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
476 2024.09.02 19:50:09.146969 [ 207375 ] {} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (Fetcher): Downloading part all_0_0_0 onto disk default.
477 2024.09.02 19:50:09.147936 [ 207375 ] {} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (Fetcher): Download of part all_0_0_0 onto disk default finished.
478 2024.09.02 19:50:09.147958 [ 207375 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
479 2024.09.02 19:50:09.148069 [ 207248 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks
480 2024.09.02 19:50:09.149824 [ 207375 ] {} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Committing part all_0_0_0 to zookeeper
481 2024.09.02 19:50:09.150059 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
482 2024.09.02 19:50:09.153233 [ 207375 ] {} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Part all_0_0_0 committed to zookeeper
483 2024.09.02 19:50:09.153300 [ 207375 ] {} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/2
484 2024.09.02 19:50:09.153381 [ 207251 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89516068864, merge_with_ttl_allowedtrue)
485 2024.09.02 19:50:09.154662 [ 207251 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 7432ms
486 2024.09.02 19:50:09.165857 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} <Debug> executeQuery: Read 3 rows, 141.00 B in 0.190607 sec., 15.73919111050486 rows/sec., 739.74 B/sec.
487 2024.09.02 19:50:09.166573 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} <Debug> DynamicQueryHandler: Done processing query
488 2024.09.02 19:50:09.166592 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} <Debug> MemoryTracker: Peak memory usage (for query): 4.96 MiB.
489 2024.09.02 19:50:09.166600 [ 207169 ] {} <Debug> HTTP-Session: 201614a0-b642-4615-8012-89529ed22b77 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
490 2024.09.02 19:50:09.167680 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 229, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
491 2024.09.02 19:50:09.171133 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
492 2024.09.02 19:50:09.171153 [ 207169 ] {} <Debug> HTTP-Session: bfad78a0-53a2-4ae0-b0d8-a383dbbe6ff1 Authenticating user 'default' from [::1]:48516
493 2024.09.02 19:50:09.171168 [ 207169 ] {} <Debug> HTTP-Session: bfad78a0-53a2-4ae0-b0d8-a383dbbe6ff1 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
494 2024.09.02 19:50:09.171175 [ 207169 ] {} <Debug> HTTP-Session: bfad78a0-53a2-4ae0-b0d8-a383dbbe6ff1 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
495 2024.09.02 19:50:09.171223 [ 207169 ] {} <Trace> HTTP-Session: bfad78a0-53a2-4ae0-b0d8-a383dbbe6ff1 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
496 2024.09.02 19:50:09.171496 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} <Debug> executeQuery: (from [::1]:48516) CREATE TABLE IF NOT EXISTS oximeter.fields_uuid ON CLUSTER oximeter_cluster AS oximeter.fields_uuid_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
497 2024.09.02 19:50:09.171538 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid
498 2024.09.02 19:50:09.171549 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
499 2024.09.02 19:50:09.171559 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
500 2024.09.02 19:50:09.171628 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid
501 2024.09.02 19:50:09.171635 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
502 2024.09.02 19:50:09.185128 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
503 2024.09.02 19:50:09.185160 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
504 2024.09.02 19:50:09.193617 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=18, queue_size=18, entries=query-0000000000..query-0000000017, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000016, last_skipped_entry_name=query-0000000009
505 2024.09.02 19:50:09.193635 [ 207410 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000017
506 2024.09.02 19:50:09.193640 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000017
507 2024.09.02 19:50:09.194148 [ 207410 ] {} <Debug> DDLWorker: Processing task query-0000000017 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])))
508 2024.09.02 19:50:09.208344 [ 207410 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))
509 2024.09.02 19:50:09.208507 [ 207410 ] {11ccae3b-7297-4aef-a9cd-3e81c5c96061} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b26d03ab-2e2b-49cd-9b59-6df10b4b32a7) /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
510 2024.09.02 19:50:09.210653 [ 207410 ] {11ccae3b-7297-4aef-a9cd-3e81c5c96061} <Debug> StorageDistributed (fields_uuid): Auto-increment is 0
511 2024.09.02 19:50:09.215348 [ 207410 ] {11ccae3b-7297-4aef-a9cd-3e81c5c96061} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))
512 2024.09.02 19:50:09.219715 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
513 2024.09.02 19:50:09.295097 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} <Debug> executeQuery: Read 3 rows, 141.00 B in 0.123712 sec., 24.24987066735644 rows/sec., 1.11 KiB/sec.
514 2024.09.02 19:50:09.295292 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} <Debug> DynamicQueryHandler: Done processing query
515 2024.09.02 19:50:09.295304 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} <Debug> MemoryTracker: Peak memory usage (for query): 3.98 MiB.
516 2024.09.02 19:50:09.295310 [ 207169 ] {} <Debug> HTTP-Session: bfad78a0-53a2-4ae0-b0d8-a383dbbe6ff1 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
517 2024.09.02 19:50:09.296222 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 1525, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
518 2024.09.02 19:50:09.296252 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
519 2024.09.02 19:50:09.296260 [ 207169 ] {} <Debug> HTTP-Session: 995482cd-edeb-476f-a923-9ee4479ce121 Authenticating user 'default' from [::1]:48516
520 2024.09.02 19:50:09.296270 [ 207169 ] {} <Debug> HTTP-Session: 995482cd-edeb-476f-a923-9ee4479ce121 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
521 2024.09.02 19:50:09.296273 [ 207169 ] {} <Debug> HTTP-Session: 995482cd-edeb-476f-a923-9ee4479ce121 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
522 2024.09.02 19:50:09.296305 [ 207169 ] {} <Trace> HTTP-Session: 995482cd-edeb-476f-a923-9ee4479ce121 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
523 2024.09.02 19:50:09.296678 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} <Debug> executeQuery: (from [::1]:48516) /* The timeseries schema table stores the extracted schema for the samples
524 * oximeter collects.
525 */
526 CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local ON CLUSTER oximeter_cluster ( timeseries_name String, fields Nested( name String, type Enum( 'Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13 ), source Enum( 'Target' = 1, 'Metric' = 2 ) ), datum_type Enum( 'Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27 ), created DateTime64(9, 'UTC') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete)
527 2024.09.02 19:50:09.296735 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema_local
528 2024.09.02 19:50:09.297057 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema_local
529 2024.09.02 19:50:09.308605 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
530 2024.09.02 19:50:09.308608 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
531 2024.09.02 19:50:09.322418 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=19, queue_size=19, entries=query-0000000000..query-0000000018, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000017, last_skipped_entry_name=query-0000000009
532 2024.09.02 19:50:09.322438 [ 207410 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000018
533 2024.09.02 19:50:09.322443 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000018
534 2024.09.02 19:50:09.329753 [ 207410 ] {} <Debug> DDLWorker: Processing task query-0000000018 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name))
535 2024.09.02 19:50:09.344941 [ 207410 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)
536 2024.09.02 19:50:09.347021 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 454fe081-af0d-4e06-9b21-59389f961b7a) /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete)
537 2024.09.02 19:50:09.353720 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Loading data parts
538 2024.09.02 19:50:09.353995 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): There are no data parts
539 2024.09.02 19:50:09.359547 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): This table /clickhouse/tables/1/timeseries_schema_local is already created, will add new replica
540 2024.09.02 19:50:09.360577 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Creating replica /clickhouse/tables/1/timeseries_schema_local/replicas/3
541 2024.09.02 19:50:09.424011 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Creating shared ID for table oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034)
542 2024.09.02 19:50:09.424302 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Initializing table shared ID with a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b
543 2024.09.02 19:50:09.428763 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Starting up table
544 2024.09.02 19:50:09.428942 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Information> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Became leader
545 2024.09.02 19:50:09.428953 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
546 2024.09.02 19:50:09.429012 [ 207236 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Activating replica.
547 2024.09.02 19:50:09.429029 [ 207236 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
548 2024.09.02 19:50:09.434281 [ 207236 ] {} <Information> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size
549 2024.09.02 19:50:09.434303 [ 207236 ] {} <Information> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size
550 2024.09.02 19:50:09.434308 [ 207236 ] {} <Information> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Will mimic 2
551 2024.09.02 19:50:09.445677 [ 207236 ] {} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Queued 1 parts to be fetched, 0 parts ignored
552 2024.09.02 19:50:09.445692 [ 207236 ] {} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Copied 0 queue entries, 0 entries ignored
553 2024.09.02 19:50:09.445856 [ 207236 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Parts in ZooKeeper after mimic:
554 2024.09.02 19:50:09.445865 [ 207236 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Enqueued fetches after mimic: all_0_0_0
555 2024.09.02 19:50:09.452799 [ 207236 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue
556 2024.09.02 19:50:09.454609 [ 207236 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized
557 2024.09.02 19:50:09.454623 [ 207236 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/3/queue
558 2024.09.02 19:50:09.454775 [ 207236 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded.
559 2024.09.02 19:50:09.456387 [ 207236 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0]
560 2024.09.02 19:50:09.460405 [ 207236 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue
561 2024.09.02 19:50:09.461203 [ 207236 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully
562 2024.09.02 19:50:09.461385 [ 207286 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 6346ms
563 2024.09.02 19:50:09.461703 [ 207289 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/timeseries_schema_local/blocks
564 2024.09.02 19:50:09.461839 [ 207381 ] {} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Fetching part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/2
565 2024.09.02 19:50:09.462338 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)
566 2024.09.02 19:50:09.462387 [ 207381 ] {} <Trace> ReadWriteBufferFromHTTP: Sending request to http://[::1]:19402/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ftimeseries_schema_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false
567 2024.09.02 19:50:09.463005 [ 207381 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Trying to reserve 1.00 MiB using storage policy from min volume index 0
568 2024.09.02 19:50:09.463021 [ 207381 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.73 GiB.
569 2024.09.02 19:50:09.463043 [ 207381 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local'
570 2024.09.02 19:50:09.463058 [ 207381 ] {} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (Fetcher): Downloading part all_0_0_0 onto disk default.
571 2024.09.02 19:50:09.465660 [ 207381 ] {} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (Fetcher): Download of part all_0_0_0 onto disk default finished.
572 2024.09.02 19:50:09.465677 [ 207381 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
573 2024.09.02 19:50:09.465705 [ 207381 ] {} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Committing part all_0_0_0 to zookeeper
574 2024.09.02 19:50:09.466356 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
575 2024.09.02 19:50:09.470946 [ 207381 ] {} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Part all_0_0_0 committed to zookeeper
576 2024.09.02 19:50:09.471002 [ 207381 ] {} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Fetched part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/2
577 2024.09.02 19:50:09.471065 [ 207291 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89514426368, merge_with_ttl_allowedtrue)
578 2024.09.02 19:50:09.471084 [ 207291 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 7668ms
579 2024.09.02 19:50:09.485117 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} <Debug> executeQuery: Read 3 rows, 141.00 B in 0.188695 sec., 15.89867246084952 rows/sec., 747.24 B/sec.
580 2024.09.02 19:50:09.485373 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} <Debug> DynamicQueryHandler: Done processing query
581 2024.09.02 19:50:09.485391 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} <Debug> MemoryTracker: Peak memory usage (for query): 4.96 MiB.
582 2024.09.02 19:50:09.485398 [ 207169 ] {} <Debug> HTTP-Session: 995482cd-edeb-476f-a923-9ee4479ce121 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
583 2024.09.02 19:50:09.486336 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 247, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
584 2024.09.02 19:50:09.487468 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
585 2024.09.02 19:50:09.487483 [ 207169 ] {} <Debug> HTTP-Session: ab299f71-b1cc-44fc-87aa-8256c97c2e35 Authenticating user 'default' from [::1]:48516
586 2024.09.02 19:50:09.487495 [ 207169 ] {} <Debug> HTTP-Session: ab299f71-b1cc-44fc-87aa-8256c97c2e35 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
587 2024.09.02 19:50:09.487499 [ 207169 ] {} <Debug> HTTP-Session: ab299f71-b1cc-44fc-87aa-8256c97c2e35 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
588 2024.09.02 19:50:09.487532 [ 207169 ] {} <Trace> HTTP-Session: ab299f71-b1cc-44fc-87aa-8256c97c2e35 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
589 2024.09.02 19:50:09.487692 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} <Debug> executeQuery: (from [::1]:48516) CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema ON CLUSTER oximeter_cluster AS oximeter.timeseries_schema_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
590 2024.09.02 19:50:09.487722 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema
591 2024.09.02 19:50:09.487728 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
592 2024.09.02 19:50:09.487734 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
593 2024.09.02 19:50:09.487914 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema
594 2024.09.02 19:50:09.487923 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} <Trace> ContextAccess (default): Access granted: REMOTE ON *.*
595 2024.09.02 19:50:09.499538 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
596 2024.09.02 19:50:09.499547 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
597 2024.09.02 19:50:09.507742 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000018, last_skipped_entry_name=query-0000000009
598 2024.09.02 19:50:09.507760 [ 207410 ] {} <Debug> DDLWorker: Will schedule 1 tasks starting from query-0000000019
599 2024.09.02 19:50:09.507765 [ 207410 ] {} <Trace> DDLWorker: Checking task query-0000000019
600 2024.09.02 19:50:09.508563 [ 207410 ] {} <Debug> DDLWorker: Processing task query-0000000019 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])))
601 2024.09.02 19:50:09.518341 [ 207410 ] {} <Debug> DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))
602 2024.09.02 19:50:09.518560 [ 207410 ] {31eca893-b8a9-4bc0-ac2a-2aaeb5b00b34} <Debug> executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 85056d0b-f852-4bad-8f4f-7ed622143aae) /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete)
603 2024.09.02 19:50:09.519164 [ 207410 ] {31eca893-b8a9-4bc0-ac2a-2aaeb5b00b34} <Debug> StorageDistributed (timeseries_schema): Auto-increment is 0
604 2024.09.02 19:50:09.526280 [ 207410 ] {31eca893-b8a9-4bc0-ac2a-2aaeb5b00b34} <Debug> DDLWorker: Executed query: /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))
605 2024.09.02 19:50:09.530883 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
606 2024.09.02 19:50:09.609524 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} <Debug> executeQuery: Read 3 rows, 141.00 B in 0.12189 sec., 24.61235540241201 rows/sec., 1.13 KiB/sec.
607 2024.09.02 19:50:09.609852 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} <Debug> DynamicQueryHandler: Done processing query
608 2024.09.02 19:50:09.609872 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} <Debug> MemoryTracker: Peak memory usage (for query): 3.98 MiB.
609 2024.09.02 19:50:09.609879 [ 207169 ] {} <Debug> HTTP-Session: ab299f71-b1cc-44fc-87aa-8256c97c2e35 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
610 2024.09.02 19:50:09.611733 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 60, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
611 2024.09.02 19:50:09.611773 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
612 2024.09.02 19:50:09.611781 [ 207169 ] {} <Debug> HTTP-Session: d5f34d5d-9f32-4652-9ad0-183a43bef943 Authenticating user 'default' from [::1]:48516
613 2024.09.02 19:50:09.611792 [ 207169 ] {} <Debug> HTTP-Session: d5f34d5d-9f32-4652-9ad0-183a43bef943 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
614 2024.09.02 19:50:09.611795 [ 207169 ] {} <Debug> HTTP-Session: d5f34d5d-9f32-4652-9ad0-183a43bef943 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
615 2024.09.02 19:50:09.611830 [ 207169 ] {} <Trace> HTTP-Session: d5f34d5d-9f32-4652-9ad0-183a43bef943 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
616 2024.09.02 19:50:09.611973 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Debug> executeQuery: (from [::1]:48516) SELECT * FROM oximeter.timeseries_schema FORMAT JSONEachRow; (stage: Complete)
617 2024.09.02 19:50:09.612183 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema
618 2024.09.02 19:50:09.612328 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema
619 2024.09.02 19:50:09.612509 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local
620 2024.09.02 19:50:09.612553 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
621 2024.09.02 19:50:09.612623 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Trace> InterpreterSelectQuery: Complete -> Complete
622 2024.09.02 19:50:09.613853 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (SelectExecutor): Key condition: unknown
623 2024.09.02 19:50:09.613877 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Debug> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges
624 2024.09.02 19:50:09.613887 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (SelectExecutor): Spreading mark ranges among streams (default reading)
625 2024.09.02 19:50:09.613906 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0
626 2024.09.02 19:50:09.614896 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Debug> executeQuery: Read 1 rows, 126.00 B in 0.002962 sec., 337.60972316002704 rows/sec., 41.54 KiB/sec.
627 2024.09.02 19:50:09.616040 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Debug> DynamicQueryHandler: Done processing query
628 2024.09.02 19:50:09.616060 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} <Debug> MemoryTracker: Peak memory usage (for query): 4.00 MiB.
629 2024.09.02 19:50:09.616066 [ 207169 ] {} <Debug> HTTP-Session: d5f34d5d-9f32-4652-9ad0-183a43bef943 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
630 2024.09.02 19:50:09.619409 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
631 2024.09.02 19:50:09.619473 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
632 2024.09.02 19:50:09.619485 [ 207169 ] {} <Debug> HTTP-Session: b9f26908-2f01-4f3e-9d33-036747731ae1 Authenticating user 'default' from [::1]:48516
633 2024.09.02 19:50:09.619500 [ 207169 ] {} <Debug> HTTP-Session: b9f26908-2f01-4f3e-9d33-036747731ae1 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
634 2024.09.02 19:50:09.619505 [ 207169 ] {} <Debug> HTTP-Session: b9f26908-2f01-4f3e-9d33-036747731ae1 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
635 2024.09.02 19:50:09.619551 [ 207169 ] {} <Trace> HTTP-Session: b9f26908-2f01-4f3e-9d33-036747731ae1 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
636 2024.09.02 19:50:09.619918 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> executeQuery: (from [::1]:48516) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete)
637 2024.09.02 19:50:09.620344 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
638 2024.09.02 19:50:09.620583 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
639 2024.09.02 19:50:09.620786 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
640 2024.09.02 19:50:09.622589 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
641 2024.09.02 19:50:09.623368 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
642 2024.09.02 19:50:09.623466 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> HashJoin: (0x7efc8cbf3298) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
643 2024.09.02 19:50:09.623477 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> HashJoin: (0x7efc8cbf3298) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
644 2024.09.02 19:50:09.623569 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> HashJoin: (0x7efc8cbf3298) Join data is being destroyed, 12288 bytes and 0 rows in hash table
645 2024.09.02 19:50:09.623881 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
646 2024.09.02 19:50:09.624287 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
647 2024.09.02 19:50:09.624355 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> HashJoin: (0x7efc1089cf18) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
648 2024.09.02 19:50:09.624363 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> HashJoin: (0x7efc1089cf18) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
649 2024.09.02 19:50:09.624885 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
650 2024.09.02 19:50:09.625784 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
651 2024.09.02 19:50:09.626008 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
652 2024.09.02 19:50:09.626022 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
653 2024.09.02 19:50:09.626128 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local
654 2024.09.02 19:50:09.626163 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
655 2024.09.02 19:50:09.626185 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: Complete -> Complete
656 2024.09.02 19:50:09.626217 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> HashJoin: (0x7efc1089ca18) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0)
657 2024.09.02 19:50:09.626223 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> HashJoin: (0x7efc1089ca18) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)]
658 2024.09.02 19:50:09.626570 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
659 2024.09.02 19:50:09.627720 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
660 2024.09.02 19:50:09.627904 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
661 2024.09.02 19:50:09.628068 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
662 2024.09.02 19:50:09.628079 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
663 2024.09.02 19:50:09.628179 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local
664 2024.09.02 19:50:09.628230 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
665 2024.09.02 19:50:09.628279 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: Complete -> Complete
666 2024.09.02 19:50:09.628337 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> HashJoin: (0x7efc1089d418) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
667 2024.09.02 19:50:09.628347 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> HashJoin: (0x7efc1089d418) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
668 2024.09.02 19:50:09.628439 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> HashJoin: (0x7efc1089cf18) Join data is being destroyed, 12288 bytes and 0 rows in hash table
669 2024.09.02 19:50:09.628698 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
670 2024.09.02 19:50:09.628879 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
671 2024.09.02 19:50:09.629027 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
672 2024.09.02 19:50:09.629040 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
673 2024.09.02 19:50:09.629146 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local
674 2024.09.02 19:50:09.629177 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
675 2024.09.02 19:50:09.629198 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: Complete -> Complete
676 2024.09.02 19:50:09.629202 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
677 2024.09.02 19:50:09.629213 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)'
678 2024.09.02 19:50:09.629228 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)'
679 2024.09.02 19:50:09.629250 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
680 2024.09.02 19:50:09.629266 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)'
681 2024.09.02 19:50:09.629299 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)'
682 2024.09.02 19:50:09.629554 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
683 2024.09.02 19:50:09.629583 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
684 2024.09.02 19:50:09.629610 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (LEFT) boundary mark: 0
685 2024.09.02 19:50:09.629618 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (RIGHT) boundary mark: 2
686 2024.09.02 19:50:09.629626 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found continuous range in 2 steps
687 2024.09.02 19:50:09.629644 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges
688 2024.09.02 19:50:09.629653 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Spreading mark ranges among streams (default reading)
689 2024.09.02 19:50:09.629724 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
690 2024.09.02 19:50:09.629735 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 8 rows starting from 0
691 2024.09.02 19:50:09.629809 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
692 2024.09.02 19:50:09.629820 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
693 2024.09.02 19:50:09.629829 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0
694 2024.09.02 19:50:09.629832 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 1
695 2024.09.02 19:50:09.629837 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps
696 2024.09.02 19:50:09.629846 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges
697 2024.09.02 19:50:09.629850 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Spreading mark ranges among streams (default reading)
698 2024.09.02 19:50:09.629894 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
699 2024.09.02 19:50:09.629900 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0
700 2024.09.02 19:50:09.629936 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)'
701 2024.09.02 19:50:09.629951 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)'
702 2024.09.02 19:50:09.630024 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
703 2024.09.02 19:50:09.630037 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
704 2024.09.02 19:50:09.630047 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0
705 2024.09.02 19:50:09.630053 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 2
706 2024.09.02 19:50:09.630060 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps
707 2024.09.02 19:50:09.630072 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges
708 2024.09.02 19:50:09.630078 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Spreading mark ranges among streams (default reading)
709 2024.09.02 19:50:09.630140 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
710 2024.09.02 19:50:09.630150 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0
711 2024.09.02 19:50:09.630189 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)'
712 2024.09.02 19:50:09.631302 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)'
713 2024.09.02 19:50:09.632552 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> executeQuery: Read 40 rows, 2.89 KiB in 0.012888 sec., 3103.6623215394166 rows/sec., 224.29 KiB/sec.
714 2024.09.02 19:50:09.633378 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> HashJoin: (0x7efc1089ca18) Join data is being destroyed, 12544 bytes and 8 rows in hash table
715 2024.09.02 19:50:09.633444 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Trace> HashJoin: (0x7efc1089d418) Join data is being destroyed, 12800 bytes and 8 rows in hash table
716 2024.09.02 19:50:09.633722 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> DynamicQueryHandler: Done processing query
717 2024.09.02 19:50:09.633737 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} <Debug> MemoryTracker: Peak memory usage (for query): 4.00 MiB.
718 2024.09.02 19:50:09.633750 [ 207169 ] {} <Debug> HTTP-Session: b9f26908-2f01-4f3e-9d33-036747731ae1 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
719 2024.09.02 19:50:09.634955 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 411, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
720 2024.09.02 19:50:09.634993 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
721 2024.09.02 19:50:09.634999 [ 207169 ] {} <Debug> HTTP-Session: f120b79e-7d39-4991-bb9a-fb5d974bb742 Authenticating user 'default' from [::1]:48516
722 2024.09.02 19:50:09.635009 [ 207169 ] {} <Debug> HTTP-Session: f120b79e-7d39-4991-bb9a-fb5d974bb742 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
723 2024.09.02 19:50:09.635014 [ 207169 ] {} <Debug> HTTP-Session: f120b79e-7d39-4991-bb9a-fb5d974bb742 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
724 2024.09.02 19:50:09.635046 [ 207169 ] {} <Trace> HTTP-Session: f120b79e-7d39-4991-bb9a-fb5d974bb742 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
725 2024.09.02 19:50:09.635400 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Debug> executeQuery: (from [::1]:48516) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (163777662738179873,3255198277614561830,4174330440898734823,5073661756869813506,6060338002058112069,10232564214925740701,10613593354210677318,16549134671421491687)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete)
726 2024.09.02 19:50:09.635832 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64
727 2024.09.02 19:50:09.639200 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64
728 2024.09.02 19:50:09.639460 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
729 2024.09.02 19:50:09.640575 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 10232564214925740701, 10613593354210677318, 16549134671421491687)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
730 2024.09.02 19:50:09.640772 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local
731 2024.09.02 19:50:09.640817 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
732 2024.09.02 19:50:09.640871 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Trace> InterpreterSelectQuery: Complete -> Complete
733 2024.09.02 19:50:09.641011 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Key condition: (column 1 in 8-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
734 2024.09.02 19:50:09.641035 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps
735 2024.09.02 19:50:09.641049 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges
736 2024.09.02 19:50:09.641062 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Spreading ranges among streams with order
737 2024.09.02 19:50:09.641115 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 10232564214925740701, 10613593354210677318, 16549134671421491687))", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
738 2024.09.02 19:50:09.641124 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0
739 2024.09.02 19:50:09.643931 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Debug> executeQuery: Read 400 rows, 25.78 KiB in 0.00865 sec., 46242.77456647399 rows/sec., 2.91 MiB/sec.
740 2024.09.02 19:50:09.645402 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Debug> DynamicQueryHandler: Done processing query
741 2024.09.02 19:50:09.645416 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} <Debug> MemoryTracker: Peak memory usage (for query): 3.99 MiB.
742 2024.09.02 19:50:09.645424 [ 207169 ] {} <Debug> HTTP-Session: f120b79e-7d39-4991-bb9a-fb5d974bb742 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
743 2024.09.02 19:50:10.000990 [ 207413 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 373.87 MiB, peak 380.08 MiB, free memory in arenas 37.85 MiB, will set to 379.26 MiB (RSS), difference: 5.39 MiB
744 2024.09.02 19:50:10.089521 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 1033, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
745 2024.09.02 19:50:10.089581 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
746 2024.09.02 19:50:10.089593 [ 207169 ] {} <Debug> HTTP-Session: afe8e3e6-7267-4613-802b-88f6dc497797 Authenticating user 'default' from [::1]:48516
747 2024.09.02 19:50:10.089608 [ 207169 ] {} <Debug> HTTP-Session: afe8e3e6-7267-4613-802b-88f6dc497797 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
748 2024.09.02 19:50:10.089614 [ 207169 ] {} <Debug> HTTP-Session: afe8e3e6-7267-4613-802b-88f6dc497797 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
749 2024.09.02 19:50:10.089659 [ 207169 ] {} <Trace> HTTP-Session: afe8e3e6-7267-4613-802b-88f6dc497797 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
750 2024.09.02 19:50:10.089895 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Debug> executeQuery: (from [::1]:48516) INSERT INTO oximeter.fields_i64 FORMAT JSONEachRow (stage: Complete)
751 2024.09.02 19:50:10.089954 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Trace> ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
752 2024.09.02 19:50:10.090304 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Trace> ParallelParsingInputFormat: Parallel parsing is used
753 2024.09.02 19:50:10.090805 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Trace> ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local
754 2024.09.02 19:50:10.092429 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Trying to reserve 1.00 MiB using storage policy from min volume index 0
755 2024.09.02 19:50:10.092451 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.66 GiB.
756 2024.09.02 19:50:10.092882 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Trace> MergedBlockOutputStream: filled checksums all_1_1_0 (state Temporary)
757 2024.09.02 19:50:10.094906 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): Wrote block with ID 'all_14521790212482541105_11730042875930291332', 8 rows
758 2024.09.02 19:50:10.102121 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
759 2024.09.02 19:50:10.108706 [ 207278 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89475713024, merge_with_ttl_allowedtrue)
760 2024.09.02 19:50:10.108752 [ 207278 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 10136ms
761 2024.09.02 19:50:10.108908 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Debug> executeQuery: Read 8 rows, 512.00 B in 0.019071 sec., 419.48508206176916 rows/sec., 26.22 KiB/sec.
762 2024.09.02 19:50:10.109096 [ 207257 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001
763 2024.09.02 19:50:10.111111 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Debug> DynamicQueryHandler: Done processing query
764 2024.09.02 19:50:10.111130 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} <Debug> MemoryTracker: Peak memory usage (for query): 4.28 MiB.
765 2024.09.02 19:50:10.111142 [ 207169 ] {} <Debug> HTTP-Session: afe8e3e6-7267-4613-802b-88f6dc497797 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
766 2024.09.02 19:50:10.113585 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 2680, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
767 2024.09.02 19:50:10.113632 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
768 2024.09.02 19:50:10.113642 [ 207169 ] {} <Debug> HTTP-Session: 62333122-095d-4d55-8f03-0da4b9072730 Authenticating user 'default' from [::1]:48516
769 2024.09.02 19:50:10.113654 [ 207169 ] {} <Debug> HTTP-Session: 62333122-095d-4d55-8f03-0da4b9072730 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
770 2024.09.02 19:50:10.113660 [ 207169 ] {} <Debug> HTTP-Session: 62333122-095d-4d55-8f03-0da4b9072730 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
771 2024.09.02 19:50:10.113709 [ 207169 ] {} <Trace> HTTP-Session: 62333122-095d-4d55-8f03-0da4b9072730 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
772 2024.09.02 19:50:10.113852 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Debug> executeQuery: (from [::1]:48516) INSERT INTO oximeter.fields_uuid FORMAT JSONEachRow (stage: Complete)
773 2024.09.02 19:50:10.113914 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Trace> ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
774 2024.09.02 19:50:10.114208 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Trace> ParallelParsingInputFormat: Parallel parsing is used
775 2024.09.02 19:50:10.115342 [ 207171 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51138, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
776 2024.09.02 19:50:10.115690 [ 207171 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false
777 2024.09.02 19:50:10.115704 [ 207171 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated PartsService): Sending part all_1_1_0
778 2024.09.02 19:50:10.116002 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Trace> ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local
779 2024.09.02 19:50:10.116147 [ 207171 ] {} <Debug> InterserverIOHTTPHandler: Done processing query
780 2024.09.02 19:50:10.116299 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Trying to reserve 1.00 MiB using storage policy from min volume index 0
781 2024.09.02 19:50:10.116316 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.66 GiB.
782 2024.09.02 19:50:10.118138 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Trace> MergedBlockOutputStream: filled checksums all_1_1_0 (state Temporary)
783 2024.09.02 19:50:10.118449 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (Replicated OutputStream): Wrote block with ID 'all_11146204176185123901_10197187094774023637', 16 rows
784 2024.09.02 19:50:10.124207 [ 207257 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0]
785 2024.09.02 19:50:10.125645 [ 207257 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
786 2024.09.02 19:50:10.138225 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
787 2024.09.02 19:50:10.153075 [ 207262 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89475475456, merge_with_ttl_allowedtrue)
788 2024.09.02 19:50:10.153102 [ 207262 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 9022ms
789 2024.09.02 19:50:10.153118 [ 207171 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51138, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
790 2024.09.02 19:50:10.153159 [ 207171 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false
791 2024.09.02 19:50:10.153173 [ 207171 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (Replicated PartsService): Sending part all_1_1_0
792 2024.09.02 19:50:10.153213 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Debug> executeQuery: Read 16 rows, 1.20 KiB in 0.039395 sec., 406.1429115369971 rows/sec., 30.34 KiB/sec.
793 2024.09.02 19:50:10.153471 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Debug> DynamicQueryHandler: Done processing query
794 2024.09.02 19:50:10.153490 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} <Debug> MemoryTracker: Peak memory usage (for query): 4.28 MiB.
795 2024.09.02 19:50:10.153502 [ 207169 ] {} <Debug> HTTP-Session: 62333122-095d-4d55-8f03-0da4b9072730 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
796 2024.09.02 19:50:10.154520 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 74687, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
797 2024.09.02 19:50:10.155048 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
798 2024.09.02 19:50:10.155064 [ 207169 ] {} <Debug> HTTP-Session: d9b61600-5130-40ea-a287-c9e5a3730767 Authenticating user 'default' from [::1]:48516
799 2024.09.02 19:50:10.155083 [ 207169 ] {} <Debug> HTTP-Session: d9b61600-5130-40ea-a287-c9e5a3730767 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
800 2024.09.02 19:50:10.155089 [ 207169 ] {} <Debug> HTTP-Session: d9b61600-5130-40ea-a287-c9e5a3730767 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
801 2024.09.02 19:50:10.155159 [ 207169 ] {} <Trace> HTTP-Session: d9b61600-5130-40ea-a287-c9e5a3730767 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
802 2024.09.02 19:50:10.155702 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Debug> executeQuery: (from [::1]:48516) INSERT INTO oximeter.measurements_cumulativef64 FORMAT JSONEachRow (stage: Complete)
803 2024.09.02 19:50:10.155754 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Trace> ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64
804 2024.09.02 19:50:10.155923 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Trace> ParallelParsingInputFormat: Parallel parsing is used
805 2024.09.02 19:50:10.156191 [ 207171 ] {} <Debug> InterserverIOHTTPHandler: Done processing query
806 2024.09.02 19:50:10.156648 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Trace> ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local
807 2024.09.02 19:50:10.157007 [ 207259 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001
808 2024.09.02 19:50:10.157745 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Trying to reserve 1.00 MiB using storage policy from min volume index 0
809 2024.09.02 19:50:10.157765 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.66 GiB.
810 2024.09.02 19:50:10.158182 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Trace> MergedBlockOutputStream: filled checksums all_1_1_0 (state Temporary)
811 2024.09.02 19:50:10.159848 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Replicated OutputStream): Wrote block with ID 'all_16256902636966177828_17920077771813326203', 400 rows
812 2024.09.02 19:50:10.169703 [ 207259 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0]
813 2024.09.02 19:50:10.169740 [ 207259 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
814 2024.09.02 19:50:10.174332 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
815 2024.09.02 19:50:10.187461 [ 207247 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89475231744, merge_with_ttl_allowedtrue)
816 2024.09.02 19:50:10.187496 [ 207247 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 10133ms
817 2024.09.02 19:50:10.187582 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Debug> executeQuery: Read 400 rows, 25.78 KiB in 0.032252 sec., 12402.331638348009 rows/sec., 799.37 KiB/sec.
818 2024.09.02 19:50:10.188281 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Debug> DynamicQueryHandler: Done processing query
819 2024.09.02 19:50:10.188296 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} <Debug> MemoryTracker: Peak memory usage (for query): 4.46 MiB.
820 2024.09.02 19:50:10.188304 [ 207169 ] {} <Debug> HTTP-Session: d9b61600-5130-40ea-a287-c9e5a3730767 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
821 2024.09.02 19:50:10.190146 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
822 2024.09.02 19:50:10.191245 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
823 2024.09.02 19:50:10.191262 [ 207169 ] {} <Debug> HTTP-Session: 02943758-e317-4dc1-8a28-0806f14395e5 Authenticating user 'default' from [::1]:48516
824 2024.09.02 19:50:10.191278 [ 207169 ] {} <Debug> HTTP-Session: 02943758-e317-4dc1-8a28-0806f14395e5 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
825 2024.09.02 19:50:10.191285 [ 207169 ] {} <Debug> HTTP-Session: 02943758-e317-4dc1-8a28-0806f14395e5 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
826 2024.09.02 19:50:10.191331 [ 207169 ] {} <Trace> HTTP-Session: 02943758-e317-4dc1-8a28-0806f14395e5 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
827 2024.09.02 19:50:10.191782 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> executeQuery: (from [::1]:48516) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete)
828 2024.09.02 19:50:10.191909 [ 207288 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001
829 2024.09.02 19:50:10.193672 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
830 2024.09.02 19:50:10.193937 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
831 2024.09.02 19:50:10.194196 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
832 2024.09.02 19:50:10.195557 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
833 2024.09.02 19:50:10.196081 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
834 2024.09.02 19:50:10.197121 [ 207171 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51138, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
835 2024.09.02 19:50:10.197161 [ 207171 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false
836 2024.09.02 19:50:10.197167 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> HashJoin: (0x7efc1089c518) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
837 2024.09.02 19:50:10.197174 [ 207171 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Replicated PartsService): Sending part all_1_1_0
838 2024.09.02 19:50:10.197192 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> HashJoin: (0x7efc1089c518) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
839 2024.09.02 19:50:10.197427 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> HashJoin: (0x7efc1089c518) Join data is being destroyed, 12288 bytes and 0 rows in hash table
840 2024.09.02 19:50:10.197700 [ 207171 ] {} <Debug> InterserverIOHTTPHandler: Done processing query
841 2024.09.02 19:50:10.197862 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
842 2024.09.02 19:50:10.198483 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
843 2024.09.02 19:50:10.198557 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> HashJoin: (0x7efc1089e098) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
844 2024.09.02 19:50:10.198565 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> HashJoin: (0x7efc1089e098) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
845 2024.09.02 19:50:10.198977 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
846 2024.09.02 19:50:10.199141 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
847 2024.09.02 19:50:10.199320 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
848 2024.09.02 19:50:10.199506 [ 207288 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0]
849 2024.09.02 19:50:10.199550 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
850 2024.09.02 19:50:10.199555 [ 207288 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
851 2024.09.02 19:50:10.199793 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local
852 2024.09.02 19:50:10.199843 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
853 2024.09.02 19:50:10.199876 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: Complete -> Complete
854 2024.09.02 19:50:10.199923 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> HashJoin: (0x7efc1089ca18) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0)
855 2024.09.02 19:50:10.199930 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> HashJoin: (0x7efc1089ca18) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)]
856 2024.09.02 19:50:10.200316 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
857 2024.09.02 19:50:10.201934 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
858 2024.09.02 19:50:10.202157 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid
859 2024.09.02 19:50:10.202408 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
860 2024.09.02 19:50:10.202425 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
861 2024.09.02 19:50:10.202636 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local
862 2024.09.02 19:50:10.204152 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
863 2024.09.02 19:50:10.204198 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: Complete -> Complete
864 2024.09.02 19:50:10.204282 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> HashJoin: (0x7efc1089d198) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)
865 2024.09.02 19:50:10.204292 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> HashJoin: (0x7efc1089d198) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)]
866 2024.09.02 19:50:10.204392 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> HashJoin: (0x7efc1089e098) Join data is being destroyed, 12288 bytes and 0 rows in hash table
867 2024.09.02 19:50:10.204735 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
868 2024.09.02 19:50:10.205006 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
869 2024.09.02 19:50:10.205234 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
870 2024.09.02 19:50:10.206713 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
871 2024.09.02 19:50:10.206890 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local
872 2024.09.02 19:50:10.206940 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
873 2024.09.02 19:50:10.206979 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: Complete -> Complete
874 2024.09.02 19:50:10.206987 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
875 2024.09.02 19:50:10.207006 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)'
876 2024.09.02 19:50:10.207030 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)'
877 2024.09.02 19:50:10.207071 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
878 2024.09.02 19:50:10.207092 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)'
879 2024.09.02 19:50:10.207110 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)'
880 2024.09.02 19:50:10.207599 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
881 2024.09.02 19:50:10.207713 [ 207426 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
882 2024.09.02 19:50:10.207725 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks)
883 2024.09.02 19:50:10.207747 [ 207426 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (LEFT) boundary mark: 0
884 2024.09.02 19:50:10.207773 [ 207426 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (RIGHT) boundary mark: 2
885 2024.09.02 19:50:10.207784 [ 207426 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found continuous range in 2 steps
886 2024.09.02 19:50:10.207751 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (LEFT) boundary mark: 0
887 2024.09.02 19:50:10.207829 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (RIGHT) boundary mark: 2
888 2024.09.02 19:50:10.207840 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found continuous range in 2 steps
889 2024.09.02 19:50:10.207965 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges
890 2024.09.02 19:50:10.207973 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Spreading mark ranges among streams (default reading)
891 2024.09.02 19:50:10.208060 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> MergeTreeReadPool: min_marks_for_concurrent_read=24
892 2024.09.02 19:50:10.208070 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Reading approx. 16 rows with 2 streams
893 2024.09.02 19:50:10.208103 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
894 2024.09.02 19:50:10.208142 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
895 2024.09.02 19:50:10.208237 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
896 2024.09.02 19:50:10.208339 [ 207429 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks)
897 2024.09.02 19:50:10.208348 [ 207428 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
898 2024.09.02 19:50:10.208365 [ 207429 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0
899 2024.09.02 19:50:10.208368 [ 207428 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0
900 2024.09.02 19:50:10.208373 [ 207429 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 1
901 2024.09.02 19:50:10.208376 [ 207428 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 1
902 2024.09.02 19:50:10.208381 [ 207429 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps
903 2024.09.02 19:50:10.208384 [ 207428 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps
904 2024.09.02 19:50:10.208469 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges
905 2024.09.02 19:50:10.208478 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Spreading mark ranges among streams (default reading)
906 2024.09.02 19:50:10.208574 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> MergeTreeReadPool: min_marks_for_concurrent_read=24
907 2024.09.02 19:50:10.208590 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Reading approx. 32 rows with 2 streams
908 2024.09.02 19:50:10.208647 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
909 2024.09.02 19:50:10.208706 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
910 2024.09.02 19:50:10.208784 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)'
911 2024.09.02 19:50:10.208804 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)'
912 2024.09.02 19:50:10.208909 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
913 2024.09.02 19:50:10.208986 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks)
914 2024.09.02 19:50:10.208987 [ 207427 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks)
915 2024.09.02 19:50:10.209010 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0
916 2024.09.02 19:50:10.209018 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 2
917 2024.09.02 19:50:10.209030 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps
918 2024.09.02 19:50:10.209039 [ 207427 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0
919 2024.09.02 19:50:10.209046 [ 207427 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 2
920 2024.09.02 19:50:10.209052 [ 207427 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps
921 2024.09.02 19:50:10.209118 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges
922 2024.09.02 19:50:10.209132 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Spreading mark ranges among streams (default reading)
923 2024.09.02 19:50:10.209249 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> MergeTreeReadPool: min_marks_for_concurrent_read=24
924 2024.09.02 19:50:10.209264 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Reading approx. 32 rows with 2 streams
925 2024.09.02 19:50:10.209332 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
926 2024.09.02 19:50:10.209417 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
927 2024.09.02 19:50:10.209481 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)'
928 2024.09.02 19:50:10.209496 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)'
929 2024.09.02 19:50:10.211020 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> executeQuery: Read 80 rows, 5.78 KiB in 0.019526 sec., 4097.101300829662 rows/sec., 296.08 KiB/sec.
930 2024.09.02 19:50:10.211200 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> HashJoin: (0x7efc1089ca18) Join data is being destroyed, 12800 bytes and 16 rows in hash table
931 2024.09.02 19:50:10.211275 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Trace> HashJoin: (0x7efc1089d198) Join data is being destroyed, 13312 bytes and 16 rows in hash table
932 2024.09.02 19:50:10.211627 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> DynamicQueryHandler: Done processing query
933 2024.09.02 19:50:10.211642 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} <Debug> MemoryTracker: Peak memory usage (for query): 5.25 MiB.
934 2024.09.02 19:50:10.211648 [ 207169 ] {} <Debug> HTTP-Session: 02943758-e317-4dc1-8a28-0806f14395e5 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
935 2024.09.02 19:50:10.212968 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 577, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
936 2024.09.02 19:50:10.213853 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
937 2024.09.02 19:50:10.213864 [ 207169 ] {} <Debug> HTTP-Session: 6b6296e9-06c0-46ac-b450-f80a468fcc91 Authenticating user 'default' from [::1]:48516
938 2024.09.02 19:50:10.213877 [ 207169 ] {} <Debug> HTTP-Session: 6b6296e9-06c0-46ac-b450-f80a468fcc91 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
939 2024.09.02 19:50:10.213883 [ 207169 ] {} <Debug> HTTP-Session: 6b6296e9-06c0-46ac-b450-f80a468fcc91 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
940 2024.09.02 19:50:10.213929 [ 207169 ] {} <Trace> HTTP-Session: 6b6296e9-06c0-46ac-b450-f80a468fcc91 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
941 2024.09.02 19:50:10.214203 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Debug> executeQuery: (from [::1]:48516) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (163777662738179873,3255198277614561830,4174330440898734823,5073661756869813506,6060338002058112069,6258172585252991913,7444263327486421469,10232564214925740701,10613593354210677318,10652587399320292971,10860360997898340759,12041534140654173142,14895190478290584883,14922767736603850140,15077062082775085482,16549134671421491687)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete)
942 2024.09.02 19:50:10.214679 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64
943 2024.09.02 19:50:10.216644 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64
944 2024.09.02 19:50:10.216908 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1
945 2024.09.02 19:50:10.216938 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 6258172585252991913, 7444263327486421469, 10232564214925740701, 10613593354210677318, 10652587399320292971, 10860360997898340759, 12041534140654173142, 14895190478290584883, 14922767736603850140, 15077062082775085482, 16549134671421491687)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE
946 2024.09.02 19:50:10.217198 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local
947 2024.09.02 19:50:10.217258 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
948 2024.09.02 19:50:10.217346 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> InterpreterSelectQuery: Complete -> Complete
949 2024.09.02 19:50:10.217571 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Key condition: (column 1 in 16-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and
950 2024.09.02 19:50:10.219288 [ 207429 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Used generic exclusion search over index for part all_1_1_0 with 1 steps
951 2024.09.02 19:50:10.219286 [ 207426 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps
952 2024.09.02 19:50:10.219742 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Debug> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges
953 2024.09.02 19:50:10.220609 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Spreading ranges among streams with order
954 2024.09.02 19:50:10.220711 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 6258172585252991913, 7444263327486421469, 10232564214925740701, 10613593354210677318, 10652587399320292971, 10860360997898340759, 12041534140654173142, 14895190478290584883, 14922767736603850140, 15077062082775085482, 16549134671421491687))", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
955 2024.09.02 19:50:10.220725 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_1_1_0, approx. 400 rows starting from 0
956 2024.09.02 19:50:10.220799 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 6258172585252991913, 7444263327486421469, 10232564214925740701, 10613593354210677318, 10652587399320292971, 10860360997898340759, 12041534140654173142, 14895190478290584883, 14922767736603850140, 15077062082775085482, 16549134671421491687))", "equals(timeseries_name, 'virtual_machine:cpu_busy')"
957 2024.09.02 19:50:10.220814 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0
958 2024.09.02 19:50:10.221820 [ 207442 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Debug> MergingSortedTransform: Merge sorted 1 blocks, 800 rows in 0.004000063 sec., 199996.85004961173 rows/sec., 8.06 MiB/sec
959 2024.09.02 19:50:10.223591 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Debug> executeQuery: Read 800 rows, 51.56 KiB in 0.009536 sec., 83892.61744966444 rows/sec., 5.28 MiB/sec.
960 2024.09.02 19:50:10.226308 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Debug> DynamicQueryHandler: Done processing query
961 2024.09.02 19:50:10.226332 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} <Debug> MemoryTracker: Peak memory usage (for query): 4.17 MiB.
962 2024.09.02 19:50:10.226342 [ 207169 ] {} <Debug> HTTP-Session: 6b6296e9-06c0-46ac-b450-f80a468fcc91 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
963 2024.09.02 19:50:10.717375 [ 207714 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51140, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
964 2024.09.02 19:50:10.717449 [ 207714 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false
965 2024.09.02 19:50:10.717462 [ 207714 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Replicated PartsService): Sending part all_1_1_0
966 2024.09.02 19:50:10.717918 [ 207714 ] {} <Debug> InterserverIOHTTPHandler: Done processing query
967 2024.09.02 19:50:10.785332 [ 207418 ] {} <Error> ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below):
968 
969 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
970 1. DB::Exception::Exception<unsigned long&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type, std::type_identity<String>::type>, unsigned long&, String&&) @ 0x0000000007354cb4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
971 2. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x0000000007354bb7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
972 3. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001384c492 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
973 4. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
974 5. ? @ 0x00007efcbab46ac3 in ?
975 6. ? @ 0x00007efcbabd8850 in ?
976 (version 23.8.7.24 (official build))
977 2024.09.02 19:50:10.785372 [ 207418 ] {} <Information> ZooKeeperClient: Finalizing session 6. finalization_started: false, queue_finished: false, reason: 'Exception in receiveThread'
978 2024.09.02 19:50:10.785443 [ 207418 ] {} <Trace> oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
979 2024.09.02 19:50:10.785468 [ 207418 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
980 2024.09.02 19:50:10.785481 [ 207418 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
981 2024.09.02 19:50:10.785491 [ 207418 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
982 2024.09.02 19:50:10.785503 [ 207418 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
983 2024.09.02 19:50:10.785530 [ 207290 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
984 2024.09.02 19:50:10.785548 [ 207295 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
985 2024.09.02 19:50:10.785610 [ 207290 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/3/is_active since session has been expired
986 2024.09.02 19:50:10.785617 [ 207295 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/is_active since session has been expired
987 2024.09.02 19:50:10.785621 [ 207290 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Waiting for threads to finish
988 2024.09.02 19:50:10.785629 [ 207295 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Waiting for threads to finish
989 2024.09.02 19:50:10.785598 [ 207287 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
990 2024.09.02 19:50:10.785665 [ 207287 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/3/is_active since session has been expired
991 2024.09.02 19:50:10.785669 [ 207287 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Waiting for threads to finish
992 2024.09.02 19:50:10.785611 [ 207302 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
993 2024.09.02 19:50:10.785685 [ 207302 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/3/is_active since session has been expired
994 2024.09.02 19:50:10.785689 [ 207302 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Waiting for threads to finish
995 2024.09.02 19:50:10.785655 [ 207297 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
996 2024.09.02 19:50:10.785704 [ 207297 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/3/is_active since session has been expired
997 2024.09.02 19:50:10.785710 [ 207297 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Waiting for threads to finish
998 2024.09.02 19:50:10.785818 [ 207290 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Threads finished
999 2024.09.02 19:50:10.785829 [ 207290 ] {} <Debug> Context: Trying to establish a new connection with ZooKeeper
1000 2024.09.02 19:50:10.785864 [ 207295 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Threads finished
1001 2024.09.02 19:50:10.785883 [ 207287 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Threads finished
1002 2024.09.02 19:50:10.785966 [ 207302 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Threads finished
1003 2024.09.02 19:50:10.785986 [ 207297 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Threads finished
1004 2024.09.02 19:50:10.787485 [ 207418 ] {} <Error> ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below):
1005 
1006 0. Poco::Net::SocketImpl::error(int, String const&) @ 0x0000000015b5abb2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1007 1. Poco::Net::SocketImpl::shutdown() @ 0x0000000015b5c39c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1008 2. Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001383d143 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1009 3. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>, std::optional<std::function<void (unsigned long, Coordination::ZooKeeper::Node const&)>>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001384e087 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1010 4. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1011 5. ? @ 0x00007efcbab46ac3 in ?
1012 6. ? @ 0x00007efcbabd8850 in ?
1013 (version 23.8.7.24 (official build))
1014 2024.09.02 19:50:10.789045 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
1015 2024.09.02 19:50:10.789344 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
1016 2024.09.02 19:50:10.792309 [ 207290 ] {} <Information> ZooKeeperClient: Connected to ZooKeeper at [::1]:19003 with session_id 8
1017 2024.09.02 19:50:10.792780 [ 207290 ] {} <Information> ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled
1018 2024.09.02 19:50:10.793828 [ 207290 ] {} <Information> ZooKeeperClient: Keeper feature flag MULTI_READ: enabled
1019 2024.09.02 19:50:10.793650 [ 207410 ] {} <Information> DDLWorker: Lost ZooKeeper connection, will try to connect again: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):
1020 
1021 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1022 1. DB::Exception::Exception<char const (&) [16]>(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1023 2. Coordination::Exception Coordination::Exception::fromMessage<char const (&) [16]>(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1024 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1025 4. Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function<void (Coordination::ListResponse const&)>, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>) @ 0x00000000138481b1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1026 5. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f728e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1027 6. zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f6d96 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1028 7. zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<std::function<void (Coordination::WatchResponse const&)>>, Coordination::ListRequestType) @ 0x00000000137f7a7b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1029 8. zkutil::ZooKeeper::tryGetChildren(String const&, std::vector<String, std::allocator<String>>&, Coordination::Stat*, std::shared_ptr<Poco::Event> const&, Coordination::ListRequestType) @ 0x00000000137f75ff in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1030 9. DB::DDLWorker::scheduleTasks(bool) @ 0x00000000116ee6b7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1031 10. DB::DDLWorker::runMainThread() @ 0x00000000116e75be in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1032 11. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1033 12. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1034 13. ? @ 0x00007efcbab46ac3 in ?
1035 14. ? @ 0x00007efcbabd8850 in ?
1036 (version 23.8.7.24 (official build))
1037 2024.09.02 19:50:10.793837 [ 207290 ] {} <Information> ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled
1038 2024.09.02 19:50:10.793862 [ 207290 ] {} <Trace> ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003
1039 2024.09.02 19:50:10.793871 [ 207290 ] {} <Debug> Context: Establishing a new connection with ZooKeeper took 8 ms
1040 2024.09.02 19:50:10.793881 [ 207290 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1041 2024.09.02 19:50:10.793920 [ 207295 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1042 2024.09.02 19:50:10.793939 [ 207287 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1043 2024.09.02 19:50:10.793946 [ 207302 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1044 2024.09.02 19:50:10.793972 [ 207297 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1045 2024.09.02 19:50:10.838549 [ 207290 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue
1046 2024.09.02 19:50:10.838547 [ 207297 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1047 2024.09.02 19:50:10.838581 [ 207295 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1048 2024.09.02 19:50:10.838598 [ 207302 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1049 2024.09.02 19:50:10.838775 [ 207287 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1050 2024.09.02 19:50:10.838859 [ 207297 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized
1051 2024.09.02 19:50:10.838870 [ 207297 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/3/queue
1052 2024.09.02 19:50:10.838890 [ 207290 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Queue initialized
1053 2024.09.02 19:50:10.838899 [ 207290 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/3/queue
1054 2024.09.02 19:50:10.838925 [ 207295 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized
1055 2024.09.02 19:50:10.838932 [ 207295 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/queue
1056 2024.09.02 19:50:10.839027 [ 207287 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized
1057 2024.09.02 19:50:10.839040 [ 207287 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/3/queue
1058 2024.09.02 19:50:10.839060 [ 207302 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized
1059 2024.09.02 19:50:10.839069 [ 207302 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/3/queue
1060 2024.09.02 19:50:10.839198 [ 207290 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1061 2024.09.02 19:50:10.839242 [ 207295 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1062 2024.09.02 19:50:10.839278 [ 207287 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1063 2024.09.02 19:50:10.839354 [ 207302 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1064 2024.09.02 19:50:10.839372 [ 207290 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Loaded queue
1065 2024.09.02 19:50:10.839477 [ 207287 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue
1066 2024.09.02 19:50:10.839480 [ 207295 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue
1067 2024.09.02 19:50:10.839524 [ 207302 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue
1068 2024.09.02 19:50:10.839788 [ 207297 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1069 2024.09.02 19:50:10.841208 [ 207294 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 2493ms, ratio: 0, points per minute: 0)
1070 2024.09.02 19:50:10.840483 [ 207290 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully
1071 2024.09.02 19:50:10.840541 [ 207287 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1072 2024.09.02 19:50:10.840549 [ 207201 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 7970ms
1073 2024.09.02 19:50:10.840683 [ 207329 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768753152, merge_with_ttl_allowedtrue)
1074 2024.09.02 19:50:10.841001 [ 207295 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1075 2024.09.02 19:50:10.841373 [ 207329 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 12211ms
1076 2024.09.02 19:50:10.841145 [ 207305 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768753152, merge_with_ttl_allowedtrue)
1077 2024.09.02 19:50:10.841399 [ 207305 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 13090ms
1078 2024.09.02 19:50:10.841469 [ 207297 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue
1079 2024.09.02 19:50:10.841677 [ 207284 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks
1080 2024.09.02 19:50:10.841696 [ 207338 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks
1081 2024.09.02 19:50:10.842090 [ 207284 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 2039ms, ratio: 0, points per minute: 0)
1082 2024.09.02 19:50:10.842107 [ 207338 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 2343ms, ratio: 0, points per minute: 0)
1083 2024.09.02 19:50:10.843095 [ 207301 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1381ms, ratio: 0, points per minute: 0)
1084 2024.09.02 19:50:10.843244 [ 207197 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks
1085 2024.09.02 19:50:10.842413 [ 207302 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1086 2024.09.02 19:50:10.842532 [ 207312 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768751104, merge_with_ttl_allowedtrue)
1087 2024.09.02 19:50:10.842723 [ 207297 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1088 2024.09.02 19:50:10.843316 [ 207312 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 9206ms
1089 2024.09.02 19:50:10.842807 [ 207317 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768751104, merge_with_ttl_allowedtrue)
1090 2024.09.02 19:50:10.843343 [ 207317 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 10931ms
1091 2024.09.02 19:50:10.843560 [ 207197 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1694ms, ratio: 0, points per minute: 0)
1092 2024.09.02 19:50:11.001676 [ 207413 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 379.19 MiB, peak 385.63 MiB, free memory in arenas 37.35 MiB, will set to 381.68 MiB (RSS), difference: 2.48 MiB
1093 2024.09.02 19:50:11.286241 [ 207169 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 1029, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
1094 2024.09.02 19:50:11.286299 [ 207169 ] {} <Trace> DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1
1095 2024.09.02 19:50:11.286310 [ 207169 ] {} <Debug> HTTP-Session: a827409a-fcc3-4591-a83b-a52a22ecf54b Authenticating user 'default' from [::1]:48516
1096 2024.09.02 19:50:11.286322 [ 207169 ] {} <Debug> HTTP-Session: a827409a-fcc3-4591-a83b-a52a22ecf54b Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
1097 2024.09.02 19:50:11.286326 [ 207169 ] {} <Debug> HTTP-Session: a827409a-fcc3-4591-a83b-a52a22ecf54b Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db
1098 2024.09.02 19:50:11.286359 [ 207169 ] {} <Trace> HTTP-Session: a827409a-fcc3-4591-a83b-a52a22ecf54b Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default
1099 2024.09.02 19:50:11.286516 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Debug> executeQuery: (from [::1]:48516) INSERT INTO oximeter.fields_i64 FORMAT JSONEachRow (stage: Complete)
1100 2024.09.02 19:50:11.286559 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Trace> ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64
1101 2024.09.02 19:50:11.286823 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Trace> ParallelParsingInputFormat: Parallel parsing is used
1102 2024.09.02 19:50:11.287224 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Trace> ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local
1103 2024.09.02 19:50:11.289216 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Trying to reserve 1.00 MiB using storage policy from min volume index 0
1104 2024.09.02 19:50:11.289249 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 167.21 GiB.
1105 2024.09.02 19:50:11.289684 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Trace> MergedBlockOutputStream: filled checksums all_2_2_0 (state Temporary)
1106 2024.09.02 19:50:11.289949 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): Wrote block with ID 'all_17738245886449976341_16902175339814383691', 8 rows
1107 2024.09.02 19:50:11.294549 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Renaming temporary part tmp_insert_all_2_2_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
1108 2024.09.02 19:50:11.793937 [ 207410 ] {} <Debug> DDLWorker: Initializing DDLWorker thread
1109 2024.09.02 19:50:12.003489 [ 207413 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 386.96 MiB, peak 386.96 MiB, free memory in arenas 34.68 MiB, will set to 381.93 MiB (RSS), difference: -5.03 MiB
1110 2024.09.02 19:50:12.066346 [ 207415 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml'
1111 2024.09.02 19:50:12.066570 [ 207411 ] {} <Debug> ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml'
1112 2024.09.02 19:50:12.066859 [ 207415 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration
1113 2024.09.02 19:50:12.067202 [ 207415 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration
1114 2024.09.02 19:50:12.067989 [ 207411 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration
1115 2024.09.02 19:50:12.068515 [ 207411 ] {} <Information> Application: Setting max_server_memory_usage was set to 27.61 GiB (30.68 GiB available * 0.90 max_server_memory_usage_to_ram_ratio)
1116 2024.09.02 19:50:12.070267 [ 207411 ] {} <Information> Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.34 GiB (30.68 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio)
1117 2024.09.02 19:50:12.070277 [ 207411 ] {} <Information> Application: Merges and mutations memory limit is set to 15.34 GiB
1118 2024.09.02 19:50:12.070543 [ 207411 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor
1119 2024.09.02 19:50:12.070552 [ 207411 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor
1120 2024.09.02 19:50:12.070557 [ 207411 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor
1121 2024.09.02 19:50:12.070561 [ 207411 ] {} <Information> MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor
1122 2024.09.02 19:50:12.070585 [ 207411 ] {} <Information> ZooKeeperClient: Finalizing session 8. finalization_started: false, queue_finished: false, reason: 'Config changed'
1123 2024.09.02 19:50:12.070648 [ 207411 ] {} <Trace> oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
1124 2024.09.02 19:50:12.070670 [ 207411 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
1125 2024.09.02 19:50:12.070688 [ 207411 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
1126 2024.09.02 19:50:12.070704 [ 207202 ] {} <Warning> oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
1127 2024.09.02 19:50:12.070725 [ 207411 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
1128 2024.09.02 19:50:12.070726 [ 207202 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/3/is_active since session has been expired
1129 2024.09.02 19:50:12.070739 [ 207202 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Waiting for threads to finish
1130 2024.09.02 19:50:12.070746 [ 207411 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true
1131 2024.09.02 19:50:12.070786 [ 207214 ] {} <Warning> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
1132 2024.09.02 19:50:12.070845 [ 207214 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/is_active since session has been expired
1133 2024.09.02 19:50:12.070859 [ 207214 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Waiting for threads to finish
1134 2024.09.02 19:50:12.070801 [ 207220 ] {} <Warning> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
1135 2024.09.02 19:50:12.070831 [ 207208 ] {} <Warning> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
1136 2024.09.02 19:50:12.070889 [ 207220 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/3/is_active since session has been expired
1137 2024.09.02 19:50:12.070896 [ 207220 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Waiting for threads to finish
1138 2024.09.02 19:50:12.070874 [ 207226 ] {} <Warning> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session.
1139 2024.09.02 19:50:12.070897 [ 207208 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/3/is_active since session has been expired
1140 2024.09.02 19:50:12.070909 [ 207226 ] {} <Debug> EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/3/is_active since session has been expired
1141 2024.09.02 19:50:12.070911 [ 207208 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Waiting for threads to finish
1142 2024.09.02 19:50:12.070913 [ 207226 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Waiting for threads to finish
1143 2024.09.02 19:50:12.071036 [ 207202 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Threads finished
1144 2024.09.02 19:50:12.071066 [ 207220 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Threads finished
1145 2024.09.02 19:50:12.071107 [ 207214 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Threads finished
1146 2024.09.02 19:50:12.071125 [ 207208 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Threads finished
1147 2024.09.02 19:50:12.071184 [ 207226 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Threads finished
1148 2024.09.02 19:50:12.079302 [ 207410 ] {} <Error> virtual bool DB::DDLWorker::initializeMainThread(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/task_queue/ddl/. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below):
1149 
1150 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1151 1. DB::Exception::Exception<char const*, String const&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String const&>::type>, char const*&&, String const&) @ 0x0000000010ba7474 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1152 2. Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000010ba6c48 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1153 3. zkutil::ZooKeeper::createAncestors(String const&) @ 0x00000000137f8935 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1154 4. DB::DDLWorker::initializeMainThread() @ 0x00000000116fc925 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1155 5. DB::DDLWorker::runMainThread() @ 0x00000000116e7280 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1156 6. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<void (DB::DDLWorker::*)(), DB::DDLWorker*>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1157 7. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1158 8. ? @ 0x00007efcbab46ac3 in ?
1159 9. ? @ 0x00007efcbabd8850 in ?
1160 (version 23.8.7.24 (official build))
1161 2024.09.02 19:50:12.081271 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: setUserError: error=319 message=Unknown status, client must retry. Reason: Connection loss
1162 2024.09.02 19:50:12.081495 [ 207411 ] {} <Information> ZooKeeperClient: Connected to ZooKeeper at [::1]:19001 with session_id 10
1163 2024.09.02 19:50:12.082718 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Debug> EphemeralLockInZooKeeper: ZooKeeper communication error during unlock: code=Session expired message='Session expired'
1164 2024.09.02 19:50:12.082730 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: will retry due to error: retry_count=1 timeout=100ms error=319 message=Unknown status, client must retry. Reason: Connection loss
1165 2024.09.02 19:50:12.082757 [ 207411 ] {} <Information> ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled
1166 2024.09.02 19:50:12.082762 [ 207411 ] {} <Information> ZooKeeperClient: Keeper feature flag MULTI_READ: enabled
1167 2024.09.02 19:50:12.082765 [ 207411 ] {} <Information> ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled
1168 2024.09.02 19:50:12.082770 [ 207411 ] {} <Trace> ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19003
1169 2024.09.02 19:50:12.082810 [ 207202 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1170 2024.09.02 19:50:12.082821 [ 207220 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1171 2024.09.02 19:50:12.082836 [ 207214 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1172 2024.09.02 19:50:12.082858 [ 207411 ] {} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1
1173 2024.09.02 19:50:12.082869 [ 207411 ] {} <Trace> StoragePolicy (default): Storage policy default created, total volumes 1
1174 2024.09.02 19:50:12.082889 [ 207208 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1175 2024.09.02 19:50:12.082923 [ 207226 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up
1176 2024.09.02 19:50:12.083024 [ 207411 ] {} <Information> CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again.
1177 2024.09.02 19:50:12.083039 [ 207411 ] {} <Debug> ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration
1178 2024.09.02 19:50:12.111836 [ 207202 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue
1179 2024.09.02 19:50:12.111914 [ 207214 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1180 2024.09.02 19:50:12.111923 [ 207220 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1181 2024.09.02 19:50:12.111920 [ 207226 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1182 2024.09.02 19:50:12.111996 [ 207208 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue
1183 2024.09.02 19:50:12.112085 [ 207220 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized
1184 2024.09.02 19:50:12.112096 [ 207226 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized
1185 2024.09.02 19:50:12.112104 [ 207220 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/3/queue
1186 2024.09.02 19:50:12.112111 [ 207226 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/3/queue
1187 2024.09.02 19:50:12.112097 [ 207208 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized
1188 2024.09.02 19:50:12.112096 [ 207202 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Queue initialized
1189 2024.09.02 19:50:12.112147 [ 207202 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/3/queue
1190 2024.09.02 19:50:12.112089 [ 207214 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized
1191 2024.09.02 19:50:12.112136 [ 207208 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/3/queue
1192 2024.09.02 19:50:12.112169 [ 207214 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/queue
1193 2024.09.02 19:50:12.112254 [ 207220 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1194 2024.09.02 19:50:12.112262 [ 207226 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1195 2024.09.02 19:50:12.112285 [ 207202 ] {} <Debug> oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1196 2024.09.02 19:50:12.112287 [ 207208 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1197 2024.09.02 19:50:12.112377 [ 207214 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded.
1198 2024.09.02 19:50:12.112404 [ 207220 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue
1199 2024.09.02 19:50:12.112493 [ 207226 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue
1200 2024.09.02 19:50:12.112525 [ 207214 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue
1201 2024.09.02 19:50:12.112532 [ 207208 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue
1202 2024.09.02 19:50:12.112532 [ 207202 ] {} <Trace> oximeter.version (ReplicatedMergeTreeQueue): Loaded queue
1203 2024.09.02 19:50:12.113349 [ 207220 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1204 2024.09.02 19:50:12.113445 [ 207226 ] {} <Debug> oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1205 2024.09.02 19:50:12.113497 [ 207229 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89767964672, merge_with_ttl_allowedtrue)
1206 2024.09.02 19:50:12.113566 [ 207225 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89767964672, merge_with_ttl_allowedtrue)
1207 2024.09.02 19:50:12.113629 [ 207229 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 15430ms
1208 2024.09.02 19:50:12.113635 [ 207225 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 13532ms
1209 2024.09.02 19:50:12.114094 [ 207230 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1272ms, ratio: 0, points per minute: 0)
1210 2024.09.02 19:50:12.114214 [ 207209 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1271ms, ratio: 0, points per minute: 0)
1211 2024.09.02 19:50:12.114569 [ 207214 ] {} <Debug> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1212 2024.09.02 19:50:12.114600 [ 207258 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89767958528, merge_with_ttl_allowedtrue)
1213 2024.09.02 19:50:12.114635 [ 207202 ] {} <Debug> oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully
1214 2024.09.02 19:50:12.116438 [ 207258 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 15918ms
1215 2024.09.02 19:50:12.114743 [ 207219 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 10127ms
1216 2024.09.02 19:50:12.114844 [ 207208 ] {} <Debug> oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully
1217 2024.09.02 19:50:12.114941 [ 207215 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89767958528, merge_with_ttl_allowedtrue)
1218 2024.09.02 19:50:12.115402 [ 207233 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1273ms, ratio: 0, points per minute: 0)
1219 2024.09.02 19:50:12.115424 [ 207252 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1272ms, ratio: 0, points per minute: 0)
1220 2024.09.02 19:50:12.115426 [ 207246 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1274ms, ratio: 0, points per minute: 0)
1221 2024.09.02 19:50:12.116507 [ 207215 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 11898ms
1222 2024.09.02 19:50:12.183132 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: setUserError: error=244 message=Insert failed due to zookeeper error. Please retry. Reason: Connection loss
1223 2024.09.02 19:50:12.183157 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Debug> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: stop retries on request: retry_count=1 timeout=200ms error=244 message=Insert failed due to zookeeper error. Please retry. Reason: Connection loss
1224 2024.09.02 19:50:12.183171 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreePartCheckThread): Enqueueing all_2_2_0 for check after after 300s
1225 2024.09.02 19:50:12.192480 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Error> executeQuery: Code: 244. DB::Exception: Insert failed due to zookeeper error. Please retry. Reason: Connection loss. (UNEXPECTED_ZOOKEEPER_ERROR) (version 23.8.7.24 (official build)) (from [::1]:48516) (in query: INSERT INTO oximeter.fields_i64 FORMAT JSONEachRow ), Stack trace (when copying this message, always include the lines below):
1226 
1227 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1228 1. DB::ZooKeeperRetriesControl::setUserError(int, String) @ 0x0000000012f32ffd in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1229 2. DB::ReplicatedMergeTreeSinkImpl<false>::commitPart(std::shared_ptr<DB::ZooKeeperWithFaultInjection> const&, std::shared_ptr<DB::IMergeTreeDataPart>&, String const&, unsigned long, bool)::'lambda'()::operator()() const @ 0x0000000012f3586a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1230 3. DB::ReplicatedMergeTreeSinkImpl<false>::commitPart(std::shared_ptr<DB::ZooKeeperWithFaultInjection> const&, std::shared_ptr<DB::IMergeTreeDataPart>&, String const&, unsigned long, bool) @ 0x0000000012f280d8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1231 4. DB::ReplicatedMergeTreeSinkImpl<false>::finishDelayedChunk(std::shared_ptr<DB::ZooKeeperWithFaultInjection> const&) @ 0x0000000012f27270 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1232 5. DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x0000000012f249db in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1233 6. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x00000000134dc0a6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1234 7. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x0000000013417e8b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1235 8. DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x0000000013417bbc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1236 9. DB::ExceptionKeepingTransform::work() @ 0x00000000134172b3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1237 10. DB::ExecutionThreadContext::executeTask() @ 0x00000000131bcdfa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1238 11. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x00000000131b3c30 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1239 12. DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x00000000131b33e8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1240 13. DB::DistributedSink::writeToLocal(DB::Cluster::ShardInfo const&, DB::Block const&, unsigned long) @ 0x0000000012b19942 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1241 14. DB::DistributedSink::writeAsyncImpl(DB::Block const&, unsigned long) @ 0x0000000012b172b7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1242 15. DB::DistributedSink::consume(DB::Chunk) @ 0x0000000012b13c1e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1243 16. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x00000000134dc0a6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1244 17. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x0000000013417e8b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1245 18. DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x0000000013417bbc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1246 19. DB::ExceptionKeepingTransform::work() @ 0x00000000134172b3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1247 20. DB::ExecutionThreadContext::executeTask() @ 0x00000000131bcdfa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1248 21. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x00000000131b3c30 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1249 22. DB::PipelineExecutor::execute(unsigned long, bool) @ 0x00000000131b2f62 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1250 23. DB::CompletedPipelineExecutor::execute() @ 0x00000000131b1812 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1251 24. DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&) @ 0x00000000122e9e0c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1252 25. DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x00000000130fd60f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1253 26. DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000013101ee9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1254 27. DB::HTTPServerConnection::run() @ 0x0000000013172ad2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1255 28. Poco::Net::TCPServerConnection::start() @ 0x0000000015b5f7f4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1256 29. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b609f1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1257 30. Poco::PooledThread::run() @ 0x0000000015c97227 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1258 31. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c954fc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1259 
1260 2024.09.02 19:50:12.194265 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Error> DynamicQueryHandler: Code: 244. DB::Exception: Insert failed due to zookeeper error. Please retry. Reason: Connection loss. (UNEXPECTED_ZOOKEEPER_ERROR), Stack trace (when copying this message, always include the lines below):
1261 
1262 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1263 1. DB::ZooKeeperRetriesControl::setUserError(int, String) @ 0x0000000012f32ffd in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1264 2. DB::ReplicatedMergeTreeSinkImpl<false>::commitPart(std::shared_ptr<DB::ZooKeeperWithFaultInjection> const&, std::shared_ptr<DB::IMergeTreeDataPart>&, String const&, unsigned long, bool)::'lambda'()::operator()() const @ 0x0000000012f3586a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1265 3. DB::ReplicatedMergeTreeSinkImpl<false>::commitPart(std::shared_ptr<DB::ZooKeeperWithFaultInjection> const&, std::shared_ptr<DB::IMergeTreeDataPart>&, String const&, unsigned long, bool) @ 0x0000000012f280d8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1266 4. DB::ReplicatedMergeTreeSinkImpl<false>::finishDelayedChunk(std::shared_ptr<DB::ZooKeeperWithFaultInjection> const&) @ 0x0000000012f27270 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1267 5. DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x0000000012f249db in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1268 6. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x00000000134dc0a6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1269 7. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x0000000013417e8b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1270 8. DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x0000000013417bbc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1271 9. DB::ExceptionKeepingTransform::work() @ 0x00000000134172b3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1272 10. DB::ExecutionThreadContext::executeTask() @ 0x00000000131bcdfa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1273 11. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x00000000131b3c30 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1274 12. DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x00000000131b33e8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1275 13. DB::DistributedSink::writeToLocal(DB::Cluster::ShardInfo const&, DB::Block const&, unsigned long) @ 0x0000000012b19942 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1276 14. DB::DistributedSink::writeAsyncImpl(DB::Block const&, unsigned long) @ 0x0000000012b172b7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1277 15. DB::DistributedSink::consume(DB::Chunk) @ 0x0000000012b13c1e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1278 16. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x00000000134dc0a6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1279 17. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ExceptionKeepingTransform::work()::$_1, void ()>>(std::__function::__policy_storage const*) @ 0x0000000013417e8b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1280 18. DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x0000000013417bbc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1281 19. DB::ExceptionKeepingTransform::work() @ 0x00000000134172b3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1282 20. DB::ExecutionThreadContext::executeTask() @ 0x00000000131bcdfa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1283 21. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x00000000131b3c30 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1284 22. DB::PipelineExecutor::execute(unsigned long, bool) @ 0x00000000131b2f62 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1285 23. DB::CompletedPipelineExecutor::execute() @ 0x00000000131b1812 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1286 24. DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, std::optional<DB::FormatSettings> const&) @ 0x00000000122e9e0c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1287 25. DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&) @ 0x00000000130fd60f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1288 26. DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000013101ee9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1289 27. DB::HTTPServerConnection::run() @ 0x0000000013172ad2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1290 28. Poco::Net::TCPServerConnection::start() @ 0x0000000015b5f7f4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1291 29. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b609f1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1292 30. Poco::PooledThread::run() @ 0x0000000015c97227 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1293 31. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c954fc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse
1294 (version 23.8.7.24 (official build))
1295 2024.09.02 19:50:12.194435 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} <Debug> MemoryTracker: Peak memory usage (for query): 4.27 MiB.
1296 2024.09.02 19:50:12.194446 [ 207169 ] {} <Debug> HTTP-Session: a827409a-fcc3-4591-a83b-a52a22ecf54b Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
1297 2024.09.02 19:50:12.295784 [ 207270 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000002 - log-0000000002
1298 2024.09.02 19:50:12.310251 [ 207714 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51140, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
1299 2024.09.02 19:50:12.310316 [ 207714 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_2_2_0&client_protocol_version=8&compress=false
1300 2024.09.02 19:50:12.310331 [ 207714 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated PartsService): Sending part all_2_2_0
1301 2024.09.02 19:50:12.310627 [ 207714 ] {} <Debug> InterserverIOHTTPHandler: Done processing query
1302 2024.09.02 19:50:12.312947 [ 207270 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_2_2_0]
1303 2024.09.02 19:50:12.312964 [ 207270 ] {} <Debug> oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue.
1304 2024.09.02 19:50:12.321132 [ 207171 ] {} <Trace> InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51138, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none)
1305 2024.09.02 19:50:12.321182 [ 207171 ] {} <Trace> InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_2_2_0&client_protocol_version=8&compress=false
1306 2024.09.02 19:50:12.321192 [ 207171 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated PartsService): Sending part all_2_2_0
1307 2024.09.02 19:50:12.321524 [ 207171 ] {} <Debug> InterserverIOHTTPHandler: Done processing query
1308 2024.09.02 19:50:13.000638 [ 207413 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 381.66 MiB, peak 391.93 MiB, free memory in arenas 43.39 MiB, will set to 393.06 MiB (RSS), difference: 11.41 MiB
1309 2024.09.02 19:50:17.083422 [ 207410 ] {} <Debug> DDLWorker: Initialized DDLWorker thread
1310 2024.09.02 19:50:17.083445 [ 207410 ] {} <Debug> DDLWorker: Scheduling tasks
1311 2024.09.02 19:50:17.083450 [ 207410 ] {} <Information> DDLWorker: Have 1 unfinished tasks, will check them
1312 2024.09.02 19:50:17.083452 [ 207412 ] {} <Trace> DDLWorker: Too early to clean queue, will do it later.
1313 2024.09.02 19:50:17.083587 [ 207410 ] {} <Trace> DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000019, last_skipped_entry_name=query-0000000009
1314 2024.09.02 19:50:17.083594 [ 207410 ] {} <Debug> DDLWorker: No tasks to schedule
1315 2024.09.02 19:50:17.083597 [ 207410 ] {} <Debug> DDLWorker: Waiting for queue updates
1316 2024.09.02 19:50:18.000448 [ 207413 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 389.04 MiB, peak 393.06 MiB, free memory in arenas 42.52 MiB, will set to 393.06 MiB (RSS), difference: 4.02 MiB
1317 2024.09.02 19:50:22.243604 [ 207197 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 13355ms
1318 2024.09.02 19:50:23.023575 [ 207213 ] {} <Debug> DNSResolver: Updating DNS cache
1319 2024.09.02 19:50:23.023624 [ 207213 ] {} <Debug> DNSResolver: Updated DNS cache
1320 2024.09.02 19:50:24.014667 [ 207195 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89898590208, merge_with_ttl_allowedtrue)
1321 2024.09.02 19:50:24.014710 [ 207195 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 14854ms
1322 2024.09.02 19:50:25.645825 [ 207218 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89896200192, merge_with_ttl_allowedtrue)
1323 2024.09.02 19:50:25.645856 [ 207218 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 17567ms
1324 2024.09.02 19:50:27.543797 [ 207264 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89893316608, merge_with_ttl_allowedtrue)
1325 2024.09.02 19:50:27.543831 [ 207264 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 18708ms
1326 2024.09.02 19:50:28.034645 [ 207254 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89892661248, merge_with_ttl_allowedtrue)
1327 2024.09.02 19:50:28.034675 [ 207254 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 20169ms
1328 2024.09.02 19:50:35.598800 [ 207238 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 16516ms
1329 2024.09.02 19:50:38.023768 [ 207262 ] {} <Debug> DNSResolver: Updating DNS cache
1330 2024.09.02 19:50:38.023849 [ 207262 ] {} <Debug> DNSResolver: Updated DNS cache
1331 2024.09.02 19:50:38.868869 [ 207282 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89876117504, merge_with_ttl_allowedtrue)
1332 2024.09.02 19:50:38.868893 [ 207282 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 17961ms
1333 2024.09.02 19:50:43.213063 [ 207300 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89869373440, merge_with_ttl_allowedtrue)
1334 2024.09.02 19:50:43.213108 [ 207300 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 21452ms
1335 2024.09.02 19:50:46.251964 [ 207294 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89865019392, merge_with_ttl_allowedtrue)
1336 2024.09.02 19:50:46.251998 [ 207294 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 22801ms
1337 2024.09.02 19:50:48.203819 [ 207285 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89862299648, merge_with_ttl_allowedtrue)
1338 2024.09.02 19:50:48.203846 [ 207285 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 25990ms
1339 2024.09.02 19:50:52.114950 [ 207284 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 21413ms
1340 2024.09.02 19:50:53.023946 [ 207317 ] {} <Debug> DNSResolver: Updating DNS cache
1341 2024.09.02 19:50:53.023973 [ 207317 ] {} <Debug> DNSResolver: Updated DNS cache
1342 2024.09.02 19:50:55.001222 [ 207413 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 392.98 MiB, peak 393.18 MiB, free memory in arenas 23.35 MiB, will set to 388.47 MiB (RSS), difference: -4.50 MiB
1343 2024.09.02 19:50:56.830042 [ 207199 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89848510464, merge_with_ttl_allowedtrue)
1344 2024.09.02 19:50:56.830077 [ 207199 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 21644ms
1345 2024.09.02 19:51:04.665266 [ 207209 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90083278848, merge_with_ttl_allowedtrue)
1346 2024.09.02 19:51:04.665358 [ 207209 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 26132ms
1347 2024.09.02 19:51:08.024086 [ 207253 ] {} <Debug> DNSResolver: Updating DNS cache
1348 2024.09.02 19:51:08.024138 [ 207253 ] {} <Debug> DNSResolver: Updated DNS cache
1349 2024.09.02 19:51:09.053180 [ 207244 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89925611520, merge_with_ttl_allowedtrue)
1350 2024.09.02 19:51:09.053227 [ 207244 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 29159ms
1351 2024.09.02 19:51:13.528159 [ 207234 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 26962ms
1352 2024.09.02 19:51:14.194009 [ 207216 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89921095680, merge_with_ttl_allowedtrue)
1353 2024.09.02 19:51:14.194064 [ 207216 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 32467ms
1354 2024.09.02 19:51:18.474208 [ 207238 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89914408960, merge_with_ttl_allowedtrue)
1355 2024.09.02 19:51:18.474234 [ 207238 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 26907ms
1356 2024.09.02 19:51:23.024264 [ 207262 ] {} <Debug> DNSResolver: Updating DNS cache
1357 2024.09.02 19:51:23.024318 [ 207262 ] {} <Debug> DNSResolver: Updated DNS cache
1358 2024.09.02 19:51:30.797546 [ 207224 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89914978304, merge_with_ttl_allowedtrue)
1359 2024.09.02 19:51:30.797583 [ 207224 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 31411ms
1360 2024.09.02 19:51:38.024440 [ 207340 ] {} <Debug> DNSResolver: Updating DNS cache
1361 2024.09.02 19:51:38.024490 [ 207340 ] {} <Debug> DNSResolver: Updated DNS cache
1362 2024.09.02 19:51:38.212373 [ 207295 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90083112960, merge_with_ttl_allowedtrue)
1363 2024.09.02 19:51:38.212438 [ 207295 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 36957ms
1364 2024.09.02 19:51:40.490349 [ 207329 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 35483ms
1365 2024.09.02 19:51:45.381378 [ 207192 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89924368384, merge_with_ttl_allowedtrue)
1366 2024.09.02 19:51:45.381412 [ 207192 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 33126ms
1367 2024.09.02 19:51:46.661223 [ 207309 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89922629632, merge_with_ttl_allowedtrue)
1368 2024.09.02 19:51:46.661265 [ 207309 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 40258ms
1369 2024.09.02 19:51:53.024606 [ 207193 ] {} <Debug> DNSResolver: Updating DNS cache
1370 2024.09.02 19:51:53.024658 [ 207193 ] {} <Debug> DNSResolver: Updated DNS cache
1371 2024.09.02 19:52:02.208737 [ 207228 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89898944512, merge_with_ttl_allowedtrue)
1372 2024.09.02 19:52:02.208782 [ 207228 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 39945ms
1373 2024.09.02 19:52:08.024758 [ 207261 ] {} <Debug> DNSResolver: Updating DNS cache
1374 2024.09.02 19:52:08.024805 [ 207261 ] {} <Debug> DNSResolver: Updated DNS cache
1375 2024.09.02 19:52:09.001410 [ 207413 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000159049 sec.
1376 2024.09.02 19:52:15.169605 [ 207233 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89878769664, merge_with_ttl_allowedtrue)
1377 2024.09.02 19:52:15.169671 [ 207233 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 45497ms
1378 2024.09.02 19:52:15.973499 [ 207246 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 42923ms
1379 2024.09.02 19:52:18.507541 [ 207216 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89873848320, merge_with_ttl_allowedtrue)
1380 2024.09.02 19:52:18.507558 [ 207216 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 40082ms
1381 2024.09.02 19:52:23.024898 [ 207289 ] {} <Debug> DNSResolver: Updating DNS cache
1382 2024.09.02 19:52:23.024929 [ 207289 ] {} <Debug> DNSResolver: Updated DNS cache
1383 2024.09.02 19:52:26.919399 [ 207238 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89860218880, merge_with_ttl_allowedtrue)
1384 2024.09.02 19:52:26.919419 [ 207238 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 51346ms
1385 2024.09.02 19:52:38.025037 [ 207268 ] {} <Debug> DNSResolver: Updating DNS cache
1386 2024.09.02 19:52:38.025079 [ 207268 ] {} <Debug> DNSResolver: Updated DNS cache
1387 2024.09.02 19:52:42.153917 [ 207300 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89837326336, merge_with_ttl_allowedtrue)
1388 2024.09.02 19:52:42.154796 [ 207300 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 51248ms
1389 2024.09.02 19:52:53.025188 [ 207305 ] {} <Debug> DNSResolver: Updating DNS cache
1390 2024.09.02 19:52:53.025259 [ 207305 ] {} <Debug> DNSResolver: Updated DNS cache
1391 2024.09.02 19:52:58.589698 [ 207192 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89812908032, merge_with_ttl_allowedtrue)
1392 2024.09.02 19:52:58.589722 [ 207192 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 52014ms
1393 2024.09.02 19:52:58.896633 [ 207309 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 54703ms
1394 2024.09.02 19:53:00.666836 [ 207338 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89810038784, merge_with_ttl_allowedtrue)
1395 2024.09.02 19:53:00.666877 [ 207338 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 58302ms
1396 2024.09.02 19:53:08.025323 [ 207199 ] {} <Debug> DNSResolver: Updating DNS cache
1397 2024.09.02 19:53:08.025356 [ 207199 ] {} <Debug> DNSResolver: Updated DNS cache
1398 2024.09.02 19:53:18.265601 [ 207256 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89782964224, merge_with_ttl_allowedtrue)
1399 2024.09.02 19:53:18.265641 [ 207256 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1400 2024.09.02 19:53:23.025468 [ 207249 ] {} <Debug> DNSResolver: Updating DNS cache
1401 2024.09.02 19:53:23.025506 [ 207249 ] {} <Debug> DNSResolver: Updated DNS cache
1402 2024.09.02 19:53:33.402933 [ 207252 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89759256576, merge_with_ttl_allowedtrue)
1403 2024.09.02 19:53:33.402981 [ 207252 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1404 2024.09.02 19:53:38.025623 [ 207183 ] {} <Debug> DNSResolver: Updating DNS cache
1405 2024.09.02 19:53:38.025658 [ 207183 ] {} <Debug> DNSResolver: Updated DNS cache
1406 2024.09.02 19:53:50.603936 [ 207194 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89732331520, merge_with_ttl_allowedtrue)
1407 2024.09.02 19:53:50.603987 [ 207194 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1408 2024.09.02 19:53:53.025761 [ 207279 ] {} <Debug> DNSResolver: Updating DNS cache
1409 2024.09.02 19:53:53.025801 [ 207279 ] {} <Debug> DNSResolver: Updated DNS cache
1410 2024.09.02 19:53:53.599757 [ 207257 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1411 2024.09.02 19:53:58.969051 [ 207266 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89720295424, merge_with_ttl_allowedtrue)
1412 2024.09.02 19:53:58.969083 [ 207266 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1413 2024.09.02 19:54:08.025914 [ 207348 ] {} <Debug> DNSResolver: Updating DNS cache
1414 2024.09.02 19:54:08.025959 [ 207348 ] {} <Debug> DNSResolver: Updated DNS cache
1415 2024.09.02 19:54:09.001780 [ 207413 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00016278 sec.
1416 2024.09.02 19:54:18.265764 [ 207285 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89688625152, merge_with_ttl_allowedtrue)
1417 2024.09.02 19:54:18.265785 [ 207285 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1418 2024.09.02 19:54:23.026051 [ 207284 ] {} <Debug> DNSResolver: Updating DNS cache
1419 2024.09.02 19:54:23.026087 [ 207284 ] {} <Debug> DNSResolver: Updated DNS cache
1420 2024.09.02 19:54:33.403125 [ 207193 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89665771520, merge_with_ttl_allowedtrue)
1421 2024.09.02 19:54:33.404930 [ 207193 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1422 2024.09.02 19:54:38.026177 [ 207221 ] {} <Debug> DNSResolver: Updating DNS cache
1423 2024.09.02 19:54:38.027941 [ 207221 ] {} <Debug> DNSResolver: Updated DNS cache
1424 2024.09.02 19:54:50.604111 [ 207240 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89638924288, merge_with_ttl_allowedtrue)
1425 2024.09.02 19:54:50.604143 [ 207240 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1426 2024.09.02 19:54:53.028061 [ 207248 ] {} <Debug> DNSResolver: Updating DNS cache
1427 2024.09.02 19:54:53.028107 [ 207248 ] {} <Debug> DNSResolver: Updated DNS cache
1428 2024.09.02 19:54:53.599907 [ 207253 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1429 2024.09.02 19:54:58.969209 [ 207258 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89624489984, merge_with_ttl_allowedtrue)
1430 2024.09.02 19:54:58.969229 [ 207258 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1431 2024.09.02 19:55:08.000713 [ 207413 ] {} <Trace> AsynchronousMetrics: Scanning /sys/block
1432 2024.09.02 19:55:08.028221 [ 207234 ] {} <Debug> DNSResolver: Updating DNS cache
1433 2024.09.02 19:55:08.028255 [ 207234 ] {} <Debug> DNSResolver: Updated DNS cache
1434 2024.09.02 19:55:15.280696 [ 207275 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks
1435 2024.09.02 19:55:15.280912 [ 207275 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 303162ms, ratio: 0, points per minute: 0)
1436 2024.09.02 19:55:17.498912 [ 207257 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 305379ms, ratio: 0, points per minute: 0)
1437 2024.09.02 19:55:18.265954 [ 207222 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89595555840, merge_with_ttl_allowedtrue)
1438 2024.09.02 19:55:18.265983 [ 207222 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1439 2024.09.02 19:55:18.341115 [ 207262 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 306221ms, ratio: 0, points per minute: 0)
1440 2024.09.02 19:55:19.583150 [ 207282 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307463ms, ratio: 0, points per minute: 0)
1441 2024.09.02 19:55:22.088984 [ 207259 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309968ms, ratio: 0, points per minute: 0)
1442 2024.09.02 19:55:23.028364 [ 207267 ] {} <Debug> DNSResolver: Updating DNS cache
1443 2024.09.02 19:55:23.028405 [ 207267 ] {} <Debug> DNSResolver: Updated DNS cache
1444 2024.09.02 19:55:33.405136 [ 207298 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89571942400, merge_with_ttl_allowedtrue)
1445 2024.09.02 19:55:33.405191 [ 207298 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1446 2024.09.02 19:55:38.028511 [ 207201 ] {} <Debug> DNSResolver: Updating DNS cache
1447 2024.09.02 19:55:38.028546 [ 207201 ] {} <Debug> DNSResolver: Updated DNS cache
1448 2024.09.02 19:55:50.604271 [ 207192 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89540505600, merge_with_ttl_allowedtrue)
1449 2024.09.02 19:55:50.605914 [ 207192 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1450 2024.09.02 19:55:53.028644 [ 207302 ] {} <Debug> DNSResolver: Updating DNS cache
1451 2024.09.02 19:55:53.028684 [ 207302 ] {} <Debug> DNSResolver: Updated DNS cache
1452 2024.09.02 19:55:53.600054 [ 207301 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1453 2024.09.02 19:55:58.969434 [ 207213 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89526777856, merge_with_ttl_allowedtrue)
1454 2024.09.02 19:55:58.969477 [ 207213 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1455 2024.09.02 19:56:08.028799 [ 207232 ] {} <Debug> DNSResolver: Updating DNS cache
1456 2024.09.02 19:56:08.028844 [ 207232 ] {} <Debug> DNSResolver: Updated DNS cache
1457 2024.09.02 19:56:09.001272 [ 207413 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00015462 sec.
1458 2024.09.02 19:56:18.266116 [ 207248 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89497602048, merge_with_ttl_allowedtrue)
1459 2024.09.02 19:56:18.266177 [ 207248 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1460 2024.09.02 19:56:23.028950 [ 207219 ] {} <Debug> DNSResolver: Updating DNS cache
1461 2024.09.02 19:56:23.028980 [ 207219 ] {} <Debug> DNSResolver: Updated DNS cache
1462 2024.09.02 19:56:30.001307 [ 207413 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 388.53 MiB, peak 393.18 MiB, free memory in arenas 9.97 MiB, will set to 383.30 MiB (RSS), difference: -5.23 MiB
1463 2024.09.02 19:56:33.405367 [ 207183 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89473185792, merge_with_ttl_allowedtrue)
1464 2024.09.02 19:56:33.405394 [ 207183 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1465 2024.09.02 19:56:38.029104 [ 207263 ] {} <Debug> DNSResolver: Updating DNS cache
1466 2024.09.02 19:56:38.029199 [ 207263 ] {} <Debug> DNSResolver: Updated DNS cache
1467 2024.09.02 19:56:50.606097 [ 207279 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081759232, merge_with_ttl_allowedtrue)
1468 2024.09.02 19:56:50.606150 [ 207279 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1469 2024.09.02 19:56:53.029337 [ 207247 ] {} <Debug> DNSResolver: Updating DNS cache
1470 2024.09.02 19:56:53.029399 [ 207247 ] {} <Debug> DNSResolver: Updated DNS cache
1471 2024.09.02 19:56:53.600216 [ 207266 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1472 2024.09.02 19:56:58.969669 [ 207268 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081716224, merge_with_ttl_allowedtrue)
1473 2024.09.02 19:56:58.969719 [ 207268 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1474 2024.09.02 19:57:08.029522 [ 207348 ] {} <Debug> DNSResolver: Updating DNS cache
1475 2024.09.02 19:57:08.029574 [ 207348 ] {} <Debug> DNSResolver: Updated DNS cache
1476 2024.09.02 19:57:18.266384 [ 207342 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081630208, merge_with_ttl_allowedtrue)
1477 2024.09.02 19:57:18.266434 [ 207342 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1478 2024.09.02 19:57:23.029679 [ 207297 ] {} <Debug> DNSResolver: Updating DNS cache
1479 2024.09.02 19:57:23.029730 [ 207297 ] {} <Debug> DNSResolver: Updated DNS cache
1480 2024.09.02 19:57:33.405573 [ 207198 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081556480, merge_with_ttl_allowedtrue)
1481 2024.09.02 19:57:33.405625 [ 207198 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1482 2024.09.02 19:57:38.029832 [ 207232 ] {} <Debug> DNSResolver: Updating DNS cache
1483 2024.09.02 19:57:38.029864 [ 207232 ] {} <Debug> DNSResolver: Updated DNS cache
1484 2024.09.02 19:57:50.606297 [ 207241 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081488896, merge_with_ttl_allowedtrue)
1485 2024.09.02 19:57:50.606341 [ 207241 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1486 2024.09.02 19:57:53.029996 [ 207249 ] {} <Debug> DNSResolver: Updating DNS cache
1487 2024.09.02 19:57:53.030043 [ 207249 ] {} <Debug> DNSResolver: Updated DNS cache
1488 2024.09.02 19:57:53.600407 [ 207261 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1489 2024.09.02 19:57:58.969908 [ 207196 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081452032, merge_with_ttl_allowedtrue)
1490 2024.09.02 19:57:58.969965 [ 207196 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1491 2024.09.02 19:58:08.030192 [ 207250 ] {} <Debug> DNSResolver: Updating DNS cache
1492 2024.09.02 19:58:08.030251 [ 207250 ] {} <Debug> DNSResolver: Updated DNS cache
1493 2024.09.02 19:58:09.000996 [ 207413 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00015178 sec.
1494 2024.09.02 19:58:18.266641 [ 207274 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081363968, merge_with_ttl_allowedtrue)
1495 2024.09.02 19:58:18.266702 [ 207274 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1496 2024.09.02 19:58:23.030352 [ 207257 ] {} <Debug> DNSResolver: Updating DNS cache
1497 2024.09.02 19:58:23.030391 [ 207257 ] {} <Debug> DNSResolver: Updated DNS cache
1498 2024.09.02 19:58:33.405789 [ 207268 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081288192, merge_with_ttl_allowedtrue)
1499 2024.09.02 19:58:33.405833 [ 207268 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1500 2024.09.02 19:58:38.030486 [ 207300 ] {} <Debug> DNSResolver: Updating DNS cache
1501 2024.09.02 19:58:38.030787 [ 207300 ] {} <Debug> DNSResolver: Updated DNS cache
1502 2024.09.02 19:58:50.606503 [ 207295 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081220608, merge_with_ttl_allowedtrue)
1503 2024.09.02 19:58:50.606543 [ 207295 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1504 2024.09.02 19:58:53.030899 [ 207342 ] {} <Debug> DNSResolver: Updating DNS cache
1505 2024.09.02 19:58:53.030950 [ 207342 ] {} <Debug> DNSResolver: Updated DNS cache
1506 2024.09.02 19:58:53.600640 [ 207211 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1507 2024.09.02 19:58:58.970155 [ 207308 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081181696, merge_with_ttl_allowedtrue)
1508 2024.09.02 19:58:58.970205 [ 207308 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1509 2024.09.02 19:59:08.031049 [ 207193 ] {} <Debug> DNSResolver: Updating DNS cache
1510 2024.09.02 19:59:08.031120 [ 207193 ] {} <Debug> DNSResolver: Updated DNS cache
1511 2024.09.02 19:59:18.266889 [ 207227 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081093632, merge_with_ttl_allowedtrue)
1512 2024.09.02 19:59:18.266945 [ 207227 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1513 2024.09.02 19:59:23.031243 [ 207256 ] {} <Debug> DNSResolver: Updating DNS cache
1514 2024.09.02 19:59:23.031310 [ 207256 ] {} <Debug> DNSResolver: Updated DNS cache
1515 2024.09.02 19:59:33.405997 [ 207196 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081019904, merge_with_ttl_allowedtrue)
1516 2024.09.02 19:59:33.406040 [ 207196 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1517 2024.09.02 19:59:38.031433 [ 207270 ] {} <Debug> DNSResolver: Updating DNS cache
1518 2024.09.02 19:59:38.031514 [ 207270 ] {} <Debug> DNSResolver: Updated DNS cache
1519 2024.09.02 19:59:50.606701 [ 207291 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080952320, merge_with_ttl_allowedtrue)
1520 2024.09.02 19:59:50.606733 [ 207291 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1521 2024.09.02 19:59:53.032652 [ 207245 ] {} <Debug> DNSResolver: Updating DNS cache
1522 2024.09.02 19:59:53.032714 [ 207245 ] {} <Debug> DNSResolver: Updated DNS cache
1523 2024.09.02 19:59:53.600821 [ 207275 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1524 2024.09.02 19:59:58.970374 [ 207278 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080911360, merge_with_ttl_allowedtrue)
1525 2024.09.02 19:59:58.970418 [ 207278 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1526 2024.09.02 20:00:08.032837 [ 207224 ] {} <Debug> DNSResolver: Updating DNS cache
1527 2024.09.02 20:00:08.032920 [ 207224 ] {} <Debug> DNSResolver: Updated DNS cache
1528 2024.09.02 20:00:09.000588 [ 207413 ] {} <Trace> AsynchronousMetrics: Scanning /sys/block
1529 2024.09.02 20:00:09.001008 [ 207413 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 8.459e-05 sec.
1530 2024.09.02 20:00:18.267101 [ 207294 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080823296, merge_with_ttl_allowedtrue)
1531 2024.09.02 20:00:18.267141 [ 207294 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1532 2024.09.02 20:00:21.544919 [ 207303 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301957ms, ratio: 0, points per minute: 0)
1533 2024.09.02 20:00:22.858631 [ 207295 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307572ms, ratio: 0, points per minute: 0)
1534 2024.09.02 20:00:23.034053 [ 207305 ] {} <Debug> DNSResolver: Updating DNS cache
1535 2024.09.02 20:00:23.034101 [ 207305 ] {} <Debug> DNSResolver: Updated DNS cache
1536 2024.09.02 20:00:25.509890 [ 207329 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307164ms, ratio: 0, points per minute: 0)
1537 2024.09.02 20:00:27.234662 [ 207211 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309731ms, ratio: 0, points per minute: 0)
1538 2024.09.02 20:00:27.340686 [ 207304 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 305247ms, ratio: 0, points per minute: 0)
1539 2024.09.02 20:00:33.406183 [ 207312 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080749568, merge_with_ttl_allowedtrue)
1540 2024.09.02 20:00:33.406225 [ 207312 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1541 2024.09.02 20:00:38.034208 [ 207193 ] {} <Debug> DNSResolver: Updating DNS cache
1542 2024.09.02 20:00:38.035329 [ 207193 ] {} <Debug> DNSResolver: Updated DNS cache
1543 2024.09.02 20:00:50.606883 [ 207230 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080684032, merge_with_ttl_allowedtrue)
1544 2024.09.02 20:00:50.606939 [ 207230 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1545 2024.09.02 20:00:53.035433 [ 207241 ] {} <Debug> DNSResolver: Updating DNS cache
1546 2024.09.02 20:00:53.035481 [ 207241 ] {} <Debug> DNSResolver: Updated DNS cache
1547 2024.09.02 20:00:53.601001 [ 207240 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1548 2024.09.02 20:00:58.970618 [ 207249 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080645120, merge_with_ttl_allowedtrue)
1549 2024.09.02 20:00:58.970695 [ 207249 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1550 2024.09.02 20:01:08.035586 [ 207258 ] {} <Debug> DNSResolver: Updating DNS cache
1551 2024.09.02 20:01:08.035657 [ 207258 ] {} <Debug> DNSResolver: Updated DNS cache
1552 2024.09.02 20:01:18.267355 [ 207235 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080555008, merge_with_ttl_allowedtrue)
1553 2024.09.02 20:01:18.267408 [ 207235 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1554 2024.09.02 20:01:23.036574 [ 207272 ] {} <Debug> DNSResolver: Updating DNS cache
1555 2024.09.02 20:01:23.036636 [ 207272 ] {} <Debug> DNSResolver: Updated DNS cache
1556 2024.09.02 20:01:33.406383 [ 207222 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080481280, merge_with_ttl_allowedtrue)
1557 2024.09.02 20:01:33.406441 [ 207222 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1558 2024.09.02 20:01:38.036748 [ 207224 ] {} <Debug> DNSResolver: Updating DNS cache
1559 2024.09.02 20:01:38.036811 [ 207224 ] {} <Debug> DNSResolver: Updated DNS cache
1560 2024.09.02 20:01:50.607148 [ 207318 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080415744, merge_with_ttl_allowedtrue)
1561 2024.09.02 20:01:50.607200 [ 207318 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1562 2024.09.02 20:01:53.038196 [ 207303 ] {} <Debug> DNSResolver: Updating DNS cache
1563 2024.09.02 20:01:53.038256 [ 207303 ] {} <Debug> DNSResolver: Updated DNS cache
1564 2024.09.02 20:01:53.601193 [ 207340 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1565 2024.09.02 20:01:58.970895 [ 207305 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080376832, merge_with_ttl_allowedtrue)
1566 2024.09.02 20:01:58.970958 [ 207305 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1567 2024.09.02 20:02:08.038375 [ 207192 ] {} <Debug> DNSResolver: Updating DNS cache
1568 2024.09.02 20:02:08.038472 [ 207192 ] {} <Debug> DNSResolver: Updated DNS cache
1569 2024.09.02 20:02:09.001178 [ 207413 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00013693 sec.
1570 2024.09.02 20:02:18.267565 [ 207220 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080286720, merge_with_ttl_allowedtrue)
1571 2024.09.02 20:02:18.267635 [ 207220 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1572 2024.09.02 20:02:23.039703 [ 207195 ] {} <Debug> DNSResolver: Updating DNS cache
1573 2024.09.02 20:02:23.039755 [ 207195 ] {} <Debug> DNSResolver: Updated DNS cache
1574 2024.09.02 20:02:33.406639 [ 207190 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080215040, merge_with_ttl_allowedtrue)
1575 2024.09.02 20:02:33.406720 [ 207190 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1576 2024.09.02 20:02:38.039876 [ 207243 ] {} <Debug> DNSResolver: Updating DNS cache
1577 2024.09.02 20:02:38.039938 [ 207243 ] {} <Debug> DNSResolver: Updated DNS cache
1578 2024.09.02 20:02:50.607353 [ 207252 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080145408, merge_with_ttl_allowedtrue)
1579 2024.09.02 20:02:50.607394 [ 207252 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1580 2024.09.02 20:02:53.040036 [ 207250 ] {} <Debug> DNSResolver: Updating DNS cache
1581 2024.09.02 20:02:53.040087 [ 207250 ] {} <Debug> DNSResolver: Updated DNS cache
1582 2024.09.02 20:02:53.601380 [ 207251 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1583 2024.09.02 20:02:58.971119 [ 207291 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080106496, merge_with_ttl_allowedtrue)
1584 2024.09.02 20:02:58.971160 [ 207291 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1585 2024.09.02 20:03:08.040228 [ 207237 ] {} <Debug> DNSResolver: Updating DNS cache
1586 2024.09.02 20:03:08.040312 [ 207237 ] {} <Debug> DNSResolver: Updated DNS cache
1587 2024.09.02 20:03:18.267840 [ 207296 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080018432, merge_with_ttl_allowedtrue)
1588 2024.09.02 20:03:18.267887 [ 207296 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1589 2024.09.02 20:03:23.041446 [ 207306 ] {} <Debug> DNSResolver: Updating DNS cache
1590 2024.09.02 20:03:23.041516 [ 207306 ] {} <Debug> DNSResolver: Updated DNS cache
1591 2024.09.02 20:03:33.406997 [ 207290 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079944704, merge_with_ttl_allowedtrue)
1592 2024.09.02 20:03:33.407156 [ 207290 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1593 2024.09.02 20:03:38.041665 [ 207337 ] {} <Debug> DNSResolver: Updating DNS cache
1594 2024.09.02 20:03:38.041752 [ 207337 ] {} <Debug> DNSResolver: Updated DNS cache
1595 2024.09.02 20:03:50.607560 [ 207302 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079877120, merge_with_ttl_allowedtrue)
1596 2024.09.02 20:03:50.607620 [ 207302 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1597 2024.09.02 20:03:53.043051 [ 207312 ] {} <Debug> DNSResolver: Updating DNS cache
1598 2024.09.02 20:03:53.043097 [ 207312 ] {} <Debug> DNSResolver: Updated DNS cache
1599 2024.09.02 20:03:53.601554 [ 207213 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1600 2024.09.02 20:03:58.971318 [ 207221 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079838208, merge_with_ttl_allowedtrue)
1601 2024.09.02 20:03:58.971395 [ 207221 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1602 2024.09.02 20:04:08.043226 [ 207227 ] {} <Debug> DNSResolver: Updating DNS cache
1603 2024.09.02 20:04:08.043291 [ 207227 ] {} <Debug> DNSResolver: Updated DNS cache
1604 2024.09.02 20:04:09.001315 [ 207413 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.0001552 sec.
1605 2024.09.02 20:04:18.268037 [ 207244 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079748096, merge_with_ttl_allowedtrue)
1606 2024.09.02 20:04:18.268073 [ 207244 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1607 2024.09.02 20:04:23.043402 [ 207233 ] {} <Debug> DNSResolver: Updating DNS cache
1608 2024.09.02 20:04:23.043457 [ 207233 ] {} <Debug> DNSResolver: Updated DNS cache
1609 2024.09.02 20:04:33.407335 [ 207234 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079672320, merge_with_ttl_allowedtrue)
1610 2024.09.02 20:04:33.407384 [ 207234 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1611 2024.09.02 20:04:38.043562 [ 207289 ] {} <Debug> DNSResolver: Updating DNS cache
1612 2024.09.02 20:04:38.043623 [ 207289 ] {} <Debug> DNSResolver: Updated DNS cache
1613 2024.09.02 20:04:50.607770 [ 207194 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079608832, merge_with_ttl_allowedtrue)
1614 2024.09.02 20:04:50.607814 [ 207194 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1615 2024.09.02 20:04:53.043747 [ 207266 ] {} <Debug> DNSResolver: Updating DNS cache
1616 2024.09.02 20:04:53.043806 [ 207266 ] {} <Debug> DNSResolver: Updated DNS cache
1617 2024.09.02 20:04:53.601740 [ 207247 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1618 2024.09.02 20:04:58.971563 [ 207288 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079569920, merge_with_ttl_allowedtrue)
1619 2024.09.02 20:04:58.971640 [ 207288 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1620 2024.09.02 20:05:08.043944 [ 207314 ] {} <Debug> DNSResolver: Updating DNS cache
1621 2024.09.02 20:05:08.044023 [ 207314 ] {} <Debug> DNSResolver: Updated DNS cache
1622 2024.09.02 20:05:10.000653 [ 207413 ] {} <Trace> AsynchronousMetrics: Scanning /sys/block
1623 2024.09.02 20:05:18.268250 [ 207338 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079479808, merge_with_ttl_allowedtrue)
1624 2024.09.02 20:05:18.268294 [ 207338 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1625 2024.09.02 20:05:23.022376 [ 207302 ] {} <Trace> oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 300159ms, ratio: 0, points per minute: 0)
1626 2024.09.02 20:05:23.044136 [ 207284 ] {} <Debug> DNSResolver: Updating DNS cache
1627 2024.09.02 20:05:23.044173 [ 207284 ] {} <Debug> DNSResolver: Updated DNS cache
1628 2024.09.02 20:05:26.518667 [ 207297 ] {} <Trace> oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304969ms, ratio: 0, points per minute: 0)
1629 2024.09.02 20:05:31.942646 [ 207213 ] {} <Trace> oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 306427ms, ratio: 0, points per minute: 0)
1630 2024.09.02 20:05:33.407536 [ 207198 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079401984, merge_with_ttl_allowedtrue)
1631 2024.09.02 20:05:33.407581 [ 207198 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1632 2024.09.02 20:05:35.056016 [ 207193 ] {} <Trace> oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307711ms, ratio: 0, points per minute: 0)
1633 2024.09.02 20:05:36.870436 [ 207221 ] {} <Trace> oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309631ms, ratio: 0, points per minute: 0)
1634 2024.09.02 20:05:38.044292 [ 207225 ] {} <Debug> DNSResolver: Updating DNS cache
1635 2024.09.02 20:05:38.044362 [ 207225 ] {} <Debug> DNSResolver: Updated DNS cache
1636 2024.09.02 20:05:50.608028 [ 207204 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079336448, merge_with_ttl_allowedtrue)
1637 2024.09.02 20:05:50.608089 [ 207204 ] {} <Trace> oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms
1638 2024.09.02 20:05:53.044486 [ 207253 ] {} <Debug> DNSResolver: Updating DNS cache
1639 2024.09.02 20:05:53.044535 [ 207253 ] {} <Debug> DNSResolver: Updated DNS cache
1640 2024.09.02 20:05:53.601918 [ 207248 ] {} <Trace> oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms
1641 2024.09.02 20:05:58.971800 [ 207202 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079297536, merge_with_ttl_allowedtrue)
1642 2024.09.02 20:05:58.971874 [ 207202 ] {} <Trace> oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms
1643 2024.09.02 20:06:08.044644 [ 207250 ] {} <Debug> DNSResolver: Updating DNS cache
1644 2024.09.02 20:06:08.044698 [ 207250 ] {} <Debug> DNSResolver: Updated DNS cache
1645 2024.09.02 20:06:09.001057 [ 207413 ] {} <Trace> AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000121641 sec.
1646 2024.09.02 20:06:18.268503 [ 207239 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079209472, merge_with_ttl_allowedtrue)
1647 2024.09.02 20:06:18.268552 [ 207239 ] {} <Trace> oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms
1648 2024.09.02 20:06:23.044800 [ 207278 ] {} <Debug> DNSResolver: Updating DNS cache
1649 2024.09.02 20:06:23.044858 [ 207278 ] {} <Debug> DNSResolver: Updated DNS cache
1650 2024.09.02 20:06:33.407785 [ 207293 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079137792, merge_with_ttl_allowedtrue)
1651 2024.09.02 20:06:33.407838 [ 207293 ] {} <Trace> oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms
1652 2024.09.02 20:06:38.044962 [ 207300 ] {} <Debug> DNSResolver: Updating DNS cache
1653 2024.09.02 20:06:38.045014 [ 207300 ] {} <Debug> DNSResolver: Updated DNS cache