2024.09.02 19:50:07.774889 [ 207166 ] {} Application: Will watch for the process with pid 207167 2024.09.02 19:50:07.774926 [ 207167 ] {} Application: Forked a child process to watch 2024.09.02 19:50:07.775038 [ 207167 ] {} SentryWriter: Sending crash reports is disabled 2024.09.02 19:50:07.775129 [ 207167 ] {} Pipe: Pipe capacity is 1.00 MiB 2024.09.02 19:50:07.822132 [ 207167 ] {} Application: Starting ClickHouse 23.8.7.24 (revision: 54477, git hash: 812b95e14ba8cf744bf1d70e6de607cf130a79fa, build id: 6484B75ECB16F4FF87A88E10249A45E1BDBDE2E5), PID 207167 2024.09.02 19:50:07.822190 [ 207167 ] {} Application: starting up 2024.09.02 19:50:07.822215 [ 207167 ] {} Application: OS name: Linux, version: 5.15.0-1015-aws, architecture: x86_64 2024.09.02 19:50:07.825209 [ 207167 ] {} Application: Available RAM: 30.68 GiB; physical cores: 8; logical cores: 8. 2024.09.02 19:50:07.825812 [ 207167 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2024.09.02 19:50:07.825829 [ 207167 ] {} AsynchronousMetrics: Scanning /sys/block 2024.09.02 19:50:07.825867 [ 207167 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2024.09.02 19:50:07.825880 [ 207167 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2024.09.02 19:50:07.975118 [ 207167 ] {} Application: Integrity check of the executable successfully passed (checksum: 63E397DB90569A93F13765E06F4A1FBF) 2024.09.02 19:50:07.979198 [ 207167 ] {} Application: Set max number of file descriptors to 524288 (was 1024). 2024.09.02 19:50:07.979212 [ 207167 ] {} Application: rlimit on number of threads is 125612 2024.09.02 19:50:07.979217 [ 207167 ] {} Application: Initializing DateLUT. 2024.09.02 19:50:07.979220 [ 207167 ] {} Application: Initialized DateLUT with time zone 'UTC'. 2024.09.02 19:50:07.979239 [ 207167 ] {} Context: Setting up /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/data/tmp/ to store temporary data in it 2024.09.02 19:50:07.980089 [ 207167 ] {} Application: Initializing interserver credentials. 2024.09.02 19:50:07.980582 [ 207167 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml' 2024.09.02 19:50:07.981119 [ 207167 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration 2024.09.02 19:50:07.981556 [ 207167 ] {} Application: Setting max_server_memory_usage was set to 27.61 GiB (30.68 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.09.02 19:50:07.981565 [ 207167 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.34 GiB (30.68 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.09.02 19:50:07.981568 [ 207167 ] {} Application: Merges and mutations memory limit is set to 15.34 GiB 2024.09.02 19:50:07.981789 [ 207167 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2024.09.02 19:50:07.984495 [ 207167 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads 2024.09.02 19:50:08.002264 [ 207167 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2024.09.02 19:50:08.003049 [ 207167 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2024.09.02 19:50:08.003725 [ 207167 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.09.02 19:50:08.003913 [ 207167 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration 2024.09.02 19:50:08.010907 [ 207167 ] {} Application: Listening for replica communication (interserver): http://[::1]:19403 2024.09.02 19:50:08.014187 [ 207167 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml' 2024.09.02 19:50:08.014917 [ 207167 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration 2024.09.02 19:50:08.015858 [ 207167 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration 2024.09.02 19:50:08.017463 [ 207167 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml 2024.09.02 19:50:08.018305 [ 207167 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2024.09.02 19:50:08.019516 [ 207167 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2024.09.02 19:50:08.019939 [ 207167 ] {} Context: Initialized background executor for fetches with num_threads=8, num_tasks=8 2024.09.02 19:50:08.021100 [ 207167 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2024.09.02 19:50:08.023353 [ 207167 ] {} DNSCacheUpdater: Update period 15 seconds 2024.09.02 19:50:08.023372 [ 207167 ] {} Application: Loading metadata from /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/data/ 2024.09.02 19:50:08.023423 [ 207192 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:50:08.023460 [ 207192 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:50:08.041251 [ 207167 ] {} DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total. 2024.09.02 19:50:08.041265 [ 207167 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 9.14e-05 sec 2024.09.02 19:50:08.041270 [ 207167 ] {} ReferentialDeps: No tables 2024.09.02 19:50:08.041272 [ 207167 ] {} LoadingDeps: No tables 2024.09.02 19:50:08.041315 [ 207167 ] {} DatabaseAtomic (system): Starting up tables. 2024.09.02 19:50:08.041337 [ 207167 ] {} SystemLog: Not creating system.query_log since corresponding section 'query_log' is missing from config 2024.09.02 19:50:08.041344 [ 207167 ] {} SystemLog: Not creating system.query_thread_log since corresponding section 'query_thread_log' is missing from config 2024.09.02 19:50:08.041350 [ 207167 ] {} SystemLog: Not creating system.part_log since corresponding section 'part_log' is missing from config 2024.09.02 19:50:08.041356 [ 207167 ] {} SystemLog: Not creating system.trace_log since corresponding section 'trace_log' is missing from config 2024.09.02 19:50:08.041362 [ 207167 ] {} SystemLog: Not creating system.crash_log since corresponding section 'crash_log' is missing from config 2024.09.02 19:50:08.041370 [ 207167 ] {} SystemLog: Not creating system.text_log since corresponding section 'text_log' is missing from config 2024.09.02 19:50:08.041377 [ 207167 ] {} SystemLog: Not creating system.metric_log since corresponding section 'metric_log' is missing from config 2024.09.02 19:50:08.041382 [ 207167 ] {} SystemLog: Not creating system.filesystem_cache_log since corresponding section 'filesystem_cache_log' is missing from config 2024.09.02 19:50:08.041395 [ 207167 ] {} SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config 2024.09.02 19:50:08.041401 [ 207167 ] {} SystemLog: Not creating system.asynchronous_metric_log since corresponding section 'asynchronous_metric_log' is missing from config 2024.09.02 19:50:08.041406 [ 207167 ] {} SystemLog: Not creating system.opentelemetry_span_log since corresponding section 'opentelemetry_span_log' is missing from config 2024.09.02 19:50:08.041412 [ 207167 ] {} SystemLog: Not creating system.query_views_log since corresponding section 'query_views_log' is missing from config 2024.09.02 19:50:08.041417 [ 207167 ] {} SystemLog: Not creating system.zookeeper_log since corresponding section 'zookeeper_log' is missing from config 2024.09.02 19:50:08.041422 [ 207167 ] {} SystemLog: Not creating system.session_log since corresponding section 'session_log' is missing from config 2024.09.02 19:50:08.041428 [ 207167 ] {} SystemLog: Not creating system.transactions_info_log since corresponding section 'transactions_info_log' is missing from config 2024.09.02 19:50:08.041435 [ 207167 ] {} SystemLog: Not creating system.processors_profile_log since corresponding section 'processors_profile_log' is missing from config 2024.09.02 19:50:08.041442 [ 207167 ] {} SystemLog: Not creating system.asynchronous_insert_log since corresponding section 'asynchronous_insert_log' is missing from config 2024.09.02 19:50:08.054961 [ 207167 ] {} DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal. 2024.09.02 19:50:08.062026 [ 207167 ] {} DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total. 2024.09.02 19:50:08.062044 [ 207167 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 6.978e-05 sec 2024.09.02 19:50:08.062051 [ 207167 ] {} ReferentialDeps: No tables 2024.09.02 19:50:08.062055 [ 207167 ] {} LoadingDeps: No tables 2024.09.02 19:50:08.062076 [ 207167 ] {} DatabaseAtomic (default): Starting up tables. 2024.09.02 19:50:08.062174 [ 207167 ] {} UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/data/user_defined/ 2024.09.02 19:50:08.062205 [ 207167 ] {} UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded 2024.09.02 19:50:08.062211 [ 207167 ] {} Application: Loaded metadata. 2024.09.02 19:50:08.062236 [ 207167 ] {} Application: Tasks stats provider: procfs 2024.09.02 19:50:08.062242 [ 207167 ] {} Application: It looks like the process has no CAP_SYS_NICE capability, the setting 'os_thread_priority' will have no effect. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_sys_nice=+ep /work/oxidecomputer/omicron/out/clickhouse/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems. 2024.09.02 19:50:08.062370 [ 207167 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.09.02 19:50:08.062880 [ 207167 ] {} AsynchronousMetrics: MemoryTracking: was 8.56 MiB, peak 13.27 MiB, free memory in arenas 9.68 MiB, will set to 371.73 MiB (RSS), difference: 363.17 MiB 2024.09.02 19:50:08.063606 [ 207167 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 2.062e-05 sec. 2024.09.02 19:50:08.064052 [ 207167 ] {} Application: Listening for http://[::1]:19303 2024.09.02 19:50:08.064162 [ 207167 ] {} Application: Listening for native protocol (tcp): [::1]:19203 2024.09.02 19:50:08.064172 [ 207412 ] {} DDLWorker: Started DDLWorker cleanup thread 2024.09.02 19:50:08.064185 [ 207167 ] {} Application: Ready for connections. 2024.09.02 19:50:08.064761 [ 207410 ] {} DDLWorker: Starting DDLWorker thread 2024.09.02 19:50:08.064993 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: GET, Address: [::1]:48516, User-Agent: (none), Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:08.066311 [ 207410 ] {} DDLWorker: Initializing DDLWorker thread 2024.09.02 19:50:08.067146 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 1261, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:08.067936 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:08.067963 [ 207169 ] {} HTTP-Session: c93c01b5-4fd7-432c-8d34-b2b56b61649b Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:08.067976 [ 207169 ] {} HTTP-Session: c93c01b5-4fd7-432c-8d34-b2b56b61649b Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.067982 [ 207169 ] {} HTTP-Session: c93c01b5-4fd7-432c-8d34-b2b56b61649b Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.068067 [ 207169 ] {} ContextAccess (default): Settings: readonly = 0, allow_ddl = true, allow_introspection_functions = false 2024.09.02 19:50:08.068082 [ 207169 ] {} ContextAccess (default): List of all grants: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* 2024.09.02 19:50:08.068089 [ 207169 ] {} ContextAccess (default): List of all grants including implicit: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* 2024.09.02 19:50:08.068116 [ 207169 ] {} HTTP-Session: c93c01b5-4fd7-432c-8d34-b2b56b61649b Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:08.068286 [ 207169 ] {0e334290-cf3b-49db-a6d4-df4fa3a79ce2} executeQuery: (from [::1]:48516) /* We purposefully split our DB schema into two *disjoint* files: * `db-init-1.sql` and `db-init-2.sql`. The purpose of this split is to shorten * the duration of our replicated tests. These tests only use a subset of the * tables defined in the full schema. We put the tables used by the replicated * tests in `db-init-1.sql`, and the remainder of the tables in `db-init-2.sql`. * This minimizes test time by reducing the cost to load a schema. In * production, we load `db-init-1.sql` followed by `db-init-2.sql` so we have * the full schema. If we end up needing to use more tables in replicated tests * we can go ahead and move them into `db-init-1.sql`, removing them from * `db-init-2.sql`. Conversely, if we stop using given tables in our tests we * can move them from `db-init-1.sql` into `db-init-2.sql` and keep our test * times minimal. * The reason to keep the two files disjoint is so that we don't have to * maintain consistency between table definitions. All tables are defined * once. However, in order to write a test that ensures the tables are in fact * disjoint, we must create the `oximeter` database in both files so we can load * them in isolation. */ CREATE DATABASE IF NOT EXISTS oximeter ON CLUSTER oximeter_cluster (stage: Complete) 2024.09.02 19:50:08.068349 [ 207169 ] {0e334290-cf3b-49db-a6d4-df4fa3a79ce2} ContextAccess (default): Access granted: CREATE DATABASE ON oximeter.* 2024.09.02 19:50:08.072037 [ 207410 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19002 with session_id 6 2024.09.02 19:50:08.072374 [ 207410 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.09.02 19:50:08.072382 [ 207410 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.09.02 19:50:08.072385 [ 207410 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.09.02 19:50:08.072389 [ 207410 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003 2024.09.02 19:50:08.077387 [ 207410 ] {} DDLWorker: Initialized DDLWorker thread 2024.09.02 19:50:08.077415 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.077421 [ 207410 ] {} DDLWorker: Don't have unfinished tasks after restarting 2024.09.02 19:50:08.077422 [ 207412 ] {} DDLWorker: Cleaning queue 2024.09.02 19:50:08.082381 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=10, queue_size=10, entries=query-0000000000..query-0000000009, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2024.09.02 19:50:08.082407 [ 207410 ] {} DDLWorker: Will schedule 10 tasks starting from query-0000000000 2024.09.02 19:50:08.082413 [ 207410 ] {} DDLWorker: Checking task query-0000000000 2024.09.02 19:50:08.082572 [ 207410 ] {} DDLWorker: Will not execute task query-0000000000: There is no a local address in host list 2024.09.02 19:50:08.082582 [ 207410 ] {} DDLWorker: Checking task query-0000000001 2024.09.02 19:50:08.082747 [ 207410 ] {} DDLWorker: Will not execute task query-0000000001: There is no a local address in host list 2024.09.02 19:50:08.082754 [ 207410 ] {} DDLWorker: Checking task query-0000000002 2024.09.02 19:50:08.082906 [ 207410 ] {} DDLWorker: Will not execute task query-0000000002: There is no a local address in host list 2024.09.02 19:50:08.082916 [ 207410 ] {} DDLWorker: Checking task query-0000000003 2024.09.02 19:50:08.083156 [ 207410 ] {} DDLWorker: Will not execute task query-0000000003: There is no a local address in host list 2024.09.02 19:50:08.083164 [ 207410 ] {} DDLWorker: Checking task query-0000000004 2024.09.02 19:50:08.083451 [ 207410 ] {} DDLWorker: Will not execute task query-0000000004: There is no a local address in host list 2024.09.02 19:50:08.083458 [ 207410 ] {} DDLWorker: Checking task query-0000000005 2024.09.02 19:50:08.090378 [ 207410 ] {} DDLWorker: Will not execute task query-0000000005: There is no a local address in host list 2024.09.02 19:50:08.090395 [ 207410 ] {} DDLWorker: Checking task query-0000000006 2024.09.02 19:50:08.104446 [ 207410 ] {} DDLWorker: Will not execute task query-0000000006: There is no a local address in host list 2024.09.02 19:50:08.104462 [ 207410 ] {} DDLWorker: Checking task query-0000000007 2024.09.02 19:50:08.104593 [ 207410 ] {} DDLWorker: Will not execute task query-0000000007: There is no a local address in host list 2024.09.02 19:50:08.104600 [ 207410 ] {} DDLWorker: Checking task query-0000000008 2024.09.02 19:50:08.104803 [ 207410 ] {} DDLWorker: Will not execute task query-0000000008: There is no a local address in host list 2024.09.02 19:50:08.104815 [ 207410 ] {} DDLWorker: Checking task query-0000000009 2024.09.02 19:50:08.105051 [ 207410 ] {} DDLWorker: Will not execute task query-0000000009: There is no a local address in host list 2024.09.02 19:50:08.105062 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.105070 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.105083 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.106478 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=11, queue_size=11, entries=query-0000000000..query-0000000010, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:08.107230 [ 207410 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000010 2024.09.02 19:50:08.107238 [ 207410 ] {} DDLWorker: Checking task query-0000000010 2024.09.02 19:50:08.113720 [ 207410 ] {} DDLWorker: Processing task query-0000000010 (CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3') 2024.09.02 19:50:08.120671 [ 207410 ] {} DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3' 2024.09.02 19:50:08.120812 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 0e334290-cf3b-49db-a6d4-df4fa3a79ce2) /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3' (stage: Complete) 2024.09.02 19:50:08.125662 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} DatabaseAtomic (oximeter): Metadata processed, database oximeter has 0 tables and 0 dictionaries in total. 2024.09.02 19:50:08.125675 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} TablesLoader: Parsed metadata of 0 tables in 1 databases in 5.372e-05 sec 2024.09.02 19:50:08.125680 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} ReferentialDeps: No tables 2024.09.02 19:50:08.125683 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} LoadingDeps: No tables 2024.09.02 19:50:08.125700 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} DatabaseAtomic (oximeter): Starting up tables. 2024.09.02 19:50:08.125779 [ 207410 ] {af74551e-a7a1-490c-a548-7de28893156c} DDLWorker: Executed query: /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID '90e92b16-cd08-4c28-93a8-510910456aa3' 2024.09.02 19:50:08.131697 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.206505 [ 207169 ] {0e334290-cf3b-49db-a6d4-df4fa3a79ce2} executeQuery: Read 3 rows, 141.00 B in 0.138255 sec., 21.699034392969516 rows/sec., 1019.85 B/sec. 2024.09.02 19:50:08.207083 [ 207169 ] {0e334290-cf3b-49db-a6d4-df4fa3a79ce2} DynamicQueryHandler: Done processing query 2024.09.02 19:50:08.209682 [ 207169 ] {0e334290-cf3b-49db-a6d4-df4fa3a79ce2} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.09.02 19:50:08.209699 [ 207169 ] {} HTTP-Session: c93c01b5-4fd7-432c-8d34-b2b56b61649b Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.210323 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 310, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:08.210366 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:08.210381 [ 207169 ] {} HTTP-Session: 0e5957bf-7457-4dbc-83f1-d4af6a36b8c3 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:08.210418 [ 207169 ] {} HTTP-Session: 0e5957bf-7457-4dbc-83f1-d4af6a36b8c3 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.210427 [ 207169 ] {} HTTP-Session: 0e5957bf-7457-4dbc-83f1-d4af6a36b8c3 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.210480 [ 207169 ] {} HTTP-Session: 0e5957bf-7457-4dbc-83f1-d4af6a36b8c3 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:08.210768 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} executeQuery: (from [::1]:48516) /* The version table contains metadata about the `oximeter` database */ CREATE TABLE IF NOT EXISTS oximeter.version ON CLUSTER oximeter_cluster ( value UInt64, timestamp DateTime64(9, 'UTC') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) 2024.09.02 19:50:08.211891 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.version 2024.09.02 19:50:08.211981 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.version 2024.09.02 19:50:08.220992 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.221020 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.223513 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=12, queue_size=12, entries=query-0000000000..query-0000000011, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000010, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:08.223808 [ 207410 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000011 2024.09.02 19:50:08.223818 [ 207410 ] {} DDLWorker: Checking task query-0000000011 2024.09.02 19:50:08.228620 [ 207410 ] {} DDLWorker: Processing task query-0000000011 (CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)) 2024.09.02 19:50:08.248435 [ 207410 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.09.02 19:50:08.248604 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 434b2747-fa1d-42bc-94c8-45f3f74f317b) /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) 2024.09.02 19:50:08.249307 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} StoragePolicy (default): Storage policy default created, total volumes 1 2024.09.02 19:50:08.253010 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Loading data parts 2024.09.02 19:50:08.253831 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): There are no data parts 2024.09.02 19:50:08.257853 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): This table /clickhouse/tables/1/version is already created, will add new replica 2024.09.02 19:50:08.258706 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Creating replica /clickhouse/tables/1/version/replicas/3 2024.09.02 19:50:08.310406 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Creating shared ID for table oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc) 2024.09.02 19:50:08.310553 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Initializing table shared ID with 626c1ca5-d8d8-4409-a032-b2aeb18345c3 2024.09.02 19:50:08.313449 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Starting up table 2024.09.02 19:50:08.313718 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Became leader 2024.09.02 19:50:08.313729 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:08.313778 [ 207200 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.09.02 19:50:08.313798 [ 207200 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:08.322731 [ 207200 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Replica 2 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.09.02 19:50:08.325040 [ 207200 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Replica 1 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.09.02 19:50:08.325045 [ 207200 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Will mimic 2 2024.09.02 19:50:08.341086 [ 207200 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Queued 0 parts to be fetched, 0 parts ignored 2024.09.02 19:50:08.341817 [ 207200 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Copied 0 queue entries, 0 entries ignored 2024.09.02 19:50:08.342075 [ 207200 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Parts in ZooKeeper after mimic: 2024.09.02 19:50:08.342088 [ 207200 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Enqueued fetches after mimic: 2024.09.02 19:50:08.344609 [ 207200 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:08.344714 [ 207200 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:08.344726 [ 207200 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/3/queue 2024.09.02 19:50:08.344848 [ 207200 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:08.344985 [ 207200 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:08.345770 [ 207200 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:08.345903 [ 207199 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 6548ms 2024.09.02 19:50:08.346030 [ 207410 ] {f57efa15-457e-45f2-bd90-9c54bb45244d} DDLWorker: Executed query: /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID 'c3224e73-e5f1-47d1-8924-d9f345d987fc' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.09.02 19:50:08.348496 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.393371 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} executeQuery: Read 3 rows, 141.00 B in 0.182747 sec., 16.41613815821874 rows/sec., 771.56 B/sec. 2024.09.02 19:50:08.393642 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} DynamicQueryHandler: Done processing query 2024.09.02 19:50:08.393662 [ 207169 ] {434b2747-fa1d-42bc-94c8-45f3f74f317b} MemoryTracker: Peak memory usage (for query): 4.96 MiB. 2024.09.02 19:50:08.393671 [ 207169 ] {} HTTP-Session: 0e5957bf-7457-4dbc-83f1-d4af6a36b8c3 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.394688 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 997, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:08.394751 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:08.394766 [ 207169 ] {} HTTP-Session: bb715a2c-81eb-4700-85b1-79b2b00b7bca Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:08.394781 [ 207169 ] {} HTTP-Session: bb715a2c-81eb-4700-85b1-79b2b00b7bca Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.394787 [ 207169 ] {} HTTP-Session: bb715a2c-81eb-4700-85b1-79b2b00b7bca Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.394832 [ 207169 ] {} HTTP-Session: bb715a2c-81eb-4700-85b1-79b2b00b7bca Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:08.395127 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} executeQuery: (from [::1]:48516) /* The measurement tables contain all individual samples from each timeseries. * * Each table stores a single datum type, and otherwise contains nearly the same * structure. The primary sorting key is on the timeseries name, key, and then * timestamp, so that all timeseries from the same schema are grouped, followed * by all samples from the same timeseries. * * This reflects that one usually looks up the _key_ in one or more field table, * and then uses that to index quickly into the measurements tables. */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local ON CLUSTER oximeter_cluster ( timeseries_name String, timeseries_key UInt64, start_time DateTime64(9, 'UTC'), timestamp DateTime64(9, 'UTC'), datum Nullable(Float64) ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + INTERVAL 30 DAY (stage: Complete) 2024.09.02 19:50:08.395621 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64_local 2024.09.02 19:50:08.395759 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64_local 2024.09.02 19:50:08.403124 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.403156 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.403311 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=13, queue_size=13, entries=query-0000000000..query-0000000012, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000011, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:08.403320 [ 207410 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000012 2024.09.02 19:50:08.403325 [ 207410 ] {} DDLWorker: Checking task query-0000000012 2024.09.02 19:50:08.407450 [ 207410 ] {} DDLWorker: Processing task query-0000000012 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.09.02 19:50:08.411108 [ 207410 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.09.02 19:50:08.411351 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8ace4dfe-7928-4de3-a7d9-e18bb1f26969) /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.09.02 19:50:08.415732 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Loading data parts 2024.09.02 19:50:08.415966 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): There are no data parts 2024.09.02 19:50:08.419638 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): This table /clickhouse/tables/1/measurements_cumulativef64_local is already created, will add new replica 2024.09.02 19:50:08.420828 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Creating replica /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3 2024.09.02 19:50:08.457946 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Creating shared ID for table oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) 2024.09.02 19:50:08.458091 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Initializing table shared ID with 8387b2c6-e147-451e-8e5f-84f4bbeb2c47 2024.09.02 19:50:08.463508 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Starting up table 2024.09.02 19:50:08.463722 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Became leader 2024.09.02 19:50:08.463732 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:08.463785 [ 207221 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.09.02 19:50:08.463821 [ 207221 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:08.469132 [ 207221 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.09.02 19:50:08.469150 [ 207221 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.09.02 19:50:08.469154 [ 207221 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Will mimic 2 2024.09.02 19:50:08.480830 [ 207221 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Queued 1 parts to be fetched, 0 parts ignored 2024.09.02 19:50:08.480847 [ 207221 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Copied 0 queue entries, 0 entries ignored 2024.09.02 19:50:08.480988 [ 207221 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Parts in ZooKeeper after mimic: 2024.09.02 19:50:08.481002 [ 207221 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Enqueued fetches after mimic: all_0_0_0 2024.09.02 19:50:08.486616 [ 207221 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:08.486775 [ 207221 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:08.486792 [ 207221 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/queue 2024.09.02 19:50:08.486901 [ 207221 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:08.487056 [ 207221 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.09.02 19:50:08.493249 [ 207221 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:08.494231 [ 207221 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:08.494435 [ 207230 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 6226ms 2024.09.02 19:50:08.494865 [ 207195 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks 2024.09.02 19:50:08.494934 [ 207410 ] {454a971b-adb3-4cec-977d-63a3bfd71194} DDLWorker: Executed query: /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'fcc03e88-5c08-4d5c-836b-80d287ce76ad' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.09.02 19:50:08.495105 [ 207379 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Fetching part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/2 2024.09.02 19:50:08.499159 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.499269 [ 207379 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19402/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:08.499350 [ 207379 ] {} HTTPSessionAdapter: Created HTTP(S) session with ::1:19402 (::1:19402) 2024.09.02 19:50:08.501233 [ 207379 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:08.501255 [ 207379 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.75 GiB. 2024.09.02 19:50:08.501269 [ 207379 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:08.501308 [ 207379 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.09.02 19:50:08.503663 [ 207379 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.09.02 19:50:08.503682 [ 207379 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:08.503720 [ 207379 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Committing part all_0_0_0 to zookeeper 2024.09.02 19:50:08.508806 [ 207379 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Part all_0_0_0 committed to zookeeper 2024.09.02 19:50:08.508861 [ 207379 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Fetched part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/2 2024.09.02 19:50:08.508951 [ 207228 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89522591744, merge_with_ttl_allowedtrue) 2024.09.02 19:50:08.508983 [ 207228 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 7789ms 2024.09.02 19:50:08.517586 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} executeQuery: Read 3 rows, 141.00 B in 0.122644 sec., 24.461041714229804 rows/sec., 1.12 KiB/sec. 2024.09.02 19:50:08.517817 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} DynamicQueryHandler: Done processing query 2024.09.02 19:50:08.517833 [ 207169 ] {8ace4dfe-7928-4de3-a7d9-e18bb1f26969} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.09.02 19:50:08.517842 [ 207169 ] {} HTTP-Session: bb715a2c-81eb-4700-85b1-79b2b00b7bca Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.518769 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 274, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:08.519281 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:08.519292 [ 207169 ] {} HTTP-Session: ec379be8-7bb6-435b-ad73-5b32396d19a8 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:08.519303 [ 207169 ] {} HTTP-Session: ec379be8-7bb6-435b-ad73-5b32396d19a8 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.519306 [ 207169 ] {} HTTP-Session: ec379be8-7bb6-435b-ad73-5b32396d19a8 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.519339 [ 207169 ] {} HTTP-Session: ec379be8-7bb6-435b-ad73-5b32396d19a8 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:08.519508 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} executeQuery: (from [::1]:48516) CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 ON CLUSTER oximeter_cluster AS oximeter.measurements_cumulativef64_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:08.519539 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64 2024.09.02 19:50:08.519546 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:08.519551 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:08.519625 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64 2024.09.02 19:50:08.519631 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:08.531399 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.531409 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.539602 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=14, queue_size=14, entries=query-0000000000..query-0000000013, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000012, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:08.539628 [ 207410 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000013 2024.09.02 19:50:08.539633 [ 207410 ] {} DDLWorker: Checking task query-0000000013 2024.09.02 19:50:08.543798 [ 207410 ] {} DDLWorker: Processing task query-0000000013 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:08.552200 [ 207410 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:08.552408 [ 207410 ] {56c1f0a4-5a9a-4935-b9e5-fab81728b8c4} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 37189558-ff42-474d-ab2d-4505cd71d619) /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:08.553004 [ 207410 ] {56c1f0a4-5a9a-4935-b9e5-fab81728b8c4} StorageDistributed (measurements_cumulativef64): Auto-increment is 0 2024.09.02 19:50:08.560421 [ 207410 ] {56c1f0a4-5a9a-4935-b9e5-fab81728b8c4} DDLWorker: Executed query: /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '883a0cf1-2d56-46f2-84c9-7b230eb59d60' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:08.564299 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.644882 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} executeQuery: Read 3 rows, 141.00 B in 0.125447 sec., 23.91448181303658 rows/sec., 1.10 KiB/sec. 2024.09.02 19:50:08.645132 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} DynamicQueryHandler: Done processing query 2024.09.02 19:50:08.645150 [ 207169 ] {37189558-ff42-474d-ab2d-4505cd71d619} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.09.02 19:50:08.645157 [ 207169 ] {} HTTP-Session: ec379be8-7bb6-435b-ad73-5b32396d19a8 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.646038 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 1384, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:08.646789 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:08.646801 [ 207169 ] {} HTTP-Session: 0f3aed3b-ad46-4fa6-bce6-52f45ae377f6 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:08.646814 [ 207169 ] {} HTTP-Session: 0f3aed3b-ad46-4fa6-bce6-52f45ae377f6 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.646819 [ 207169 ] {} HTTP-Session: 0f3aed3b-ad46-4fa6-bce6-52f45ae377f6 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.646868 [ 207169 ] {} HTTP-Session: 0f3aed3b-ad46-4fa6-bce6-52f45ae377f6 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:08.647143 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} executeQuery: (from [::1]:48516) /* The field tables store named dimensions of each timeseries. * * As with the measurement tables, there is one field table for each field data * type. Fields are deduplicated by using the "replacing merge tree", though * this behavior **must not** be relied upon for query correctness. * * The index for the fields differs from the measurements, however. Rows are * sorted by timeseries name, then field name, field value, and finally * timeseries key. This reflects the most common pattern for looking them up: * by field name and possibly value, within a timeseries. The resulting keys are * usually then used to look up measurements. * * NOTE: We may want to consider a secondary index on these tables, sorting by * timeseries name and then key, since it would improve lookups where one * already has the key. Realistically though, these tables are quite small and * so performance benefits will be low in absolute terms. */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local ON CLUSTER oximeter_cluster ( timeseries_name String, timeseries_key UInt64, field_name String, field_value Int64, last_updated_at DateTime MATERIALIZED now() ) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + INTERVAL 30 DAY (stage: Complete) 2024.09.02 19:50:08.647191 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64_local 2024.09.02 19:50:08.647394 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64_local 2024.09.02 19:50:08.657655 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.657686 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.669079 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=15, queue_size=15, entries=query-0000000000..query-0000000014, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000013, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:08.669096 [ 207410 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000014 2024.09.02 19:50:08.669102 [ 207410 ] {} DDLWorker: Checking task query-0000000014 2024.09.02 19:50:08.669653 [ 207410 ] {} DDLWorker: Processing task query-0000000014 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.09.02 19:50:08.684503 [ 207410 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:08.684725 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 52e0bd6c-57f7-404b-ac8a-c1c145cb962a) /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.09.02 19:50:08.692147 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Loading data parts 2024.09.02 19:50:08.693300 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): There are no data parts 2024.09.02 19:50:08.698680 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): This table /clickhouse/tables/1/fields_i64_local is already created, will add new replica 2024.09.02 19:50:08.699681 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Creating replica /clickhouse/tables/1/fields_i64_local/replicas/3 2024.09.02 19:50:08.748700 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Creating shared ID for table oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) 2024.09.02 19:50:08.748828 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Initializing table shared ID with 745b0c5d-7345-48e5-92db-352d47dfc7b4 2024.09.02 19:50:08.753597 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Starting up table 2024.09.02 19:50:08.753837 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Became leader 2024.09.02 19:50:08.755339 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:08.755395 [ 207240 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.09.02 19:50:08.755423 [ 207240 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:08.762059 [ 207240 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.09.02 19:50:08.762075 [ 207240 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.09.02 19:50:08.762078 [ 207240 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Will mimic 2 2024.09.02 19:50:08.781618 [ 207240 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Queued 1 parts to be fetched, 0 parts ignored 2024.09.02 19:50:08.781634 [ 207240 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Copied 0 queue entries, 0 entries ignored 2024.09.02 19:50:08.781827 [ 207240 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Parts in ZooKeeper after mimic: 2024.09.02 19:50:08.781839 [ 207240 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Enqueued fetches after mimic: all_0_0_0 2024.09.02 19:50:08.787780 [ 207240 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:08.788733 [ 207240 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:08.790241 [ 207240 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/3/queue 2024.09.02 19:50:08.790419 [ 207240 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:08.790644 [ 207240 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.09.02 19:50:08.794530 [ 207240 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:08.796990 [ 207240 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:08.797142 [ 207256 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 6440ms 2024.09.02 19:50:08.797663 [ 207373 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1 2024.09.02 19:50:08.798260 [ 207410 ] {52ded82a-68c3-433e-9d79-f79e23aaae72} DDLWorker: Executed query: /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'ba1edf03-d402-4cf9-950d-c2b13382a3f7' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:08.798342 [ 207373 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:08.798352 [ 207258 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks 2024.09.02 19:50:08.798422 [ 207373 ] {} HTTPSessionAdapter: Created HTTP(S) session with ::1:19401 (::1:19401) 2024.09.02 19:50:08.800609 [ 207373 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:08.800630 [ 207373 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.75 GiB. 2024.09.02 19:50:08.800644 [ 207373 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:08.800656 [ 207373 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.09.02 19:50:08.802857 [ 207373 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.09.02 19:50:08.802884 [ 207373 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:08.802935 [ 207373 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Committing part all_0_0_0 to zookeeper 2024.09.02 19:50:08.803122 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.809999 [ 207373 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Part all_0_0_0 committed to zookeeper 2024.09.02 19:50:08.810124 [ 207373 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/1 2024.09.02 19:50:08.810297 [ 207241 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89521375232, merge_with_ttl_allowedtrue) 2024.09.02 19:50:08.810360 [ 207241 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 8418ms 2024.09.02 19:50:08.829091 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} executeQuery: Read 3 rows, 141.00 B in 0.182088 sec., 16.475550283379466 rows/sec., 774.35 B/sec. 2024.09.02 19:50:08.829537 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} DynamicQueryHandler: Done processing query 2024.09.02 19:50:08.829575 [ 207169 ] {52e0bd6c-57f7-404b-ac8a-c1c145cb962a} MemoryTracker: Peak memory usage (for query): 4.96 MiB. 2024.09.02 19:50:08.829587 [ 207169 ] {} HTTP-Session: 0f3aed3b-ad46-4fa6-bce6-52f45ae377f6 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.830876 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 226, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:08.831229 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:08.831247 [ 207169 ] {} HTTP-Session: 1dca7690-b287-4daf-8934-55f93df44083 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:08.831264 [ 207169 ] {} HTTP-Session: 1dca7690-b287-4daf-8934-55f93df44083 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.831272 [ 207169 ] {} HTTP-Session: 1dca7690-b287-4daf-8934-55f93df44083 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.831319 [ 207169 ] {} HTTP-Session: 1dca7690-b287-4daf-8934-55f93df44083 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:08.831661 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} executeQuery: (from [::1]:48516) CREATE TABLE IF NOT EXISTS oximeter.fields_i64 ON CLUSTER oximeter_cluster AS oximeter.fields_i64_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:08.831714 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64 2024.09.02 19:50:08.831726 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:08.831737 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:08.831839 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64 2024.09.02 19:50:08.831850 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:08.844629 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.844678 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.844958 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=16, queue_size=16, entries=query-0000000000..query-0000000015, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000014, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:08.844975 [ 207410 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000015 2024.09.02 19:50:08.844981 [ 207410 ] {} DDLWorker: Checking task query-0000000015 2024.09.02 19:50:08.848603 [ 207410 ] {} DDLWorker: Processing task query-0000000015 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:08.869648 [ 207410 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:08.869834 [ 207410 ] {bbd4ccf6-328d-4028-b907-0ea05c861daa} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: c2d8387b-0b77-4c12-a4d5-0e5372331992) /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:08.871793 [ 207410 ] {bbd4ccf6-328d-4028-b907-0ea05c861daa} StorageDistributed (fields_i64): Auto-increment is 0 2024.09.02 19:50:08.878369 [ 207410 ] {bbd4ccf6-328d-4028-b907-0ea05c861daa} DDLWorker: Executed query: /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '853bba48-cd47-4256-8f56-0acdb1b9ed2a' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:08.883261 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:08.972900 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} executeQuery: Read 3 rows, 141.00 B in 0.141423 sec., 21.212956874058676 rows/sec., 997.01 B/sec. 2024.09.02 19:50:08.973156 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} DynamicQueryHandler: Done processing query 2024.09.02 19:50:08.973172 [ 207169 ] {c2d8387b-0b77-4c12-a4d5-0e5372331992} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.09.02 19:50:08.973180 [ 207169 ] {} HTTP-Session: 1dca7690-b287-4daf-8934-55f93df44083 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.974134 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 441, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:08.975099 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:08.975111 [ 207169 ] {} HTTP-Session: 201614a0-b642-4615-8012-89529ed22b77 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:08.975121 [ 207169 ] {} HTTP-Session: 201614a0-b642-4615-8012-89529ed22b77 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.975126 [ 207169 ] {} HTTP-Session: 201614a0-b642-4615-8012-89529ed22b77 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:08.975155 [ 207169 ] {} HTTP-Session: 201614a0-b642-4615-8012-89529ed22b77 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:08.975336 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} executeQuery: (from [::1]:48516) CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local ON CLUSTER oximeter_cluster ( timeseries_name String, timeseries_key UInt64, field_name String, field_value UUID, last_updated_at DateTime MATERIALIZED now() ) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + INTERVAL 30 DAY (stage: Complete) 2024.09.02 19:50:08.975379 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid_local 2024.09.02 19:50:08.975528 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid_local 2024.09.02 19:50:08.988069 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:08.988078 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:08.999595 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=17, queue_size=17, entries=query-0000000000..query-0000000016, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000015, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:09.001323 [ 207410 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000016 2024.09.02 19:50:09.001334 [ 207410 ] {} DDLWorker: Checking task query-0000000016 2024.09.02 19:50:09.002030 [ 207410 ] {} DDLWorker: Processing task query-0000000016 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.09.02 19:50:09.017013 [ 207410 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:09.017187 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 29ec56c2-ebf7-4c6a-972e-826e0b263337) /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.09.02 19:50:09.023651 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Loading data parts 2024.09.02 19:50:09.025356 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): There are no data parts 2024.09.02 19:50:09.032094 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): This table /clickhouse/tables/1/fields_uuid_local is already created, will add new replica 2024.09.02 19:50:09.033297 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Creating replica /clickhouse/tables/1/fields_uuid_local/replicas/3 2024.09.02 19:50:09.104546 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Creating shared ID for table oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) 2024.09.02 19:50:09.104716 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Initializing table shared ID with 2a01182b-0909-4138-ac40-9871004f15b4 2024.09.02 19:50:09.113461 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Starting up table 2024.09.02 19:50:09.113657 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Became leader 2024.09.02 19:50:09.113667 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:09.113708 [ 207261 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.09.02 19:50:09.113730 [ 207261 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:09.120867 [ 207261 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.09.02 19:50:09.120884 [ 207261 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.09.02 19:50:09.120887 [ 207261 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Will mimic 1 2024.09.02 19:50:09.131622 [ 207261 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Queued 1 parts to be fetched, 0 parts ignored 2024.09.02 19:50:09.131636 [ 207261 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Copied 0 queue entries, 0 entries ignored 2024.09.02 19:50:09.131834 [ 207261 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Parts in ZooKeeper after mimic: 2024.09.02 19:50:09.131848 [ 207261 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Enqueued fetches after mimic: all_0_0_0 2024.09.02 19:50:09.136193 [ 207261 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:09.136346 [ 207261 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:09.136353 [ 207261 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/3/queue 2024.09.02 19:50:09.136475 [ 207261 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:09.136593 [ 207261 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.09.02 19:50:09.142078 [ 207261 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:09.142991 [ 207261 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:09.143127 [ 207265 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 6063ms 2024.09.02 19:50:09.143588 [ 207375 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/2 2024.09.02 19:50:09.144498 [ 207410 ] {9069b14e-d87d-4ff9-b711-5090e23ac7b3} DDLWorker: Executed query: /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID '614ac4a6-68d5-4c21-9de9-1166fa3f9b38' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.09.02 19:50:09.144741 [ 207375 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19402/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:09.146923 [ 207375 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:09.146943 [ 207375 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.74 GiB. 2024.09.02 19:50:09.146957 [ 207375 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:09.146969 [ 207375 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.09.02 19:50:09.147936 [ 207375 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.09.02 19:50:09.147958 [ 207375 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:09.148069 [ 207248 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks 2024.09.02 19:50:09.149824 [ 207375 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Committing part all_0_0_0 to zookeeper 2024.09.02 19:50:09.150059 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:09.153233 [ 207375 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Part all_0_0_0 committed to zookeeper 2024.09.02 19:50:09.153300 [ 207375 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/2 2024.09.02 19:50:09.153381 [ 207251 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89516068864, merge_with_ttl_allowedtrue) 2024.09.02 19:50:09.154662 [ 207251 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 7432ms 2024.09.02 19:50:09.165857 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} executeQuery: Read 3 rows, 141.00 B in 0.190607 sec., 15.73919111050486 rows/sec., 739.74 B/sec. 2024.09.02 19:50:09.166573 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} DynamicQueryHandler: Done processing query 2024.09.02 19:50:09.166592 [ 207169 ] {29ec56c2-ebf7-4c6a-972e-826e0b263337} MemoryTracker: Peak memory usage (for query): 4.96 MiB. 2024.09.02 19:50:09.166600 [ 207169 ] {} HTTP-Session: 201614a0-b642-4615-8012-89529ed22b77 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.167680 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 229, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:09.171133 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:09.171153 [ 207169 ] {} HTTP-Session: bfad78a0-53a2-4ae0-b0d8-a383dbbe6ff1 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:09.171168 [ 207169 ] {} HTTP-Session: bfad78a0-53a2-4ae0-b0d8-a383dbbe6ff1 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.171175 [ 207169 ] {} HTTP-Session: bfad78a0-53a2-4ae0-b0d8-a383dbbe6ff1 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.171223 [ 207169 ] {} HTTP-Session: bfad78a0-53a2-4ae0-b0d8-a383dbbe6ff1 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:09.171496 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} executeQuery: (from [::1]:48516) CREATE TABLE IF NOT EXISTS oximeter.fields_uuid ON CLUSTER oximeter_cluster AS oximeter.fields_uuid_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:09.171538 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid 2024.09.02 19:50:09.171549 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:09.171559 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:09.171628 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid 2024.09.02 19:50:09.171635 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:09.185128 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:09.185160 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:09.193617 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=18, queue_size=18, entries=query-0000000000..query-0000000017, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000016, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:09.193635 [ 207410 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000017 2024.09.02 19:50:09.193640 [ 207410 ] {} DDLWorker: Checking task query-0000000017 2024.09.02 19:50:09.194148 [ 207410 ] {} DDLWorker: Processing task query-0000000017 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:09.208344 [ 207410 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:09.208507 [ 207410 ] {11ccae3b-7297-4aef-a9cd-3e81c5c96061} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: b26d03ab-2e2b-49cd-9b59-6df10b4b32a7) /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:09.210653 [ 207410 ] {11ccae3b-7297-4aef-a9cd-3e81c5c96061} StorageDistributed (fields_uuid): Auto-increment is 0 2024.09.02 19:50:09.215348 [ 207410 ] {11ccae3b-7297-4aef-a9cd-3e81c5c96061} DDLWorker: Executed query: /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '23a87205-a11f-4215-86dc-ac227f9e2b8b' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:09.219715 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:09.295097 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} executeQuery: Read 3 rows, 141.00 B in 0.123712 sec., 24.24987066735644 rows/sec., 1.11 KiB/sec. 2024.09.02 19:50:09.295292 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} DynamicQueryHandler: Done processing query 2024.09.02 19:50:09.295304 [ 207169 ] {b26d03ab-2e2b-49cd-9b59-6df10b4b32a7} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.09.02 19:50:09.295310 [ 207169 ] {} HTTP-Session: bfad78a0-53a2-4ae0-b0d8-a383dbbe6ff1 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.296222 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 1525, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:09.296252 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:09.296260 [ 207169 ] {} HTTP-Session: 995482cd-edeb-476f-a923-9ee4479ce121 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:09.296270 [ 207169 ] {} HTTP-Session: 995482cd-edeb-476f-a923-9ee4479ce121 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.296273 [ 207169 ] {} HTTP-Session: 995482cd-edeb-476f-a923-9ee4479ce121 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.296305 [ 207169 ] {} HTTP-Session: 995482cd-edeb-476f-a923-9ee4479ce121 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:09.296678 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} executeQuery: (from [::1]:48516) /* The timeseries schema table stores the extracted schema for the samples * oximeter collects. */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local ON CLUSTER oximeter_cluster ( timeseries_name String, fields Nested( name String, type Enum( 'Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13 ), source Enum( 'Target' = 1, 'Metric' = 2 ) ), datum_type Enum( 'Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27 ), created DateTime64(9, 'UTC') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) 2024.09.02 19:50:09.296735 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema_local 2024.09.02 19:50:09.297057 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema_local 2024.09.02 19:50:09.308605 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:09.308608 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:09.322418 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=19, queue_size=19, entries=query-0000000000..query-0000000018, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000017, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:09.322438 [ 207410 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000018 2024.09.02 19:50:09.322443 [ 207410 ] {} DDLWorker: Checking task query-0000000018 2024.09.02 19:50:09.329753 [ 207410 ] {} DDLWorker: Processing task query-0000000018 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)) 2024.09.02 19:50:09.344941 [ 207410 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.09.02 19:50:09.347021 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 454fe081-af0d-4e06-9b21-59389f961b7a) /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) 2024.09.02 19:50:09.353720 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Loading data parts 2024.09.02 19:50:09.353995 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): There are no data parts 2024.09.02 19:50:09.359547 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): This table /clickhouse/tables/1/timeseries_schema_local is already created, will add new replica 2024.09.02 19:50:09.360577 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Creating replica /clickhouse/tables/1/timeseries_schema_local/replicas/3 2024.09.02 19:50:09.424011 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Creating shared ID for table oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) 2024.09.02 19:50:09.424302 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Initializing table shared ID with a2ebfaf1-ac91-4f00-bc5d-2262ba7d5a5b 2024.09.02 19:50:09.428763 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Starting up table 2024.09.02 19:50:09.428942 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Became leader 2024.09.02 19:50:09.428953 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:09.429012 [ 207236 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.09.02 19:50:09.429029 [ 207236 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:09.434281 [ 207236 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.09.02 19:50:09.434303 [ 207236 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.09.02 19:50:09.434308 [ 207236 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Will mimic 2 2024.09.02 19:50:09.445677 [ 207236 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Queued 1 parts to be fetched, 0 parts ignored 2024.09.02 19:50:09.445692 [ 207236 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Copied 0 queue entries, 0 entries ignored 2024.09.02 19:50:09.445856 [ 207236 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Parts in ZooKeeper after mimic: 2024.09.02 19:50:09.445865 [ 207236 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Enqueued fetches after mimic: all_0_0_0 2024.09.02 19:50:09.452799 [ 207236 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:09.454609 [ 207236 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:09.454623 [ 207236 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/3/queue 2024.09.02 19:50:09.454775 [ 207236 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:09.456387 [ 207236 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.09.02 19:50:09.460405 [ 207236 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:09.461203 [ 207236 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:09.461385 [ 207286 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 6346ms 2024.09.02 19:50:09.461703 [ 207289 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/timeseries_schema_local/blocks 2024.09.02 19:50:09.461839 [ 207381 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Fetching part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/2 2024.09.02 19:50:09.462338 [ 207410 ] {b9968e52-d20e-46ac-a8ef-9733e6b3272a} DDLWorker: Executed query: /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'b4a66826-887d-4127-8be1-078d55905034' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.09.02 19:50:09.462387 [ 207381 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19402/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ftimeseries_schema_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false 2024.09.02 19:50:09.463005 [ 207381 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:09.463021 [ 207381 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.73 GiB. 2024.09.02 19:50:09.463043 [ 207381 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.09.02 19:50:09.463058 [ 207381 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.09.02 19:50:09.465660 [ 207381 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.09.02 19:50:09.465677 [ 207381 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:09.465705 [ 207381 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Committing part all_0_0_0 to zookeeper 2024.09.02 19:50:09.466356 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:09.470946 [ 207381 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Part all_0_0_0 committed to zookeeper 2024.09.02 19:50:09.471002 [ 207381 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Fetched part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/2 2024.09.02 19:50:09.471065 [ 207291 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89514426368, merge_with_ttl_allowedtrue) 2024.09.02 19:50:09.471084 [ 207291 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 7668ms 2024.09.02 19:50:09.485117 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} executeQuery: Read 3 rows, 141.00 B in 0.188695 sec., 15.89867246084952 rows/sec., 747.24 B/sec. 2024.09.02 19:50:09.485373 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} DynamicQueryHandler: Done processing query 2024.09.02 19:50:09.485391 [ 207169 ] {454fe081-af0d-4e06-9b21-59389f961b7a} MemoryTracker: Peak memory usage (for query): 4.96 MiB. 2024.09.02 19:50:09.485398 [ 207169 ] {} HTTP-Session: 995482cd-edeb-476f-a923-9ee4479ce121 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.486336 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 247, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:09.487468 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:09.487483 [ 207169 ] {} HTTP-Session: ab299f71-b1cc-44fc-87aa-8256c97c2e35 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:09.487495 [ 207169 ] {} HTTP-Session: ab299f71-b1cc-44fc-87aa-8256c97c2e35 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.487499 [ 207169 ] {} HTTP-Session: ab299f71-b1cc-44fc-87aa-8256c97c2e35 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.487532 [ 207169 ] {} HTTP-Session: ab299f71-b1cc-44fc-87aa-8256c97c2e35 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:09.487692 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} executeQuery: (from [::1]:48516) CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema ON CLUSTER oximeter_cluster AS oximeter.timeseries_schema_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:09.487722 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema 2024.09.02 19:50:09.487728 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:09.487734 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:09.487914 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema 2024.09.02 19:50:09.487923 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} ContextAccess (default): Access granted: REMOTE ON *.* 2024.09.02 19:50:09.499538 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:09.499547 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:09.507742 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000018, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:09.507760 [ 207410 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000019 2024.09.02 19:50:09.507765 [ 207410 ] {} DDLWorker: Checking task query-0000000019 2024.09.02 19:50:09.508563 [ 207410 ] {} DDLWorker: Processing task query-0000000019 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.09.02 19:50:09.518341 [ 207410 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:09.518560 [ 207410 ] {31eca893-b8a9-4bc0-ac2a-2aaeb5b00b34} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 85056d0b-f852-4bad-8f4f-7ed622143aae) /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.09.02 19:50:09.519164 [ 207410 ] {31eca893-b8a9-4bc0-ac2a-2aaeb5b00b34} StorageDistributed (timeseries_schema): Auto-increment is 0 2024.09.02 19:50:09.526280 [ 207410 ] {31eca893-b8a9-4bc0-ac2a-2aaeb5b00b34} DDLWorker: Executed query: /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'b834205c-17bc-4194-b1e6-690377bb6137' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.09.02 19:50:09.530883 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:09.609524 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} executeQuery: Read 3 rows, 141.00 B in 0.12189 sec., 24.61235540241201 rows/sec., 1.13 KiB/sec. 2024.09.02 19:50:09.609852 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} DynamicQueryHandler: Done processing query 2024.09.02 19:50:09.609872 [ 207169 ] {85056d0b-f852-4bad-8f4f-7ed622143aae} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.09.02 19:50:09.609879 [ 207169 ] {} HTTP-Session: ab299f71-b1cc-44fc-87aa-8256c97c2e35 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.611733 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 60, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:09.611773 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:09.611781 [ 207169 ] {} HTTP-Session: d5f34d5d-9f32-4652-9ad0-183a43bef943 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:09.611792 [ 207169 ] {} HTTP-Session: d5f34d5d-9f32-4652-9ad0-183a43bef943 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.611795 [ 207169 ] {} HTTP-Session: d5f34d5d-9f32-4652-9ad0-183a43bef943 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.611830 [ 207169 ] {} HTTP-Session: d5f34d5d-9f32-4652-9ad0-183a43bef943 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:09.611973 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} executeQuery: (from [::1]:48516) SELECT * FROM oximeter.timeseries_schema FORMAT JSONEachRow; (stage: Complete) 2024.09.02 19:50:09.612183 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema 2024.09.02 19:50:09.612328 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema 2024.09.02 19:50:09.612509 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local 2024.09.02 19:50:09.612553 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:09.612623 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:09.613853 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (SelectExecutor): Key condition: unknown 2024.09.02 19:50:09.613877 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.09.02 19:50:09.613887 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:09.613906 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0 2024.09.02 19:50:09.614896 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} executeQuery: Read 1 rows, 126.00 B in 0.002962 sec., 337.60972316002704 rows/sec., 41.54 KiB/sec. 2024.09.02 19:50:09.616040 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} DynamicQueryHandler: Done processing query 2024.09.02 19:50:09.616060 [ 207169 ] {cecab91e-7865-4a3f-9833-2c9ea6e31efa} MemoryTracker: Peak memory usage (for query): 4.00 MiB. 2024.09.02 19:50:09.616066 [ 207169 ] {} HTTP-Session: d5f34d5d-9f32-4652-9ad0-183a43bef943 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.619409 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:09.619473 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:09.619485 [ 207169 ] {} HTTP-Session: b9f26908-2f01-4f3e-9d33-036747731ae1 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:09.619500 [ 207169 ] {} HTTP-Session: b9f26908-2f01-4f3e-9d33-036747731ae1 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.619505 [ 207169 ] {} HTTP-Session: b9f26908-2f01-4f3e-9d33-036747731ae1 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.619551 [ 207169 ] {} HTTP-Session: b9f26908-2f01-4f3e-9d33-036747731ae1 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:09.619918 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} executeQuery: (from [::1]:48516) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:09.620344 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:09.620583 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:09.620786 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:09.622589 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:09.623368 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:09.623466 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc8cbf3298) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:09.623477 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc8cbf3298) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:09.623569 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc8cbf3298) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.09.02 19:50:09.623881 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:09.624287 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:09.624355 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc1089cf18) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:09.624363 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc1089cf18) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:09.624885 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:09.625784 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:09.626008 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:09.626022 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:09.626128 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.09.02 19:50:09.626163 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:09.626185 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:09.626217 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc1089ca18) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0) 2024.09.02 19:50:09.626223 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc1089ca18) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)] 2024.09.02 19:50:09.626570 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:09.627720 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:09.627904 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:09.628068 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:09.628079 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:09.628179 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.09.02 19:50:09.628230 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:09.628279 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:09.628337 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc1089d418) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:09.628347 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc1089d418) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:09.628439 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc1089cf18) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.09.02 19:50:09.628698 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:09.628879 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:09.629027 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:09.629040 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:09.629146 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.09.02 19:50:09.629177 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:09.629198 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:09.629202 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:09.629213 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.09.02 19:50:09.629228 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:09.629250 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:09.629266 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:09.629299 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.09.02 19:50:09.629554 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:09.629583 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:09.629610 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:09.629618 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:09.629626 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:09.629644 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.09.02 19:50:09.629653 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:09.629724 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:09.629735 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 8 rows starting from 0 2024.09.02 19:50:09.629809 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:09.629820 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:09.629829 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:09.629832 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.09.02 19:50:09.629837 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:09.629846 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.09.02 19:50:09.629850 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:09.629894 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:09.629900 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0 2024.09.02 19:50:09.629936 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.09.02 19:50:09.629951 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:09.630024 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:09.630037 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:09.630047 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:09.630053 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:09.630060 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:09.630072 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.09.02 19:50:09.630078 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:09.630140 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:09.630150 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0 2024.09.02 19:50:09.630189 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:09.631302 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.09.02 19:50:09.632552 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} executeQuery: Read 40 rows, 2.89 KiB in 0.012888 sec., 3103.6623215394166 rows/sec., 224.29 KiB/sec. 2024.09.02 19:50:09.633378 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc1089ca18) Join data is being destroyed, 12544 bytes and 8 rows in hash table 2024.09.02 19:50:09.633444 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} HashJoin: (0x7efc1089d418) Join data is being destroyed, 12800 bytes and 8 rows in hash table 2024.09.02 19:50:09.633722 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} DynamicQueryHandler: Done processing query 2024.09.02 19:50:09.633737 [ 207169 ] {babaf764-de0a-4604-9383-2555d3b0d765} MemoryTracker: Peak memory usage (for query): 4.00 MiB. 2024.09.02 19:50:09.633750 [ 207169 ] {} HTTP-Session: b9f26908-2f01-4f3e-9d33-036747731ae1 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.634955 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 411, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:09.634993 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:09.634999 [ 207169 ] {} HTTP-Session: f120b79e-7d39-4991-bb9a-fb5d974bb742 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:09.635009 [ 207169 ] {} HTTP-Session: f120b79e-7d39-4991-bb9a-fb5d974bb742 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.635014 [ 207169 ] {} HTTP-Session: f120b79e-7d39-4991-bb9a-fb5d974bb742 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:09.635046 [ 207169 ] {} HTTP-Session: f120b79e-7d39-4991-bb9a-fb5d974bb742 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:09.635400 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} executeQuery: (from [::1]:48516) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (163777662738179873,3255198277614561830,4174330440898734823,5073661756869813506,6060338002058112069,10232564214925740701,10613593354210677318,16549134671421491687)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:09.635832 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.09.02 19:50:09.639200 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.09.02 19:50:09.639460 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:09.640575 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 10232564214925740701, 10613593354210677318, 16549134671421491687)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:09.640772 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local 2024.09.02 19:50:09.640817 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:09.640871 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:09.641011 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Key condition: (column 1 in 8-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:09.641035 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps 2024.09.02 19:50:09.641049 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.09.02 19:50:09.641062 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Spreading ranges among streams with order 2024.09.02 19:50:09.641115 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 10232564214925740701, 10613593354210677318, 16549134671421491687))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:09.641124 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 2024.09.02 19:50:09.643931 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} executeQuery: Read 400 rows, 25.78 KiB in 0.00865 sec., 46242.77456647399 rows/sec., 2.91 MiB/sec. 2024.09.02 19:50:09.645402 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} DynamicQueryHandler: Done processing query 2024.09.02 19:50:09.645416 [ 207169 ] {f7fafe81-c3b0-46f7-83f0-c37b27cea4f0} MemoryTracker: Peak memory usage (for query): 3.99 MiB. 2024.09.02 19:50:09.645424 [ 207169 ] {} HTTP-Session: f120b79e-7d39-4991-bb9a-fb5d974bb742 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.000990 [ 207413 ] {} AsynchronousMetrics: MemoryTracking: was 373.87 MiB, peak 380.08 MiB, free memory in arenas 37.85 MiB, will set to 379.26 MiB (RSS), difference: 5.39 MiB 2024.09.02 19:50:10.089521 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 1033, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.089581 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:10.089593 [ 207169 ] {} HTTP-Session: afe8e3e6-7267-4613-802b-88f6dc497797 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:10.089608 [ 207169 ] {} HTTP-Session: afe8e3e6-7267-4613-802b-88f6dc497797 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.089614 [ 207169 ] {} HTTP-Session: afe8e3e6-7267-4613-802b-88f6dc497797 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.089659 [ 207169 ] {} HTTP-Session: afe8e3e6-7267-4613-802b-88f6dc497797 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:10.089895 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} executeQuery: (from [::1]:48516) INSERT INTO oximeter.fields_i64 FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:10.089954 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.090304 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} ParallelParsingInputFormat: Parallel parsing is used 2024.09.02 19:50:10.090805 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.09.02 19:50:10.092429 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:10.092451 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.66 GiB. 2024.09.02 19:50:10.092882 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} MergedBlockOutputStream: filled checksums all_1_1_0 (state Temporary) 2024.09.02 19:50:10.094906 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): Wrote block with ID 'all_14521790212482541105_11730042875930291332', 8 rows 2024.09.02 19:50:10.102121 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:10.108706 [ 207278 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89475713024, merge_with_ttl_allowedtrue) 2024.09.02 19:50:10.108752 [ 207278 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 10136ms 2024.09.02 19:50:10.108908 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} executeQuery: Read 8 rows, 512.00 B in 0.019071 sec., 419.48508206176916 rows/sec., 26.22 KiB/sec. 2024.09.02 19:50:10.109096 [ 207257 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.09.02 19:50:10.111111 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} DynamicQueryHandler: Done processing query 2024.09.02 19:50:10.111130 [ 207169 ] {f5af5c7d-0602-4101-94da-6036ea2a0c94} MemoryTracker: Peak memory usage (for query): 4.28 MiB. 2024.09.02 19:50:10.111142 [ 207169 ] {} HTTP-Session: afe8e3e6-7267-4613-802b-88f6dc497797 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.113585 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 2680, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.113632 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:10.113642 [ 207169 ] {} HTTP-Session: 62333122-095d-4d55-8f03-0da4b9072730 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:10.113654 [ 207169 ] {} HTTP-Session: 62333122-095d-4d55-8f03-0da4b9072730 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.113660 [ 207169 ] {} HTTP-Session: 62333122-095d-4d55-8f03-0da4b9072730 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.113709 [ 207169 ] {} HTTP-Session: 62333122-095d-4d55-8f03-0da4b9072730 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:10.113852 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} executeQuery: (from [::1]:48516) INSERT INTO oximeter.fields_uuid FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:10.113914 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.114208 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} ParallelParsingInputFormat: Parallel parsing is used 2024.09.02 19:50:10.115342 [ 207171 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51138, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.115690 [ 207171 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.09.02 19:50:10.115704 [ 207171 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated PartsService): Sending part all_1_1_0 2024.09.02 19:50:10.116002 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.09.02 19:50:10.116147 [ 207171 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:10.116299 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:10.116316 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.66 GiB. 2024.09.02 19:50:10.118138 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} MergedBlockOutputStream: filled checksums all_1_1_0 (state Temporary) 2024.09.02 19:50:10.118449 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (Replicated OutputStream): Wrote block with ID 'all_11146204176185123901_10197187094774023637', 16 rows 2024.09.02 19:50:10.124207 [ 207257 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.09.02 19:50:10.125645 [ 207257 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:10.138225 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:10.153075 [ 207262 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89475475456, merge_with_ttl_allowedtrue) 2024.09.02 19:50:10.153102 [ 207262 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 9022ms 2024.09.02 19:50:10.153118 [ 207171 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51138, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.153159 [ 207171 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.09.02 19:50:10.153173 [ 207171 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (Replicated PartsService): Sending part all_1_1_0 2024.09.02 19:50:10.153213 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} executeQuery: Read 16 rows, 1.20 KiB in 0.039395 sec., 406.1429115369971 rows/sec., 30.34 KiB/sec. 2024.09.02 19:50:10.153471 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} DynamicQueryHandler: Done processing query 2024.09.02 19:50:10.153490 [ 207169 ] {382c63cc-9fbb-45d7-9698-776f1042e1ab} MemoryTracker: Peak memory usage (for query): 4.28 MiB. 2024.09.02 19:50:10.153502 [ 207169 ] {} HTTP-Session: 62333122-095d-4d55-8f03-0da4b9072730 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.154520 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 74687, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.155048 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:10.155064 [ 207169 ] {} HTTP-Session: d9b61600-5130-40ea-a287-c9e5a3730767 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:10.155083 [ 207169 ] {} HTTP-Session: d9b61600-5130-40ea-a287-c9e5a3730767 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.155089 [ 207169 ] {} HTTP-Session: d9b61600-5130-40ea-a287-c9e5a3730767 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.155159 [ 207169 ] {} HTTP-Session: d9b61600-5130-40ea-a287-c9e5a3730767 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:10.155702 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} executeQuery: (from [::1]:48516) INSERT INTO oximeter.measurements_cumulativef64 FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:10.155754 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.09.02 19:50:10.155923 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} ParallelParsingInputFormat: Parallel parsing is used 2024.09.02 19:50:10.156191 [ 207171 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:10.156648 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local 2024.09.02 19:50:10.157007 [ 207259 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.09.02 19:50:10.157745 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:10.157765 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 166.66 GiB. 2024.09.02 19:50:10.158182 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} MergedBlockOutputStream: filled checksums all_1_1_0 (state Temporary) 2024.09.02 19:50:10.159848 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Replicated OutputStream): Wrote block with ID 'all_16256902636966177828_17920077771813326203', 400 rows 2024.09.02 19:50:10.169703 [ 207259 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.09.02 19:50:10.169740 [ 207259 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:10.174332 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:10.187461 [ 207247 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89475231744, merge_with_ttl_allowedtrue) 2024.09.02 19:50:10.187496 [ 207247 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 10133ms 2024.09.02 19:50:10.187582 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} executeQuery: Read 400 rows, 25.78 KiB in 0.032252 sec., 12402.331638348009 rows/sec., 799.37 KiB/sec. 2024.09.02 19:50:10.188281 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} DynamicQueryHandler: Done processing query 2024.09.02 19:50:10.188296 [ 207169 ] {ce1b71b2-0961-47d9-911d-6341db5a8166} MemoryTracker: Peak memory usage (for query): 4.46 MiB. 2024.09.02 19:50:10.188304 [ 207169 ] {} HTTP-Session: d9b61600-5130-40ea-a287-c9e5a3730767 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.190146 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.191245 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:10.191262 [ 207169 ] {} HTTP-Session: 02943758-e317-4dc1-8a28-0806f14395e5 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:10.191278 [ 207169 ] {} HTTP-Session: 02943758-e317-4dc1-8a28-0806f14395e5 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.191285 [ 207169 ] {} HTTP-Session: 02943758-e317-4dc1-8a28-0806f14395e5 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.191331 [ 207169 ] {} HTTP-Session: 02943758-e317-4dc1-8a28-0806f14395e5 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:10.191782 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} executeQuery: (from [::1]:48516) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:10.191909 [ 207288 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.09.02 19:50:10.193672 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.193937 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.194196 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.195557 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.196081 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.197121 [ 207171 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51138, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.197161 [ 207171 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.09.02 19:50:10.197167 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089c518) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:10.197174 [ 207171 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Replicated PartsService): Sending part all_1_1_0 2024.09.02 19:50:10.197192 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089c518) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:10.197427 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089c518) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.09.02 19:50:10.197700 [ 207171 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:10.197862 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.198483 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.198557 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089e098) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:10.198565 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089e098) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:10.198977 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.199141 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.199320 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:10.199506 [ 207288 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.09.02 19:50:10.199550 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:10.199555 [ 207288 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:10.199793 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.09.02 19:50:10.199843 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.199876 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:10.199923 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089ca18) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0) 2024.09.02 19:50:10.199930 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089ca18) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)] 2024.09.02 19:50:10.200316 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.201934 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.202157 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.09.02 19:50:10.202408 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:10.202425 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:10.202636 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.09.02 19:50:10.204152 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.204198 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:10.204282 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089d198) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.09.02 19:50:10.204292 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089d198) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.09.02 19:50:10.204392 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089e098) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.09.02 19:50:10.204735 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.205006 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:10.205234 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:10.206713 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:10.206890 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.09.02 19:50:10.206940 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.206979 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:10.206987 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.207006 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.09.02 19:50:10.207030 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.207071 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.207092 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.207110 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.207599 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:10.207713 [ 207426 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:10.207725 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.09.02 19:50:10.207747 [ 207426 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.207773 [ 207426 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:10.207784 [ 207426 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.207751 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.207829 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:10.207840 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.207965 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.09.02 19:50:10.207973 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:10.208060 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.09.02 19:50:10.208070 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (SelectExecutor): Reading approx. 16 rows with 2 streams 2024.09.02 19:50:10.208103 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.208142 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.208237 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:10.208339 [ 207429 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.09.02 19:50:10.208348 [ 207428 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:10.208365 [ 207429 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.208368 [ 207428 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.208373 [ 207429 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.09.02 19:50:10.208376 [ 207428 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.09.02 19:50:10.208381 [ 207429 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.208384 [ 207428 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.208469 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.09.02 19:50:10.208478 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:10.208574 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.09.02 19:50:10.208590 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Reading approx. 32 rows with 2 streams 2024.09.02 19:50:10.208647 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.208706 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.208784 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.09.02 19:50:10.208804 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.208909 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:10.208986 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.09.02 19:50:10.208987 [ 207427 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.09.02 19:50:10.209010 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.209018 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:10.209030 [ 207420 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.209039 [ 207427 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.09.02 19:50:10.209046 [ 207427 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.09.02 19:50:10.209052 [ 207427 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Found continuous range in 2 steps 2024.09.02 19:50:10.209118 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.09.02 19:50:10.209132 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.09.02 19:50:10.209249 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.09.02 19:50:10.209264 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (SelectExecutor): Reading approx. 32 rows with 2 streams 2024.09.02 19:50:10.209332 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.209417 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.209481 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.209496 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.09.02 19:50:10.211020 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} executeQuery: Read 80 rows, 5.78 KiB in 0.019526 sec., 4097.101300829662 rows/sec., 296.08 KiB/sec. 2024.09.02 19:50:10.211200 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089ca18) Join data is being destroyed, 12800 bytes and 16 rows in hash table 2024.09.02 19:50:10.211275 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} HashJoin: (0x7efc1089d198) Join data is being destroyed, 13312 bytes and 16 rows in hash table 2024.09.02 19:50:10.211627 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} DynamicQueryHandler: Done processing query 2024.09.02 19:50:10.211642 [ 207169 ] {3449ccb3-78cf-44d7-8168-c58b5b2e51e8} MemoryTracker: Peak memory usage (for query): 5.25 MiB. 2024.09.02 19:50:10.211648 [ 207169 ] {} HTTP-Session: 02943758-e317-4dc1-8a28-0806f14395e5 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.212968 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 577, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.213853 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:10.213864 [ 207169 ] {} HTTP-Session: 6b6296e9-06c0-46ac-b450-f80a468fcc91 Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:10.213877 [ 207169 ] {} HTTP-Session: 6b6296e9-06c0-46ac-b450-f80a468fcc91 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.213883 [ 207169 ] {} HTTP-Session: 6b6296e9-06c0-46ac-b450-f80a468fcc91 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.213929 [ 207169 ] {} HTTP-Session: 6b6296e9-06c0-46ac-b450-f80a468fcc91 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:10.214203 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} executeQuery: (from [::1]:48516) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (163777662738179873,3255198277614561830,4174330440898734823,5073661756869813506,6060338002058112069,6258172585252991913,7444263327486421469,10232564214925740701,10613593354210677318,10652587399320292971,10860360997898340759,12041534140654173142,14895190478290584883,14922767736603850140,15077062082775085482,16549134671421491687)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:10.214679 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.09.02 19:50:10.216644 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.09.02 19:50:10.216908 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.09.02 19:50:10.216938 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 6258172585252991913, 7444263327486421469, 10232564214925740701, 10613593354210677318, 10652587399320292971, 10860360997898340759, 12041534140654173142, 14895190478290584883, 14922767736603850140, 15077062082775085482, 16549134671421491687)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.09.02 19:50:10.217198 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local 2024.09.02 19:50:10.217258 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} InterpreterSelectQuery: FetchColumns -> Complete 2024.09.02 19:50:10.217346 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} InterpreterSelectQuery: Complete -> Complete 2024.09.02 19:50:10.217571 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Key condition: (column 1 in 16-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.09.02 19:50:10.219288 [ 207429 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Used generic exclusion search over index for part all_1_1_0 with 1 steps 2024.09.02 19:50:10.219286 [ 207426 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps 2024.09.02 19:50:10.219742 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.09.02 19:50:10.220609 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (SelectExecutor): Spreading ranges among streams with order 2024.09.02 19:50:10.220711 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 6258172585252991913, 7444263327486421469, 10232564214925740701, 10613593354210677318, 10652587399320292971, 10860360997898340759, 12041534140654173142, 14895190478290584883, 14922767736603850140, 15077062082775085482, 16549134671421491687))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.220725 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_1_1_0, approx. 400 rows starting from 0 2024.09.02 19:50:10.220799 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (163777662738179873, 3255198277614561830, 4174330440898734823, 5073661756869813506, 6060338002058112069, 6258172585252991913, 7444263327486421469, 10232564214925740701, 10613593354210677318, 10652587399320292971, 10860360997898340759, 12041534140654173142, 14895190478290584883, 14922767736603850140, 15077062082775085482, 16549134671421491687))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.09.02 19:50:10.220814 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 2024.09.02 19:50:10.221820 [ 207442 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} MergingSortedTransform: Merge sorted 1 blocks, 800 rows in 0.004000063 sec., 199996.85004961173 rows/sec., 8.06 MiB/sec 2024.09.02 19:50:10.223591 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} executeQuery: Read 800 rows, 51.56 KiB in 0.009536 sec., 83892.61744966444 rows/sec., 5.28 MiB/sec. 2024.09.02 19:50:10.226308 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} DynamicQueryHandler: Done processing query 2024.09.02 19:50:10.226332 [ 207169 ] {efc5c31c-6990-4cb6-9402-ba161888c74a} MemoryTracker: Peak memory usage (for query): 4.17 MiB. 2024.09.02 19:50:10.226342 [ 207169 ] {} HTTP-Session: 6b6296e9-06c0-46ac-b450-f80a468fcc91 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:10.717375 [ 207714 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51140, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:10.717449 [ 207714 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.09.02 19:50:10.717462 [ 207714 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (Replicated PartsService): Sending part all_1_1_0 2024.09.02 19:50:10.717918 [ 207714 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:10.785332 [ 207418 ] {} ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, unsigned long&, String&&) @ 0x0000000007354cb4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x0000000007354bb7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001384c492 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. ? @ 0x00007efcbab46ac3 in ? 6. ? @ 0x00007efcbabd8850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:10.785372 [ 207418 ] {} ZooKeeperClient: Finalizing session 6. finalization_started: false, queue_finished: false, reason: 'Exception in receiveThread' 2024.09.02 19:50:10.785443 [ 207418 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:10.785468 [ 207418 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:10.785481 [ 207418 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:10.785491 [ 207418 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:10.785503 [ 207418 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:10.785530 [ 207290 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:10.785548 [ 207295 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:10.785610 [ 207290 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/3/is_active since session has been expired 2024.09.02 19:50:10.785617 [ 207295 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/is_active since session has been expired 2024.09.02 19:50:10.785621 [ 207290 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Waiting for threads to finish 2024.09.02 19:50:10.785629 [ 207295 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Waiting for threads to finish 2024.09.02 19:50:10.785598 [ 207287 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:10.785665 [ 207287 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/3/is_active since session has been expired 2024.09.02 19:50:10.785669 [ 207287 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Waiting for threads to finish 2024.09.02 19:50:10.785611 [ 207302 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:10.785685 [ 207302 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/3/is_active since session has been expired 2024.09.02 19:50:10.785689 [ 207302 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Waiting for threads to finish 2024.09.02 19:50:10.785655 [ 207297 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:10.785704 [ 207297 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/3/is_active since session has been expired 2024.09.02 19:50:10.785710 [ 207297 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Waiting for threads to finish 2024.09.02 19:50:10.785818 [ 207290 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Threads finished 2024.09.02 19:50:10.785829 [ 207290 ] {} Context: Trying to establish a new connection with ZooKeeper 2024.09.02 19:50:10.785864 [ 207295 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Threads finished 2024.09.02 19:50:10.785883 [ 207287 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Threads finished 2024.09.02 19:50:10.785966 [ 207302 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Threads finished 2024.09.02 19:50:10.785986 [ 207297 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Threads finished 2024.09.02 19:50:10.787485 [ 207418 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. Poco::Net::SocketImpl::error(int, String const&) @ 0x0000000015b5abb2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. Poco::Net::SocketImpl::shutdown() @ 0x0000000015b5c39c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001383d143 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001384e087 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. ? @ 0x00007efcbab46ac3 in ? 6. ? @ 0x00007efcbabd8850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:10.789045 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:10.789344 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:10.792309 [ 207290 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19003 with session_id 8 2024.09.02 19:50:10.792780 [ 207290 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.09.02 19:50:10.793828 [ 207290 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.09.02 19:50:10.793650 [ 207410 ] {} DDLWorker: Lost ZooKeeper connection, will try to connect again: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000c63f980 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000013817dd3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000138452ec in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x00000000138481b1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f728e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f6d96 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x00000000137f7a7b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x00000000137f75ff in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::DDLWorker::scheduleTasks(bool) @ 0x00000000116ee6b7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::DDLWorker::runMainThread() @ 0x00000000116e75be in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. ? @ 0x00007efcbab46ac3 in ? 14. ? @ 0x00007efcbabd8850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:10.793837 [ 207290 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.09.02 19:50:10.793862 [ 207290 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003 2024.09.02 19:50:10.793871 [ 207290 ] {} Context: Establishing a new connection with ZooKeeper took 8 ms 2024.09.02 19:50:10.793881 [ 207290 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:10.793920 [ 207295 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:10.793939 [ 207287 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:10.793946 [ 207302 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:10.793972 [ 207297 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:10.838549 [ 207290 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:10.838547 [ 207297 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:10.838581 [ 207295 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:10.838598 [ 207302 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:10.838775 [ 207287 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:10.838859 [ 207297 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:10.838870 [ 207297 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/3/queue 2024.09.02 19:50:10.838890 [ 207290 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:10.838899 [ 207290 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/3/queue 2024.09.02 19:50:10.838925 [ 207295 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:10.838932 [ 207295 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/queue 2024.09.02 19:50:10.839027 [ 207287 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:10.839040 [ 207287 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/3/queue 2024.09.02 19:50:10.839060 [ 207302 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:10.839069 [ 207302 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/3/queue 2024.09.02 19:50:10.839198 [ 207290 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:10.839242 [ 207295 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:10.839278 [ 207287 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:10.839354 [ 207302 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:10.839372 [ 207290 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:10.839477 [ 207287 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:10.839480 [ 207295 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:10.839524 [ 207302 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:10.839788 [ 207297 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:10.841208 [ 207294 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 2493ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:10.840483 [ 207290 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:10.840541 [ 207287 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:10.840549 [ 207201 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 7970ms 2024.09.02 19:50:10.840683 [ 207329 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768753152, merge_with_ttl_allowedtrue) 2024.09.02 19:50:10.841001 [ 207295 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:10.841373 [ 207329 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 12211ms 2024.09.02 19:50:10.841145 [ 207305 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768753152, merge_with_ttl_allowedtrue) 2024.09.02 19:50:10.841399 [ 207305 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 13090ms 2024.09.02 19:50:10.841469 [ 207297 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:10.841677 [ 207284 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks 2024.09.02 19:50:10.841696 [ 207338 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks 2024.09.02 19:50:10.842090 [ 207284 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 2039ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:10.842107 [ 207338 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 2343ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:10.843095 [ 207301 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1381ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:10.843244 [ 207197 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks 2024.09.02 19:50:10.842413 [ 207302 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:10.842532 [ 207312 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768751104, merge_with_ttl_allowedtrue) 2024.09.02 19:50:10.842723 [ 207297 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:10.843316 [ 207312 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 9206ms 2024.09.02 19:50:10.842807 [ 207317 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89768751104, merge_with_ttl_allowedtrue) 2024.09.02 19:50:10.843343 [ 207317 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 10931ms 2024.09.02 19:50:10.843560 [ 207197 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1694ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:11.001676 [ 207413 ] {} AsynchronousMetrics: MemoryTracking: was 379.19 MiB, peak 385.63 MiB, free memory in arenas 37.35 MiB, will set to 381.68 MiB (RSS), difference: 2.48 MiB 2024.09.02 19:50:11.286241 [ 207169 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:48516, User-Agent: (none), Length: 1029, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:11.286299 [ 207169 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.09.02 19:50:11.286310 [ 207169 ] {} HTTP-Session: a827409a-fcc3-4591-a83b-a52a22ecf54b Authenticating user 'default' from [::1]:48516 2024.09.02 19:50:11.286322 [ 207169 ] {} HTTP-Session: a827409a-fcc3-4591-a83b-a52a22ecf54b Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:11.286326 [ 207169 ] {} HTTP-Session: a827409a-fcc3-4591-a83b-a52a22ecf54b Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:11.286359 [ 207169 ] {} HTTP-Session: a827409a-fcc3-4591-a83b-a52a22ecf54b Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.09.02 19:50:11.286516 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} executeQuery: (from [::1]:48516) INSERT INTO oximeter.fields_i64 FORMAT JSONEachRow (stage: Complete) 2024.09.02 19:50:11.286559 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.09.02 19:50:11.286823 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} ParallelParsingInputFormat: Parallel parsing is used 2024.09.02 19:50:11.287224 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.09.02 19:50:11.289216 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.09.02 19:50:11.289249 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 167.21 GiB. 2024.09.02 19:50:11.289684 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} MergedBlockOutputStream: filled checksums all_2_2_0 (state Temporary) 2024.09.02 19:50:11.289949 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): Wrote block with ID 'all_17738245886449976341_16902175339814383691', 8 rows 2024.09.02 19:50:11.294549 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Renaming temporary part tmp_insert_all_2_2_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.09.02 19:50:11.793937 [ 207410 ] {} DDLWorker: Initializing DDLWorker thread 2024.09.02 19:50:12.003489 [ 207413 ] {} AsynchronousMetrics: MemoryTracking: was 386.96 MiB, peak 386.96 MiB, free memory in arenas 34.68 MiB, will set to 381.93 MiB (RSS), difference: -5.03 MiB 2024.09.02 19:50:12.066346 [ 207415 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml' 2024.09.02 19:50:12.066570 [ 207411 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml' 2024.09.02 19:50:12.066859 [ 207415 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration 2024.09.02 19:50:12.067202 [ 207415 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration 2024.09.02 19:50:12.067989 [ 207411 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration 2024.09.02 19:50:12.068515 [ 207411 ] {} Application: Setting max_server_memory_usage was set to 27.61 GiB (30.68 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.09.02 19:50:12.070267 [ 207411 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.34 GiB (30.68 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.09.02 19:50:12.070277 [ 207411 ] {} Application: Merges and mutations memory limit is set to 15.34 GiB 2024.09.02 19:50:12.070543 [ 207411 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor 2024.09.02 19:50:12.070552 [ 207411 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor 2024.09.02 19:50:12.070557 [ 207411 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor 2024.09.02 19:50:12.070561 [ 207411 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor 2024.09.02 19:50:12.070585 [ 207411 ] {} ZooKeeperClient: Finalizing session 8. finalization_started: false, queue_finished: false, reason: 'Config changed' 2024.09.02 19:50:12.070648 [ 207411 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:12.070670 [ 207411 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:12.070688 [ 207411 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:12.070704 [ 207202 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:12.070725 [ 207411 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:12.070726 [ 207202 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/3/is_active since session has been expired 2024.09.02 19:50:12.070739 [ 207202 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Waiting for threads to finish 2024.09.02 19:50:12.070746 [ 207411 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.09.02 19:50:12.070786 [ 207214 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:12.070845 [ 207214 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/is_active since session has been expired 2024.09.02 19:50:12.070859 [ 207214 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Waiting for threads to finish 2024.09.02 19:50:12.070801 [ 207220 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:12.070831 [ 207208 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:12.070889 [ 207220 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/3/is_active since session has been expired 2024.09.02 19:50:12.070896 [ 207220 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Waiting for threads to finish 2024.09.02 19:50:12.070874 [ 207226 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.09.02 19:50:12.070897 [ 207208 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/3/is_active since session has been expired 2024.09.02 19:50:12.070909 [ 207226 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/3/is_active since session has been expired 2024.09.02 19:50:12.070911 [ 207208 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Waiting for threads to finish 2024.09.02 19:50:12.070913 [ 207226 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Waiting for threads to finish 2024.09.02 19:50:12.071036 [ 207202 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Threads finished 2024.09.02 19:50:12.071066 [ 207220 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Threads finished 2024.09.02 19:50:12.071107 [ 207214 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Threads finished 2024.09.02 19:50:12.071125 [ 207208 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Threads finished 2024.09.02 19:50:12.071184 [ 207226 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Threads finished 2024.09.02 19:50:12.079302 [ 207410 ] {} virtual bool DB::DDLWorker::initializeMainThread(): Code: 999. Coordination::Exception: Coordination error: Connection loss, path /clickhouse/task_queue/ddl/. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, char const*&&, String const&) @ 0x0000000010ba7474 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. Coordination::Exception::fromPath(Coordination::Error, String const&) @ 0x0000000010ba6c48 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. zkutil::ZooKeeper::createAncestors(String const&) @ 0x00000000137f8935 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. DB::DDLWorker::initializeMainThread() @ 0x00000000116fc925 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. DB::DDLWorker::runMainThread() @ 0x00000000116e7280 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000116fd92c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x000000000c7298c4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. ? @ 0x00007efcbab46ac3 in ? 9. ? @ 0x00007efcbabd8850 in ? (version 23.8.7.24 (official build)) 2024.09.02 19:50:12.081271 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: setUserError: error=319 message=Unknown status, client must retry. Reason: Connection loss 2024.09.02 19:50:12.081495 [ 207411 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19001 with session_id 10 2024.09.02 19:50:12.082718 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} EphemeralLockInZooKeeper: ZooKeeper communication error during unlock: code=Session expired message='Session expired' 2024.09.02 19:50:12.082730 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: will retry due to error: retry_count=1 timeout=100ms error=319 message=Unknown status, client must retry. Reason: Connection loss 2024.09.02 19:50:12.082757 [ 207411 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.09.02 19:50:12.082762 [ 207411 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.09.02 19:50:12.082765 [ 207411 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.09.02 19:50:12.082770 [ 207411 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19003 2024.09.02 19:50:12.082810 [ 207202 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:12.082821 [ 207220 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:12.082836 [ 207214 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:12.082858 [ 207411 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.09.02 19:50:12.082869 [ 207411 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.09.02 19:50:12.082889 [ 207208 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:12.082923 [ 207226 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.09.02 19:50:12.083024 [ 207411 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.09.02 19:50:12.083039 [ 207411 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-62a6f93586c06e24-test_cluster.205201.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration 2024.09.02 19:50:12.111836 [ 207202 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:12.111914 [ 207214 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:12.111923 [ 207220 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:12.111920 [ 207226 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:12.111996 [ 207208 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.09.02 19:50:12.112085 [ 207220 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:12.112096 [ 207226 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:12.112104 [ 207220 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/3/queue 2024.09.02 19:50:12.112111 [ 207226 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/3/queue 2024.09.02 19:50:12.112097 [ 207208 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:12.112096 [ 207202 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:12.112147 [ 207202 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/3/queue 2024.09.02 19:50:12.112089 [ 207214 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.09.02 19:50:12.112136 [ 207208 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/3/queue 2024.09.02 19:50:12.112169 [ 207214 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/queue 2024.09.02 19:50:12.112254 [ 207220 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:12.112262 [ 207226 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:12.112285 [ 207202 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:12.112287 [ 207208 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:12.112377 [ 207214 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.09.02 19:50:12.112404 [ 207220 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:12.112493 [ 207226 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:12.112525 [ 207214 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:12.112532 [ 207208 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:12.112532 [ 207202 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.09.02 19:50:12.113349 [ 207220 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:12.113445 [ 207226 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:12.113497 [ 207229 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89767964672, merge_with_ttl_allowedtrue) 2024.09.02 19:50:12.113566 [ 207225 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89767964672, merge_with_ttl_allowedtrue) 2024.09.02 19:50:12.113629 [ 207229 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 15430ms 2024.09.02 19:50:12.113635 [ 207225 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 13532ms 2024.09.02 19:50:12.114094 [ 207230 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1272ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:12.114214 [ 207209 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1271ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:12.114569 [ 207214 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:12.114600 [ 207258 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89767958528, merge_with_ttl_allowedtrue) 2024.09.02 19:50:12.114635 [ 207202 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:12.116438 [ 207258 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 15918ms 2024.09.02 19:50:12.114743 [ 207219 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 10127ms 2024.09.02 19:50:12.114844 [ 207208 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.09.02 19:50:12.114941 [ 207215 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89767958528, merge_with_ttl_allowedtrue) 2024.09.02 19:50:12.115402 [ 207233 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1273ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:12.115424 [ 207252 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1272ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:12.115426 [ 207246 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 1274ms, ratio: 0, points per minute: 0) 2024.09.02 19:50:12.116507 [ 207215 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 11898ms 2024.09.02 19:50:12.183132 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: setUserError: error=244 message=Insert failed due to zookeeper error. Please retry. Reason: Connection loss 2024.09.02 19:50:12.183157 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: stop retries on request: retry_count=1 timeout=200ms error=244 message=Insert failed due to zookeeper error. Please retry. Reason: Connection loss 2024.09.02 19:50:12.183171 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} oximeter.fields_i64_local (ReplicatedMergeTreePartCheckThread): Enqueueing all_2_2_0 for check after after 300s 2024.09.02 19:50:12.192480 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} executeQuery: Code: 244. DB::Exception: Insert failed due to zookeeper error. Please retry. Reason: Connection loss. (UNEXPECTED_ZOOKEEPER_ERROR) (version 23.8.7.24 (official build)) (from [::1]:48516) (in query: INSERT INTO oximeter.fields_i64 FORMAT JSONEachRow ), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::ZooKeeperRetriesControl::setUserError(int, String) @ 0x0000000012f32ffd in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool)::'lambda'()::operator()() const @ 0x0000000012f3586a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x0000000012f280d8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x0000000012f27270 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x0000000012f249db in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x00000000134dc0a6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000013417e8b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x0000000013417bbc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::ExceptionKeepingTransform::work() @ 0x00000000134172b3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::ExecutionThreadContext::executeTask() @ 0x00000000131bcdfa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000131b3c30 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. DB::PipelineExecutor::executeStep(std::atomic*) @ 0x00000000131b33e8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. DB::DistributedSink::writeToLocal(DB::Cluster::ShardInfo const&, DB::Block const&, unsigned long) @ 0x0000000012b19942 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. DB::DistributedSink::writeAsyncImpl(DB::Block const&, unsigned long) @ 0x0000000012b172b7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. DB::DistributedSink::consume(DB::Chunk) @ 0x0000000012b13c1e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 16. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x00000000134dc0a6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 17. void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000013417e8b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 18. DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x0000000013417bbc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 19. DB::ExceptionKeepingTransform::work() @ 0x00000000134172b3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 20. DB::ExecutionThreadContext::executeTask() @ 0x00000000131bcdfa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 21. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000131b3c30 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 22. DB::PipelineExecutor::execute(unsigned long, bool) @ 0x00000000131b2f62 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 23. DB::CompletedPipelineExecutor::execute() @ 0x00000000131b1812 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 24. DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&) @ 0x00000000122e9e0c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 25. DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x00000000130fd60f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 26. DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000013101ee9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 27. DB::HTTPServerConnection::run() @ 0x0000000013172ad2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 28. Poco::Net::TCPServerConnection::start() @ 0x0000000015b5f7f4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 29. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b609f1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 30. Poco::PooledThread::run() @ 0x0000000015c97227 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 31. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c954fc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2024.09.02 19:50:12.194265 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} DynamicQueryHandler: Code: 244. DB::Exception: Insert failed due to zookeeper error. Please retry. Reason: Connection loss. (UNEXPECTED_ZOOKEEPER_ERROR), Stack trace (when copying this message, always include the lines below): 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c6487f7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::ZooKeeperRetriesControl::setUserError(int, String) @ 0x0000000012f32ffd in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool)::'lambda'()::operator()() const @ 0x0000000012f3586a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, String const&, unsigned long, bool) @ 0x0000000012f280d8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x0000000012f27270 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x0000000012f249db in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x00000000134dc0a6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000013417e8b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x0000000013417bbc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. DB::ExceptionKeepingTransform::work() @ 0x00000000134172b3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::ExecutionThreadContext::executeTask() @ 0x00000000131bcdfa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000131b3c30 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. DB::PipelineExecutor::executeStep(std::atomic*) @ 0x00000000131b33e8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. DB::DistributedSink::writeToLocal(DB::Cluster::ShardInfo const&, DB::Block const&, unsigned long) @ 0x0000000012b19942 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. DB::DistributedSink::writeAsyncImpl(DB::Block const&, unsigned long) @ 0x0000000012b172b7 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. DB::DistributedSink::consume(DB::Chunk) @ 0x0000000012b13c1e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 16. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x00000000134dc0a6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 17. void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x0000000013417e8b in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 18. DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x0000000013417bbc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 19. DB::ExceptionKeepingTransform::work() @ 0x00000000134172b3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 20. DB::ExecutionThreadContext::executeTask() @ 0x00000000131bcdfa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 21. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000131b3c30 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 22. DB::PipelineExecutor::execute(unsigned long, bool) @ 0x00000000131b2f62 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 23. DB::CompletedPipelineExecutor::execute() @ 0x00000000131b1812 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 24. DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&) @ 0x00000000122e9e0c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 25. DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x00000000130fd60f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 26. DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x0000000013101ee9 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 27. DB::HTTPServerConnection::run() @ 0x0000000013172ad2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 28. Poco::Net::TCPServerConnection::start() @ 0x0000000015b5f7f4 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 29. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b609f1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 30. Poco::PooledThread::run() @ 0x0000000015c97227 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 31. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c954fc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse (version 23.8.7.24 (official build)) 2024.09.02 19:50:12.194435 [ 207169 ] {0d434a24-4043-4c13-8ec7-e50b877b526f} MemoryTracker: Peak memory usage (for query): 4.27 MiB. 2024.09.02 19:50:12.194446 [ 207169 ] {} HTTP-Session: a827409a-fcc3-4591-a83b-a52a22ecf54b Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.09.02 19:50:12.295784 [ 207270 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000002 - log-0000000002 2024.09.02 19:50:12.310251 [ 207714 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51140, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:12.310316 [ 207714 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_2_2_0&client_protocol_version=8&compress=false 2024.09.02 19:50:12.310331 [ 207714 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated PartsService): Sending part all_2_2_0 2024.09.02 19:50:12.310627 [ 207714 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:12.312947 [ 207270 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_2_2_0] 2024.09.02 19:50:12.312964 [ 207270 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.09.02 19:50:12.321132 [ 207171 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:51138, User-Agent: ClickHouse/23.8.7.24, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.09.02 19:50:12.321182 [ 207171 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_2_2_0&client_protocol_version=8&compress=false 2024.09.02 19:50:12.321192 [ 207171 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (Replicated PartsService): Sending part all_2_2_0 2024.09.02 19:50:12.321524 [ 207171 ] {} InterserverIOHTTPHandler: Done processing query 2024.09.02 19:50:13.000638 [ 207413 ] {} AsynchronousMetrics: MemoryTracking: was 381.66 MiB, peak 391.93 MiB, free memory in arenas 43.39 MiB, will set to 393.06 MiB (RSS), difference: 11.41 MiB 2024.09.02 19:50:17.083422 [ 207410 ] {} DDLWorker: Initialized DDLWorker thread 2024.09.02 19:50:17.083445 [ 207410 ] {} DDLWorker: Scheduling tasks 2024.09.02 19:50:17.083450 [ 207410 ] {} DDLWorker: Have 1 unfinished tasks, will check them 2024.09.02 19:50:17.083452 [ 207412 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.09.02 19:50:17.083587 [ 207410 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000019, last_skipped_entry_name=query-0000000009 2024.09.02 19:50:17.083594 [ 207410 ] {} DDLWorker: No tasks to schedule 2024.09.02 19:50:17.083597 [ 207410 ] {} DDLWorker: Waiting for queue updates 2024.09.02 19:50:18.000448 [ 207413 ] {} AsynchronousMetrics: MemoryTracking: was 389.04 MiB, peak 393.06 MiB, free memory in arenas 42.52 MiB, will set to 393.06 MiB (RSS), difference: 4.02 MiB 2024.09.02 19:50:22.243604 [ 207197 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 13355ms 2024.09.02 19:50:23.023575 [ 207213 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:50:23.023624 [ 207213 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:50:24.014667 [ 207195 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89898590208, merge_with_ttl_allowedtrue) 2024.09.02 19:50:24.014710 [ 207195 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 14854ms 2024.09.02 19:50:25.645825 [ 207218 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89896200192, merge_with_ttl_allowedtrue) 2024.09.02 19:50:25.645856 [ 207218 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 17567ms 2024.09.02 19:50:27.543797 [ 207264 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89893316608, merge_with_ttl_allowedtrue) 2024.09.02 19:50:27.543831 [ 207264 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 18708ms 2024.09.02 19:50:28.034645 [ 207254 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89892661248, merge_with_ttl_allowedtrue) 2024.09.02 19:50:28.034675 [ 207254 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 20169ms 2024.09.02 19:50:35.598800 [ 207238 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 16516ms 2024.09.02 19:50:38.023768 [ 207262 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:50:38.023849 [ 207262 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:50:38.868869 [ 207282 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89876117504, merge_with_ttl_allowedtrue) 2024.09.02 19:50:38.868893 [ 207282 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 17961ms 2024.09.02 19:50:43.213063 [ 207300 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89869373440, merge_with_ttl_allowedtrue) 2024.09.02 19:50:43.213108 [ 207300 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 21452ms 2024.09.02 19:50:46.251964 [ 207294 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89865019392, merge_with_ttl_allowedtrue) 2024.09.02 19:50:46.251998 [ 207294 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 22801ms 2024.09.02 19:50:48.203819 [ 207285 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89862299648, merge_with_ttl_allowedtrue) 2024.09.02 19:50:48.203846 [ 207285 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 25990ms 2024.09.02 19:50:52.114950 [ 207284 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 21413ms 2024.09.02 19:50:53.023946 [ 207317 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:50:53.023973 [ 207317 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:50:55.001222 [ 207413 ] {} AsynchronousMetrics: MemoryTracking: was 392.98 MiB, peak 393.18 MiB, free memory in arenas 23.35 MiB, will set to 388.47 MiB (RSS), difference: -4.50 MiB 2024.09.02 19:50:56.830042 [ 207199 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89848510464, merge_with_ttl_allowedtrue) 2024.09.02 19:50:56.830077 [ 207199 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 21644ms 2024.09.02 19:51:04.665266 [ 207209 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90083278848, merge_with_ttl_allowedtrue) 2024.09.02 19:51:04.665358 [ 207209 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 26132ms 2024.09.02 19:51:08.024086 [ 207253 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:51:08.024138 [ 207253 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:51:09.053180 [ 207244 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89925611520, merge_with_ttl_allowedtrue) 2024.09.02 19:51:09.053227 [ 207244 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 29159ms 2024.09.02 19:51:13.528159 [ 207234 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 26962ms 2024.09.02 19:51:14.194009 [ 207216 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89921095680, merge_with_ttl_allowedtrue) 2024.09.02 19:51:14.194064 [ 207216 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 32467ms 2024.09.02 19:51:18.474208 [ 207238 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89914408960, merge_with_ttl_allowedtrue) 2024.09.02 19:51:18.474234 [ 207238 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 26907ms 2024.09.02 19:51:23.024264 [ 207262 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:51:23.024318 [ 207262 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:51:30.797546 [ 207224 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89914978304, merge_with_ttl_allowedtrue) 2024.09.02 19:51:30.797583 [ 207224 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 31411ms 2024.09.02 19:51:38.024440 [ 207340 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:51:38.024490 [ 207340 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:51:38.212373 [ 207295 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90083112960, merge_with_ttl_allowedtrue) 2024.09.02 19:51:38.212438 [ 207295 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 36957ms 2024.09.02 19:51:40.490349 [ 207329 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 35483ms 2024.09.02 19:51:45.381378 [ 207192 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89924368384, merge_with_ttl_allowedtrue) 2024.09.02 19:51:45.381412 [ 207192 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 33126ms 2024.09.02 19:51:46.661223 [ 207309 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89922629632, merge_with_ttl_allowedtrue) 2024.09.02 19:51:46.661265 [ 207309 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 40258ms 2024.09.02 19:51:53.024606 [ 207193 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:51:53.024658 [ 207193 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:52:02.208737 [ 207228 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89898944512, merge_with_ttl_allowedtrue) 2024.09.02 19:52:02.208782 [ 207228 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 39945ms 2024.09.02 19:52:08.024758 [ 207261 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:52:08.024805 [ 207261 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:52:09.001410 [ 207413 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000159049 sec. 2024.09.02 19:52:15.169605 [ 207233 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89878769664, merge_with_ttl_allowedtrue) 2024.09.02 19:52:15.169671 [ 207233 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 45497ms 2024.09.02 19:52:15.973499 [ 207246 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 42923ms 2024.09.02 19:52:18.507541 [ 207216 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89873848320, merge_with_ttl_allowedtrue) 2024.09.02 19:52:18.507558 [ 207216 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 40082ms 2024.09.02 19:52:23.024898 [ 207289 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:52:23.024929 [ 207289 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:52:26.919399 [ 207238 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89860218880, merge_with_ttl_allowedtrue) 2024.09.02 19:52:26.919419 [ 207238 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 51346ms 2024.09.02 19:52:38.025037 [ 207268 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:52:38.025079 [ 207268 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:52:42.153917 [ 207300 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89837326336, merge_with_ttl_allowedtrue) 2024.09.02 19:52:42.154796 [ 207300 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 51248ms 2024.09.02 19:52:53.025188 [ 207305 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:52:53.025259 [ 207305 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:52:58.589698 [ 207192 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89812908032, merge_with_ttl_allowedtrue) 2024.09.02 19:52:58.589722 [ 207192 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 52014ms 2024.09.02 19:52:58.896633 [ 207309 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 54703ms 2024.09.02 19:53:00.666836 [ 207338 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89810038784, merge_with_ttl_allowedtrue) 2024.09.02 19:53:00.666877 [ 207338 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 58302ms 2024.09.02 19:53:08.025323 [ 207199 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:53:08.025356 [ 207199 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:53:18.265601 [ 207256 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89782964224, merge_with_ttl_allowedtrue) 2024.09.02 19:53:18.265641 [ 207256 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 19:53:23.025468 [ 207249 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:53:23.025506 [ 207249 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:53:33.402933 [ 207252 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89759256576, merge_with_ttl_allowedtrue) 2024.09.02 19:53:33.402981 [ 207252 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 19:53:38.025623 [ 207183 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:53:38.025658 [ 207183 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:53:50.603936 [ 207194 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89732331520, merge_with_ttl_allowedtrue) 2024.09.02 19:53:50.603987 [ 207194 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 19:53:53.025761 [ 207279 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:53:53.025801 [ 207279 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:53:53.599757 [ 207257 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 19:53:58.969051 [ 207266 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89720295424, merge_with_ttl_allowedtrue) 2024.09.02 19:53:58.969083 [ 207266 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 19:54:08.025914 [ 207348 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:54:08.025959 [ 207348 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:54:09.001780 [ 207413 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00016278 sec. 2024.09.02 19:54:18.265764 [ 207285 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89688625152, merge_with_ttl_allowedtrue) 2024.09.02 19:54:18.265785 [ 207285 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 19:54:23.026051 [ 207284 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:54:23.026087 [ 207284 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:54:33.403125 [ 207193 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89665771520, merge_with_ttl_allowedtrue) 2024.09.02 19:54:33.404930 [ 207193 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 19:54:38.026177 [ 207221 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:54:38.027941 [ 207221 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:54:50.604111 [ 207240 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89638924288, merge_with_ttl_allowedtrue) 2024.09.02 19:54:50.604143 [ 207240 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 19:54:53.028061 [ 207248 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:54:53.028107 [ 207248 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:54:53.599907 [ 207253 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 19:54:58.969209 [ 207258 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89624489984, merge_with_ttl_allowedtrue) 2024.09.02 19:54:58.969229 [ 207258 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 19:55:08.000713 [ 207413 ] {} AsynchronousMetrics: Scanning /sys/block 2024.09.02 19:55:08.028221 [ 207234 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:55:08.028255 [ 207234 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:55:15.280696 [ 207275 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks 2024.09.02 19:55:15.280912 [ 207275 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 303162ms, ratio: 0, points per minute: 0) 2024.09.02 19:55:17.498912 [ 207257 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 305379ms, ratio: 0, points per minute: 0) 2024.09.02 19:55:18.265954 [ 207222 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89595555840, merge_with_ttl_allowedtrue) 2024.09.02 19:55:18.265983 [ 207222 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 19:55:18.341115 [ 207262 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 306221ms, ratio: 0, points per minute: 0) 2024.09.02 19:55:19.583150 [ 207282 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307463ms, ratio: 0, points per minute: 0) 2024.09.02 19:55:22.088984 [ 207259 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309968ms, ratio: 0, points per minute: 0) 2024.09.02 19:55:23.028364 [ 207267 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:55:23.028405 [ 207267 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:55:33.405136 [ 207298 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89571942400, merge_with_ttl_allowedtrue) 2024.09.02 19:55:33.405191 [ 207298 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 19:55:38.028511 [ 207201 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:55:38.028546 [ 207201 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:55:50.604271 [ 207192 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89540505600, merge_with_ttl_allowedtrue) 2024.09.02 19:55:50.605914 [ 207192 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 19:55:53.028644 [ 207302 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:55:53.028684 [ 207302 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:55:53.600054 [ 207301 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 19:55:58.969434 [ 207213 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89526777856, merge_with_ttl_allowedtrue) 2024.09.02 19:55:58.969477 [ 207213 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 19:56:08.028799 [ 207232 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:56:08.028844 [ 207232 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:56:09.001272 [ 207413 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00015462 sec. 2024.09.02 19:56:18.266116 [ 207248 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89497602048, merge_with_ttl_allowedtrue) 2024.09.02 19:56:18.266177 [ 207248 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 19:56:23.028950 [ 207219 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:56:23.028980 [ 207219 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:56:30.001307 [ 207413 ] {} AsynchronousMetrics: MemoryTracking: was 388.53 MiB, peak 393.18 MiB, free memory in arenas 9.97 MiB, will set to 383.30 MiB (RSS), difference: -5.23 MiB 2024.09.02 19:56:33.405367 [ 207183 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=89473185792, merge_with_ttl_allowedtrue) 2024.09.02 19:56:33.405394 [ 207183 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 19:56:38.029104 [ 207263 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:56:38.029199 [ 207263 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:56:50.606097 [ 207279 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081759232, merge_with_ttl_allowedtrue) 2024.09.02 19:56:50.606150 [ 207279 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 19:56:53.029337 [ 207247 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:56:53.029399 [ 207247 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:56:53.600216 [ 207266 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 19:56:58.969669 [ 207268 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081716224, merge_with_ttl_allowedtrue) 2024.09.02 19:56:58.969719 [ 207268 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 19:57:08.029522 [ 207348 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:57:08.029574 [ 207348 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:57:18.266384 [ 207342 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081630208, merge_with_ttl_allowedtrue) 2024.09.02 19:57:18.266434 [ 207342 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 19:57:23.029679 [ 207297 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:57:23.029730 [ 207297 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:57:33.405573 [ 207198 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081556480, merge_with_ttl_allowedtrue) 2024.09.02 19:57:33.405625 [ 207198 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 19:57:38.029832 [ 207232 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:57:38.029864 [ 207232 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:57:50.606297 [ 207241 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081488896, merge_with_ttl_allowedtrue) 2024.09.02 19:57:50.606341 [ 207241 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 19:57:53.029996 [ 207249 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:57:53.030043 [ 207249 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:57:53.600407 [ 207261 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 19:57:58.969908 [ 207196 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081452032, merge_with_ttl_allowedtrue) 2024.09.02 19:57:58.969965 [ 207196 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 19:58:08.030192 [ 207250 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:58:08.030251 [ 207250 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:58:09.000996 [ 207413 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00015178 sec. 2024.09.02 19:58:18.266641 [ 207274 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081363968, merge_with_ttl_allowedtrue) 2024.09.02 19:58:18.266702 [ 207274 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 19:58:23.030352 [ 207257 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:58:23.030391 [ 207257 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:58:33.405789 [ 207268 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081288192, merge_with_ttl_allowedtrue) 2024.09.02 19:58:33.405833 [ 207268 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 19:58:38.030486 [ 207300 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:58:38.030787 [ 207300 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:58:50.606503 [ 207295 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081220608, merge_with_ttl_allowedtrue) 2024.09.02 19:58:50.606543 [ 207295 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 19:58:53.030899 [ 207342 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:58:53.030950 [ 207342 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:58:53.600640 [ 207211 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 19:58:58.970155 [ 207308 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081181696, merge_with_ttl_allowedtrue) 2024.09.02 19:58:58.970205 [ 207308 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 19:59:08.031049 [ 207193 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:59:08.031120 [ 207193 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:59:18.266889 [ 207227 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081093632, merge_with_ttl_allowedtrue) 2024.09.02 19:59:18.266945 [ 207227 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 19:59:23.031243 [ 207256 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:59:23.031310 [ 207256 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:59:33.405997 [ 207196 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90081019904, merge_with_ttl_allowedtrue) 2024.09.02 19:59:33.406040 [ 207196 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 19:59:38.031433 [ 207270 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:59:38.031514 [ 207270 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:59:50.606701 [ 207291 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080952320, merge_with_ttl_allowedtrue) 2024.09.02 19:59:50.606733 [ 207291 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 19:59:53.032652 [ 207245 ] {} DNSResolver: Updating DNS cache 2024.09.02 19:59:53.032714 [ 207245 ] {} DNSResolver: Updated DNS cache 2024.09.02 19:59:53.600821 [ 207275 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 19:59:58.970374 [ 207278 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080911360, merge_with_ttl_allowedtrue) 2024.09.02 19:59:58.970418 [ 207278 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 20:00:08.032837 [ 207224 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:00:08.032920 [ 207224 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:00:09.000588 [ 207413 ] {} AsynchronousMetrics: Scanning /sys/block 2024.09.02 20:00:09.001008 [ 207413 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 8.459e-05 sec. 2024.09.02 20:00:18.267101 [ 207294 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080823296, merge_with_ttl_allowedtrue) 2024.09.02 20:00:18.267141 [ 207294 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 20:00:21.544919 [ 207303 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301957ms, ratio: 0, points per minute: 0) 2024.09.02 20:00:22.858631 [ 207295 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307572ms, ratio: 0, points per minute: 0) 2024.09.02 20:00:23.034053 [ 207305 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:00:23.034101 [ 207305 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:00:25.509890 [ 207329 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307164ms, ratio: 0, points per minute: 0) 2024.09.02 20:00:27.234662 [ 207211 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309731ms, ratio: 0, points per minute: 0) 2024.09.02 20:00:27.340686 [ 207304 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 305247ms, ratio: 0, points per minute: 0) 2024.09.02 20:00:33.406183 [ 207312 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080749568, merge_with_ttl_allowedtrue) 2024.09.02 20:00:33.406225 [ 207312 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 20:00:38.034208 [ 207193 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:00:38.035329 [ 207193 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:00:50.606883 [ 207230 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080684032, merge_with_ttl_allowedtrue) 2024.09.02 20:00:50.606939 [ 207230 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 20:00:53.035433 [ 207241 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:00:53.035481 [ 207241 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:00:53.601001 [ 207240 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 20:00:58.970618 [ 207249 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080645120, merge_with_ttl_allowedtrue) 2024.09.02 20:00:58.970695 [ 207249 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 20:01:08.035586 [ 207258 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:01:08.035657 [ 207258 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:01:18.267355 [ 207235 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080555008, merge_with_ttl_allowedtrue) 2024.09.02 20:01:18.267408 [ 207235 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 20:01:23.036574 [ 207272 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:01:23.036636 [ 207272 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:01:33.406383 [ 207222 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080481280, merge_with_ttl_allowedtrue) 2024.09.02 20:01:33.406441 [ 207222 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 20:01:38.036748 [ 207224 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:01:38.036811 [ 207224 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:01:50.607148 [ 207318 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080415744, merge_with_ttl_allowedtrue) 2024.09.02 20:01:50.607200 [ 207318 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 20:01:53.038196 [ 207303 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:01:53.038256 [ 207303 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:01:53.601193 [ 207340 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 20:01:58.970895 [ 207305 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080376832, merge_with_ttl_allowedtrue) 2024.09.02 20:01:58.970958 [ 207305 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 20:02:08.038375 [ 207192 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:02:08.038472 [ 207192 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:02:09.001178 [ 207413 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00013693 sec. 2024.09.02 20:02:18.267565 [ 207220 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080286720, merge_with_ttl_allowedtrue) 2024.09.02 20:02:18.267635 [ 207220 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 20:02:23.039703 [ 207195 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:02:23.039755 [ 207195 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:02:33.406639 [ 207190 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080215040, merge_with_ttl_allowedtrue) 2024.09.02 20:02:33.406720 [ 207190 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 20:02:38.039876 [ 207243 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:02:38.039938 [ 207243 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:02:50.607353 [ 207252 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080145408, merge_with_ttl_allowedtrue) 2024.09.02 20:02:50.607394 [ 207252 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 20:02:53.040036 [ 207250 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:02:53.040087 [ 207250 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:02:53.601380 [ 207251 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 20:02:58.971119 [ 207291 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080106496, merge_with_ttl_allowedtrue) 2024.09.02 20:02:58.971160 [ 207291 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 20:03:08.040228 [ 207237 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:03:08.040312 [ 207237 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:03:18.267840 [ 207296 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90080018432, merge_with_ttl_allowedtrue) 2024.09.02 20:03:18.267887 [ 207296 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 20:03:23.041446 [ 207306 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:03:23.041516 [ 207306 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:03:33.406997 [ 207290 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079944704, merge_with_ttl_allowedtrue) 2024.09.02 20:03:33.407156 [ 207290 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 20:03:38.041665 [ 207337 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:03:38.041752 [ 207337 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:03:50.607560 [ 207302 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079877120, merge_with_ttl_allowedtrue) 2024.09.02 20:03:50.607620 [ 207302 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 20:03:53.043051 [ 207312 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:03:53.043097 [ 207312 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:03:53.601554 [ 207213 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 20:03:58.971318 [ 207221 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079838208, merge_with_ttl_allowedtrue) 2024.09.02 20:03:58.971395 [ 207221 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 20:04:08.043226 [ 207227 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:04:08.043291 [ 207227 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:04:09.001315 [ 207413 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.0001552 sec. 2024.09.02 20:04:18.268037 [ 207244 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079748096, merge_with_ttl_allowedtrue) 2024.09.02 20:04:18.268073 [ 207244 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 20:04:23.043402 [ 207233 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:04:23.043457 [ 207233 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:04:33.407335 [ 207234 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079672320, merge_with_ttl_allowedtrue) 2024.09.02 20:04:33.407384 [ 207234 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 20:04:38.043562 [ 207289 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:04:38.043623 [ 207289 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:04:50.607770 [ 207194 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079608832, merge_with_ttl_allowedtrue) 2024.09.02 20:04:50.607814 [ 207194 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 20:04:53.043747 [ 207266 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:04:53.043806 [ 207266 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:04:53.601740 [ 207247 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 20:04:58.971563 [ 207288 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079569920, merge_with_ttl_allowedtrue) 2024.09.02 20:04:58.971640 [ 207288 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 20:05:08.043944 [ 207314 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:05:08.044023 [ 207314 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:05:10.000653 [ 207413 ] {} AsynchronousMetrics: Scanning /sys/block 2024.09.02 20:05:18.268250 [ 207338 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079479808, merge_with_ttl_allowedtrue) 2024.09.02 20:05:18.268294 [ 207338 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 20:05:23.022376 [ 207302 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 300159ms, ratio: 0, points per minute: 0) 2024.09.02 20:05:23.044136 [ 207284 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:05:23.044173 [ 207284 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:05:26.518667 [ 207297 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304969ms, ratio: 0, points per minute: 0) 2024.09.02 20:05:31.942646 [ 207213 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 306427ms, ratio: 0, points per minute: 0) 2024.09.02 20:05:33.407536 [ 207198 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079401984, merge_with_ttl_allowedtrue) 2024.09.02 20:05:33.407581 [ 207198 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 20:05:35.056016 [ 207193 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307711ms, ratio: 0, points per minute: 0) 2024.09.02 20:05:36.870436 [ 207221 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309631ms, ratio: 0, points per minute: 0) 2024.09.02 20:05:38.044292 [ 207225 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:05:38.044362 [ 207225 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:05:50.608028 [ 207204 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079336448, merge_with_ttl_allowedtrue) 2024.09.02 20:05:50.608089 [ 207204 ] {} oximeter.timeseries_schema_local (b4a66826-887d-4127-8be1-078d55905034): Scheduling next merge selecting task after 60000ms 2024.09.02 20:05:53.044486 [ 207253 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:05:53.044535 [ 207253 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:05:53.601918 [ 207248 ] {} oximeter.version (c3224e73-e5f1-47d1-8924-d9f345d987fc): Scheduling next merge selecting task after 60000ms 2024.09.02 20:05:58.971800 [ 207202 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079297536, merge_with_ttl_allowedtrue) 2024.09.02 20:05:58.971874 [ 207202 ] {} oximeter.fields_i64_local (ba1edf03-d402-4cf9-950d-c2b13382a3f7): Scheduling next merge selecting task after 60000ms 2024.09.02 20:06:08.044644 [ 207250 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:06:08.044698 [ 207250 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:06:09.001057 [ 207413 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000121641 sec. 2024.09.02 20:06:18.268503 [ 207239 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079209472, merge_with_ttl_allowedtrue) 2024.09.02 20:06:18.268552 [ 207239 ] {} oximeter.measurements_cumulativef64_local (fcc03e88-5c08-4d5c-836b-80d287ce76ad): Scheduling next merge selecting task after 60000ms 2024.09.02 20:06:23.044800 [ 207278 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:06:23.044858 [ 207278 ] {} DNSResolver: Updated DNS cache 2024.09.02 20:06:33.407785 [ 207293 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=90079137792, merge_with_ttl_allowedtrue) 2024.09.02 20:06:33.407838 [ 207293 ] {} oximeter.fields_uuid_local (614ac4a6-68d5-4c21-9de9-1166fa3f9b38): Scheduling next merge selecting task after 60000ms 2024.09.02 20:06:38.044962 [ 207300 ] {} DNSResolver: Updating DNS cache 2024.09.02 20:06:38.045014 [ 207300 ] {} DNSResolver: Updated DNS cache