2024.08.27 19:20:05.354684 [ 1 ] {} Application: Will watch for the process with pid 21353 2024.08.27 19:20:05.355937 [ 1 ] {} Application: Forked a child process to watch 2024.08.27 19:20:05.573821 [ 1 ] {} Application: Starting ClickHouse 23.8.7.1 (revision: 54477, git hash: b6a391579f09dde47a1aa5602e154e7fcde80d1e, build id: ), PID 21353 2024.08.27 19:20:05.574108 [ 1 ] {} Application: starting up 2024.08.27 19:20:05.574323 [ 1 ] {} Application: OS name: SunOS, version: 5.11, architecture: i86pc 2024.08.27 19:20:05.590116 [ 1 ] {} Application: Available RAM: 31.99 GiB; physical cores: 8; logical cores: 8. 2024.08.27 19:20:05.595231 [ 1 ] {} Application: rlimit on number of file descriptors is 65536 2024.08.27 19:20:05.595282 [ 1 ] {} Application: Initializing DateLUT. 2024.08.27 19:20:05.595299 [ 1 ] {} Application: Initialized DateLUT with time zone 'UTC'. 2024.08.27 19:20:05.595401 [ 1 ] {} Context: Setting up /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/data/tmp/ to store temporary data in it 2024.08.27 19:20:05.596453 [ 1 ] {} Application: Initializing interserver credentials. 2024.08.27 19:20:05.598282 [ 1 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml' 2024.08.27 19:20:05.600949 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration 2024.08.27 19:20:05.602252 [ 1 ] {} Application: Setting max_server_memory_usage was set to 28.79 GiB (31.99 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.08.27 19:20:05.602290 [ 1 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 16.00 GiB (31.99 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.08.27 19:20:05.602313 [ 1 ] {} Application: Merges and mutations memory limit is set to 16.00 GiB 2024.08.27 19:20:05.605453 [ 1 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2024.08.27 19:20:05.608547 [ 1 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads 2024.08.27 19:20:05.641515 [ 1 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2024.08.27 19:20:05.646024 [ 1 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2024.08.27 19:20:05.650231 [ 1 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.08.27 19:20:05.650463 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration 2024.08.27 19:20:05.657330 [ 1 ] {} Application: Listening for replica communication (interserver): http://[::1]:19403 2024.08.27 19:20:05.658981 [ 1 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml' 2024.08.27 19:20:05.661307 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration 2024.08.27 19:20:05.666172 [ 1 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration 2024.08.27 19:20:05.668129 [ 1 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml 2024.08.27 19:20:05.671842 [ 1 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2024.08.27 19:20:05.673425 [ 1 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2024.08.27 19:20:05.674331 [ 1 ] {} Context: Initialized background executor for fetches with num_threads=8, num_tasks=8 2024.08.27 19:20:05.675614 [ 1 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2024.08.27 19:20:05.686177 [ 1 ] {} DNSCacheUpdater: Update period 15 seconds 2024.08.27 19:20:05.689271 [ 1 ] {} Application: Loading metadata from /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/data/ 2024.08.27 19:20:05.689353 [ 129 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:20:05.689893 [ 129 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:20:05.705475 [ 1 ] {} DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total. 2024.08.27 19:20:05.705558 [ 1 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.001066866 sec 2024.08.27 19:20:05.705700 [ 1 ] {} ReferentialDeps: No tables 2024.08.27 19:20:05.705724 [ 1 ] {} LoadingDeps: No tables 2024.08.27 19:20:05.705857 [ 1 ] {} DatabaseAtomic (system): Starting up tables. 2024.08.27 19:20:05.705998 [ 1 ] {} SystemLog: Not creating system.query_log since corresponding section 'query_log' is missing from config 2024.08.27 19:20:05.706027 [ 1 ] {} SystemLog: Not creating system.query_thread_log since corresponding section 'query_thread_log' is missing from config 2024.08.27 19:20:05.706114 [ 1 ] {} SystemLog: Not creating system.part_log since corresponding section 'part_log' is missing from config 2024.08.27 19:20:05.706149 [ 1 ] {} SystemLog: Not creating system.trace_log since corresponding section 'trace_log' is missing from config 2024.08.27 19:20:05.706160 [ 1 ] {} SystemLog: Not creating system.crash_log since corresponding section 'crash_log' is missing from config 2024.08.27 19:20:05.706200 [ 1 ] {} SystemLog: Not creating system.text_log since corresponding section 'text_log' is missing from config 2024.08.27 19:20:05.706218 [ 1 ] {} SystemLog: Not creating system.metric_log since corresponding section 'metric_log' is missing from config 2024.08.27 19:20:05.706230 [ 1 ] {} SystemLog: Not creating system.filesystem_cache_log since corresponding section 'filesystem_cache_log' is missing from config 2024.08.27 19:20:05.706294 [ 1 ] {} SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config 2024.08.27 19:20:05.706324 [ 1 ] {} SystemLog: Not creating system.asynchronous_metric_log since corresponding section 'asynchronous_metric_log' is missing from config 2024.08.27 19:20:05.706338 [ 1 ] {} SystemLog: Not creating system.opentelemetry_span_log since corresponding section 'opentelemetry_span_log' is missing from config 2024.08.27 19:20:05.706348 [ 1 ] {} SystemLog: Not creating system.query_views_log since corresponding section 'query_views_log' is missing from config 2024.08.27 19:20:05.706426 [ 1 ] {} SystemLog: Not creating system.zookeeper_log since corresponding section 'zookeeper_log' is missing from config 2024.08.27 19:20:05.706450 [ 1 ] {} SystemLog: Not creating system.session_log since corresponding section 'session_log' is missing from config 2024.08.27 19:20:05.706708 [ 1 ] {} SystemLog: Not creating system.transactions_info_log since corresponding section 'transactions_info_log' is missing from config 2024.08.27 19:20:05.706821 [ 1 ] {} SystemLog: Not creating system.processors_profile_log since corresponding section 'processors_profile_log' is missing from config 2024.08.27 19:20:05.706838 [ 1 ] {} SystemLog: Not creating system.asynchronous_insert_log since corresponding section 'asynchronous_insert_log' is missing from config 2024.08.27 19:20:05.762109 [ 1 ] {} DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal. 2024.08.27 19:20:05.764402 [ 1 ] {} DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total. 2024.08.27 19:20:05.764460 [ 1 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.000165882 sec 2024.08.27 19:20:05.764479 [ 1 ] {} ReferentialDeps: No tables 2024.08.27 19:20:05.764556 [ 1 ] {} LoadingDeps: No tables 2024.08.27 19:20:05.764610 [ 1 ] {} DatabaseAtomic (default): Starting up tables. 2024.08.27 19:20:05.765376 [ 1 ] {} UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/data/user_defined/ 2024.08.27 19:20:05.765513 [ 1 ] {} UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded 2024.08.27 19:20:05.765540 [ 1 ] {} Application: Loaded metadata. 2024.08.27 19:20:05.765567 [ 1 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2024.08.27 19:20:05.765583 [ 1 ] {} Application: TaskStats is not implemented for this OS. IO accounting will be disabled. 2024.08.27 19:20:05.765910 [ 1 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.08.27 19:20:05.766331 [ 1 ] {} AsynchronousMetrics: MemoryTracking: was 9.98 MiB, peak 16.17 MiB, free memory in arenas 0.00 B, will set to 98.62 MiB (RSS), difference: 88.64 MiB 2024.08.27 19:20:05.767024 [ 1 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 8.1252e-05 sec. 2024.08.27 19:20:05.768801 [ 1 ] {} Application: Listening for http://[::1]:19303 2024.08.27 19:20:05.768826 [ 248 ] {} DDLWorker: Starting DDLWorker thread 2024.08.27 19:20:05.768970 [ 249 ] {} DDLWorker: Started DDLWorker cleanup thread 2024.08.27 19:20:05.769039 [ 1 ] {} Application: Listening for native protocol (tcp): [::1]:19203 2024.08.27 19:20:05.769081 [ 1 ] {} Application: Ready for connections. 2024.08.27 19:20:05.769043 [ 248 ] {} DDLWorker: Initializing DDLWorker thread 2024.08.27 19:20:05.774443 [ 248 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19002 with session_id 6 2024.08.27 19:20:05.776997 [ 248 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.08.27 19:20:05.777037 [ 248 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.08.27 19:20:05.777047 [ 248 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.08.27 19:20:05.777074 [ 248 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003 2024.08.27 19:20:05.780769 [ 248 ] {} DDLWorker: Initialized DDLWorker thread 2024.08.27 19:20:05.780884 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:05.780900 [ 248 ] {} DDLWorker: Don't have unfinished tasks after restarting 2024.08.27 19:20:05.781173 [ 249 ] {} DDLWorker: Cleaning queue 2024.08.27 19:20:05.781595 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=10, queue_size=10, entries=query-0000000000..query-0000000009, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2024.08.27 19:20:05.781681 [ 248 ] {} DDLWorker: Will schedule 10 tasks starting from query-0000000000 2024.08.27 19:20:05.781696 [ 248 ] {} DDLWorker: Checking task query-0000000000 2024.08.27 19:20:05.782533 [ 248 ] {} DDLWorker: Will not execute task query-0000000000: There is no a local address in host list 2024.08.27 19:20:05.782710 [ 248 ] {} DDLWorker: Checking task query-0000000001 2024.08.27 19:20:05.783106 [ 248 ] {} DDLWorker: Will not execute task query-0000000001: There is no a local address in host list 2024.08.27 19:20:05.783130 [ 248 ] {} DDLWorker: Checking task query-0000000002 2024.08.27 19:20:05.783640 [ 248 ] {} DDLWorker: Will not execute task query-0000000002: There is no a local address in host list 2024.08.27 19:20:05.783682 [ 248 ] {} DDLWorker: Checking task query-0000000003 2024.08.27 19:20:05.784385 [ 248 ] {} DDLWorker: Will not execute task query-0000000003: There is no a local address in host list 2024.08.27 19:20:05.784505 [ 248 ] {} DDLWorker: Checking task query-0000000004 2024.08.27 19:20:05.784936 [ 248 ] {} DDLWorker: Will not execute task query-0000000004: There is no a local address in host list 2024.08.27 19:20:05.784959 [ 248 ] {} DDLWorker: Checking task query-0000000005 2024.08.27 19:20:05.785420 [ 248 ] {} DDLWorker: Will not execute task query-0000000005: There is no a local address in host list 2024.08.27 19:20:05.785452 [ 248 ] {} DDLWorker: Checking task query-0000000006 2024.08.27 19:20:05.785791 [ 248 ] {} DDLWorker: Will not execute task query-0000000006: There is no a local address in host list 2024.08.27 19:20:05.785817 [ 248 ] {} DDLWorker: Checking task query-0000000007 2024.08.27 19:20:05.786236 [ 248 ] {} DDLWorker: Will not execute task query-0000000007: There is no a local address in host list 2024.08.27 19:20:05.786263 [ 248 ] {} DDLWorker: Checking task query-0000000008 2024.08.27 19:20:05.786619 [ 248 ] {} DDLWorker: Will not execute task query-0000000008: There is no a local address in host list 2024.08.27 19:20:05.786931 [ 248 ] {} DDLWorker: Checking task query-0000000009 2024.08.27 19:20:05.787693 [ 248 ] {} DDLWorker: Will not execute task query-0000000009: There is no a local address in host list 2024.08.27 19:20:05.787730 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:06.002340 [ 244 ] {} AsynchronousMetrics: MemoryTracking: was 98.65 MiB, peak 98.65 MiB, free memory in arenas 0.00 B, will set to 100.87 MiB (RSS), difference: 2.22 MiB 2024.08.27 19:20:06.541763 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: GET, Address: [::1]:37610, User-Agent: (none), Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:06.543408 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 1261, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:06.544051 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:06.544143 [ 3 ] {} HTTP-Session: 2c9a6237-befb-41ed-8e95-fdcb31aa5613 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:06.544911 [ 3 ] {} HTTP-Session: 2c9a6237-befb-41ed-8e95-fdcb31aa5613 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.544974 [ 3 ] {} HTTP-Session: 2c9a6237-befb-41ed-8e95-fdcb31aa5613 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.545408 [ 3 ] {} ContextAccess (default): Settings: readonly = 0, allow_ddl = true, allow_introspection_functions = false 2024.08.27 19:20:06.545986 [ 3 ] {} ContextAccess (default): List of all grants: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* 2024.08.27 19:20:06.546091 [ 3 ] {} ContextAccess (default): List of all grants including implicit: GRANT SHOW, SELECT, INSERT, ALTER, CREATE, DROP, UNDROP TABLE, TRUNCATE, OPTIMIZE, BACKUP, KILL QUERY, KILL TRANSACTION, MOVE PARTITION BETWEEN SHARDS, SYSTEM, dictGet, displaySecretsInShowAndSelect, INTROSPECTION, SOURCES, CLUSTER ON *.* 2024.08.27 19:20:06.546546 [ 3 ] {} HTTP-Session: 2c9a6237-befb-41ed-8e95-fdcb31aa5613 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:06.547398 [ 3 ] {00225401-2519-48fa-8153-0a4188d42636} executeQuery: (from [::1]:37610) /* We purposefully split our DB schema into two *disjoint* files: * `db-init-1.sql` and `db-init-2.sql`. The purpose of this split is to shorten * the duration of our replicated tests. These tests only use a subset of the * tables defined in the full schema. We put the tables used by the replicated * tests in `db-init-1.sql`, and the remainder of the tables in `db-init-2.sql`. * This minimizes test time by reducing the cost to load a schema. In * production, we load `db-init-1.sql` followed by `db-init-2.sql` so we have * the full schema. If we end up needing to use more tables in replicated tests * we can go ahead and move them into `db-init-1.sql`, removing them from * `db-init-2.sql`. Conversely, if we stop using given tables in our tests we * can move them from `db-init-1.sql` into `db-init-2.sql` and keep our test * times minimal. * The reason to keep the two files disjoint is so that we don't have to * maintain consistency between table definitions. All tables are defined * once. However, in order to write a test that ensures the tables are in fact * disjoint, we must create the `oximeter` database in both files so we can load * them in isolation. */ CREATE DATABASE IF NOT EXISTS oximeter ON CLUSTER oximeter_cluster (stage: Complete) 2024.08.27 19:20:06.547748 [ 3 ] {00225401-2519-48fa-8153-0a4188d42636} ContextAccess (default): Access granted: CREATE DATABASE ON oximeter.* 2024.08.27 19:20:06.556222 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:06.556374 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:06.557110 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=11, queue_size=11, entries=query-0000000000..query-0000000010, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:06.557149 [ 248 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000010 2024.08.27 19:20:06.557163 [ 248 ] {} DDLWorker: Checking task query-0000000010 2024.08.27 19:20:06.561547 [ 248 ] {} DDLWorker: Processing task query-0000000010 (CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b') 2024.08.27 19:20:06.564348 [ 248 ] {} DDLWorker: Executing query: CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b' 2024.08.27 19:20:06.564930 [ 248 ] {bebc4ff4-a37a-47e3-83e2-a99df2cfe1cc} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 00225401-2519-48fa-8153-0a4188d42636) /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b' (stage: Complete) 2024.08.27 19:20:06.571706 [ 248 ] {bebc4ff4-a37a-47e3-83e2-a99df2cfe1cc} DatabaseAtomic (oximeter): Metadata processed, database oximeter has 0 tables and 0 dictionaries in total. 2024.08.27 19:20:06.571745 [ 248 ] {bebc4ff4-a37a-47e3-83e2-a99df2cfe1cc} TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.000118958 sec 2024.08.27 19:20:06.571767 [ 248 ] {bebc4ff4-a37a-47e3-83e2-a99df2cfe1cc} ReferentialDeps: No tables 2024.08.27 19:20:06.571798 [ 248 ] {bebc4ff4-a37a-47e3-83e2-a99df2cfe1cc} LoadingDeps: No tables 2024.08.27 19:20:06.571840 [ 248 ] {bebc4ff4-a37a-47e3-83e2-a99df2cfe1cc} DatabaseAtomic (oximeter): Starting up tables. 2024.08.27 19:20:06.571953 [ 248 ] {bebc4ff4-a37a-47e3-83e2-a99df2cfe1cc} DDLWorker: Executed query: /* ddl_entry=query-0000000010 */ CREATE DATABASE IF NOT EXISTS oximeter UUID 'bc161daf-58a3-4ee3-9511-dff3650e303b' 2024.08.27 19:20:06.581596 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:06.682876 [ 3 ] {00225401-2519-48fa-8153-0a4188d42636} executeQuery: Read 3 rows, 141.00 B in 0.135613 sec., 22.121772986365613 rows/sec., 1.02 KiB/sec. 2024.08.27 19:20:06.683549 [ 3 ] {00225401-2519-48fa-8153-0a4188d42636} DynamicQueryHandler: Done processing query 2024.08.27 19:20:06.683593 [ 3 ] {00225401-2519-48fa-8153-0a4188d42636} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.08.27 19:20:06.683622 [ 3 ] {} HTTP-Session: 2c9a6237-befb-41ed-8e95-fdcb31aa5613 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.684911 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 310, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:06.685012 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:06.685054 [ 3 ] {} HTTP-Session: 4f9b4f2e-cc93-4263-8ae3-33a99c39859c Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:06.685080 [ 3 ] {} HTTP-Session: 4f9b4f2e-cc93-4263-8ae3-33a99c39859c Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.685090 [ 3 ] {} HTTP-Session: 4f9b4f2e-cc93-4263-8ae3-33a99c39859c Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.685148 [ 3 ] {} HTTP-Session: 4f9b4f2e-cc93-4263-8ae3-33a99c39859c Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:06.685513 [ 3 ] {6f6c813b-85a8-4f90-b375-647f513add95} executeQuery: (from [::1]:37610) /* The version table contains metadata about the `oximeter` database */ CREATE TABLE IF NOT EXISTS oximeter.version ON CLUSTER oximeter_cluster ( value UInt64, timestamp DateTime64(9, 'UTC') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) 2024.08.27 19:20:06.685611 [ 3 ] {6f6c813b-85a8-4f90-b375-647f513add95} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.version 2024.08.27 19:20:06.685786 [ 3 ] {6f6c813b-85a8-4f90-b375-647f513add95} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.version 2024.08.27 19:20:06.692289 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:06.692435 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:06.695681 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=12, queue_size=12, entries=query-0000000000..query-0000000011, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000010, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:06.695730 [ 248 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000011 2024.08.27 19:20:06.695767 [ 248 ] {} DDLWorker: Checking task query-0000000011 2024.08.27 19:20:06.697250 [ 248 ] {} DDLWorker: Processing task query-0000000011 (CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp)) 2024.08.27 19:20:06.703636 [ 248 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.08.27 19:20:06.703946 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6f6c813b-85a8-4f90-b375-647f513add95) /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) (stage: Complete) 2024.08.27 19:20:06.706186 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} StoragePolicy (default): Storage policy default created, total volumes 1 2024.08.27 19:20:06.707332 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Loading data parts 2024.08.27 19:20:06.708467 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): There are no data parts 2024.08.27 19:20:06.713194 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): This table /clickhouse/tables/1/version is already created, will add new replica 2024.08.27 19:20:06.716010 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Creating replica /clickhouse/tables/1/version/replicas/3 2024.08.27 19:20:06.758215 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Creating shared ID for table oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e) 2024.08.27 19:20:06.759024 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Initializing table shared ID with a8b9cbbd-ba1f-41e3-b21a-cebda6afb17e 2024.08.27 19:20:06.760360 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Starting up table 2024.08.27 19:20:06.760936 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Became leader 2024.08.27 19:20:06.761070 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:06.761163 [ 123 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.08.27 19:20:06.761227 [ 123 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:06.768286 [ 123 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Replica 2 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.08.27 19:20:06.768445 [ 123 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Replica 1 has log pointer '0', approximate 1 queue lag and 0 queue size 2024.08.27 19:20:06.768482 [ 123 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Will mimic 2 2024.08.27 19:20:06.775843 [ 123 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Queued 0 parts to be fetched, 0 parts ignored 2024.08.27 19:20:06.775877 [ 123 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Copied 0 queue entries, 0 entries ignored 2024.08.27 19:20:06.776480 [ 123 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Parts in ZooKeeper after mimic: 2024.08.27 19:20:06.776600 [ 123 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Enqueued fetches after mimic: 2024.08.27 19:20:06.780217 [ 123 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:06.780431 [ 123 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:06.780460 [ 123 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/3/queue 2024.08.27 19:20:06.780655 [ 123 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:06.780889 [ 123 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:06.782649 [ 123 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:06.782801 [ 143 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 6283ms 2024.08.27 19:20:06.782975 [ 248 ] {b05f2261-1ef9-40b6-85c1-2284ca46b7a9} DDLWorker: Executed query: /* ddl_entry=query-0000000011 */ CREATE TABLE IF NOT EXISTS oximeter.version UUID '0c252196-de3a-41fe-af04-c96ffeb5b03e' (`value` UInt64, `timestamp` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/version', '{replica}') ORDER BY (value, timestamp) 2024.08.27 19:20:06.786187 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:06.804704 [ 3 ] {6f6c813b-85a8-4f90-b375-647f513add95} executeQuery: Read 3 rows, 141.00 B in 0.119241 sec., 25.159131506780387 rows/sec., 1.15 KiB/sec. 2024.08.27 19:20:06.805894 [ 3 ] {6f6c813b-85a8-4f90-b375-647f513add95} DynamicQueryHandler: Done processing query 2024.08.27 19:20:06.805992 [ 3 ] {6f6c813b-85a8-4f90-b375-647f513add95} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.08.27 19:20:06.806033 [ 3 ] {} HTTP-Session: 4f9b4f2e-cc93-4263-8ae3-33a99c39859c Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.807951 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 997, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:06.808059 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:06.808090 [ 3 ] {} HTTP-Session: 66811260-0bec-4633-99c2-5938dbb5a30e Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:06.808143 [ 3 ] {} HTTP-Session: 66811260-0bec-4633-99c2-5938dbb5a30e Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.808159 [ 3 ] {} HTTP-Session: 66811260-0bec-4633-99c2-5938dbb5a30e Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.808245 [ 3 ] {} HTTP-Session: 66811260-0bec-4633-99c2-5938dbb5a30e Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:06.808858 [ 3 ] {60e1672f-1a93-42f4-bdb3-23817d9077bf} executeQuery: (from [::1]:37610) /* The measurement tables contain all individual samples from each timeseries. * * Each table stores a single datum type, and otherwise contains nearly the same * structure. The primary sorting key is on the timeseries name, key, and then * timestamp, so that all timeseries from the same schema are grouped, followed * by all samples from the same timeseries. * * This reflects that one usually looks up the _key_ in one or more field table, * and then uses that to index quickly into the measurements tables. */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local ON CLUSTER oximeter_cluster ( timeseries_name String, timeseries_key UInt64, start_time DateTime64(9, 'UTC'), timestamp DateTime64(9, 'UTC'), datum Nullable(Float64) ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + INTERVAL 30 DAY (stage: Complete) 2024.08.27 19:20:06.808951 [ 3 ] {60e1672f-1a93-42f4-bdb3-23817d9077bf} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64_local 2024.08.27 19:20:06.809146 [ 3 ] {60e1672f-1a93-42f4-bdb3-23817d9077bf} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64_local 2024.08.27 19:20:06.818105 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:06.818141 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:06.819126 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=13, queue_size=13, entries=query-0000000000..query-0000000012, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000011, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:06.819180 [ 248 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000012 2024.08.27 19:20:06.819191 [ 248 ] {} DDLWorker: Checking task query-0000000012 2024.08.27 19:20:06.829278 [ 248 ] {} DDLWorker: Processing task query-0000000012 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30)) 2024.08.27 19:20:06.835675 [ 248 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.08.27 19:20:06.836159 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 60e1672f-1a93-42f4-bdb3-23817d9077bf) /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) (stage: Complete) 2024.08.27 19:20:06.839778 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Loading data parts 2024.08.27 19:20:06.840233 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): There are no data parts 2024.08.27 19:20:06.844221 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): This table /clickhouse/tables/1/measurements_cumulativef64_local is already created, will add new replica 2024.08.27 19:20:06.846624 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Creating replica /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3 2024.08.27 19:20:06.874246 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Creating shared ID for table oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) 2024.08.27 19:20:06.874652 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Initializing table shared ID with 5a85093b-c21a-4b08-bf37-6af0108427b6 2024.08.27 19:20:06.875795 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Starting up table 2024.08.27 19:20:06.876677 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Became leader 2024.08.27 19:20:06.876718 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:06.876794 [ 102 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.08.27 19:20:06.876812 [ 102 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:06.882658 [ 102 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.08.27 19:20:06.882715 [ 102 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.08.27 19:20:06.882726 [ 102 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Will mimic 1 2024.08.27 19:20:06.894515 [ 102 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Queued 1 parts to be fetched, 0 parts ignored 2024.08.27 19:20:06.894731 [ 102 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Copied 0 queue entries, 0 entries ignored 2024.08.27 19:20:06.895514 [ 102 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Parts in ZooKeeper after mimic: 2024.08.27 19:20:06.895537 [ 102 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Enqueued fetches after mimic: all_0_0_0 2024.08.27 19:20:06.902204 [ 102 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:06.902893 [ 102 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:06.902927 [ 102 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/queue 2024.08.27 19:20:06.903919 [ 102 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:06.904806 [ 102 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.08.27 19:20:06.909874 [ 102 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:06.913537 [ 102 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:06.913704 [ 123 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 6426ms 2024.08.27 19:20:06.914135 [ 248 ] {acd9acf7-1761-435f-8cbf-71670af95c7d} DDLWorker: Executed query: /* ddl_entry=query-0000000012 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64_local UUID 'c3418791-a716-4326-9bd3-a6cb615bf6fe' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/measurements_cumulativef64_local', '{replica}') ORDER BY (timeseries_name, timeseries_key, start_time, timestamp) TTL toDateTime(timestamp) + toIntervalDay(30) 2024.08.27 19:20:06.914425 [ 121 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks 2024.08.27 19:20:06.916992 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:06.917628 [ 209 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Fetching part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1 2024.08.27 19:20:06.918148 [ 209 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.08.27 19:20:06.918366 [ 209 ] {} HTTPSessionAdapter: Created HTTP(S) session with ::1:19401 (::1:19401) 2024.08.27 19:20:06.919624 [ 209 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:06.919704 [ 209 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:06.919724 [ 209 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:06.919770 [ 209 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.08.27 19:20:06.922399 [ 209 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.08.27 19:20:06.922458 [ 209 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:06.922763 [ 209 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Committing part all_0_0_0 to zookeeper 2024.08.27 19:20:06.927326 [ 209 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Part all_0_0_0 committed to zookeeper 2024.08.27 19:20:06.927456 [ 209 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Fetched part all_0_0_0 from default:/clickhouse/tables/1/measurements_cumulativef64_local/replicas/1 2024.08.27 19:20:06.927634 [ 136 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue) 2024.08.27 19:20:06.927672 [ 136 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 7897ms 2024.08.27 19:20:06.992278 [ 3 ] {60e1672f-1a93-42f4-bdb3-23817d9077bf} executeQuery: Read 3 rows, 141.00 B in 0.183872 sec., 16.315697876783847 rows/sec., 766.84 B/sec. 2024.08.27 19:20:06.992691 [ 3 ] {60e1672f-1a93-42f4-bdb3-23817d9077bf} DynamicQueryHandler: Done processing query 2024.08.27 19:20:06.992721 [ 3 ] {60e1672f-1a93-42f4-bdb3-23817d9077bf} MemoryTracker: Peak memory usage (for query): 4.96 MiB. 2024.08.27 19:20:06.992736 [ 3 ] {} HTTP-Session: 66811260-0bec-4633-99c2-5938dbb5a30e Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.993596 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 274, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:06.993678 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:06.993695 [ 3 ] {} HTTP-Session: d657a44b-ba4a-4b51-91e8-9c312ada1381 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:06.993723 [ 3 ] {} HTTP-Session: d657a44b-ba4a-4b51-91e8-9c312ada1381 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.993734 [ 3 ] {} HTTP-Session: d657a44b-ba4a-4b51-91e8-9c312ada1381 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:06.993778 [ 3 ] {} HTTP-Session: d657a44b-ba4a-4b51-91e8-9c312ada1381 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:06.994057 [ 3 ] {ee8e23ad-46b3-40df-b03c-32b65df97ae1} executeQuery: (from [::1]:37610) CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 ON CLUSTER oximeter_cluster AS oximeter.measurements_cumulativef64_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:06.994134 [ 3 ] {ee8e23ad-46b3-40df-b03c-32b65df97ae1} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64 2024.08.27 19:20:06.994149 [ 3 ] {ee8e23ad-46b3-40df-b03c-32b65df97ae1} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:06.994161 [ 3 ] {ee8e23ad-46b3-40df-b03c-32b65df97ae1} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:06.994288 [ 3 ] {ee8e23ad-46b3-40df-b03c-32b65df97ae1} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.measurements_cumulativef64 2024.08.27 19:20:06.994311 [ 3 ] {ee8e23ad-46b3-40df-b03c-32b65df97ae1} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:07.001201 [ 244 ] {} AsynchronousMetrics: MemoryTracking: was 104.29 MiB, peak 109.21 MiB, free memory in arenas 0.00 B, will set to 106.91 MiB (RSS), difference: 2.62 MiB 2024.08.27 19:20:07.001847 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.001866 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.002274 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=14, queue_size=14, entries=query-0000000000..query-0000000013, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000012, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:07.002306 [ 248 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000013 2024.08.27 19:20:07.002329 [ 248 ] {} DDLWorker: Checking task query-0000000013 2024.08.27 19:20:07.006242 [ 248 ] {} DDLWorker: Processing task query-0000000013 (CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:07.013556 [ 248 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.013954 [ 248 ] {514b714f-51f7-434d-97fc-e833320b749b} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: ee8e23ad-46b3-40df-b03c-32b65df97ae1) /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.016564 [ 248 ] {514b714f-51f7-434d-97fc-e833320b749b} StorageDistributed (measurements_cumulativef64): Auto-increment is 0 2024.08.27 19:20:07.018284 [ 248 ] {514b714f-51f7-434d-97fc-e833320b749b} DDLWorker: Executed query: /* ddl_entry=query-0000000013 */ CREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64 UUID '5544f27e-d5aa-4a62-b6d3-f9f1b05cb5e5' (`timeseries_name` String, `timeseries_key` UInt64, `start_time` DateTime64(9, 'UTC'), `timestamp` DateTime64(9, 'UTC'), `datum` Nullable(Float64)) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'measurements_cumulativef64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.026821 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.118937 [ 3 ] {ee8e23ad-46b3-40df-b03c-32b65df97ae1} executeQuery: Read 3 rows, 141.00 B in 0.125001 sec., 23.99980800153599 rows/sec., 1.10 KiB/sec. 2024.08.27 19:20:07.119776 [ 3 ] {ee8e23ad-46b3-40df-b03c-32b65df97ae1} DynamicQueryHandler: Done processing query 2024.08.27 19:20:07.119824 [ 3 ] {ee8e23ad-46b3-40df-b03c-32b65df97ae1} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.08.27 19:20:07.119851 [ 3 ] {} HTTP-Session: d657a44b-ba4a-4b51-91e8-9c312ada1381 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.121022 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 1384, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:07.121141 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:07.121173 [ 3 ] {} HTTP-Session: d292d02d-3fa9-446f-b23d-acc320b547d1 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:07.121207 [ 3 ] {} HTTP-Session: d292d02d-3fa9-446f-b23d-acc320b547d1 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.121224 [ 3 ] {} HTTP-Session: d292d02d-3fa9-446f-b23d-acc320b547d1 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.121294 [ 3 ] {} HTTP-Session: d292d02d-3fa9-446f-b23d-acc320b547d1 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:07.121719 [ 3 ] {eaf35fa9-e032-40af-9452-955864320874} executeQuery: (from [::1]:37610) /* The field tables store named dimensions of each timeseries. * * As with the measurement tables, there is one field table for each field data * type. Fields are deduplicated by using the "replacing merge tree", though * this behavior **must not** be relied upon for query correctness. * * The index for the fields differs from the measurements, however. Rows are * sorted by timeseries name, then field name, field value, and finally * timeseries key. This reflects the most common pattern for looking them up: * by field name and possibly value, within a timeseries. The resulting keys are * usually then used to look up measurements. * * NOTE: We may want to consider a secondary index on these tables, sorting by * timeseries name and then key, since it would improve lookups where one * already has the key. Realistically though, these tables are quite small and * so performance benefits will be low in absolute terms. */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local ON CLUSTER oximeter_cluster ( timeseries_name String, timeseries_key UInt64, field_name String, field_value Int64, last_updated_at DateTime MATERIALIZED now() ) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + INTERVAL 30 DAY (stage: Complete) 2024.08.27 19:20:07.121816 [ 3 ] {eaf35fa9-e032-40af-9452-955864320874} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64_local 2024.08.27 19:20:07.122252 [ 3 ] {eaf35fa9-e032-40af-9452-955864320874} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64_local 2024.08.27 19:20:07.130417 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.130450 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.135315 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=15, queue_size=15, entries=query-0000000000..query-0000000014, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000013, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:07.135361 [ 248 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000014 2024.08.27 19:20:07.135377 [ 248 ] {} DDLWorker: Checking task query-0000000014 2024.08.27 19:20:07.140932 [ 248 ] {} DDLWorker: Processing task query-0000000014 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.08.27 19:20:07.148397 [ 248 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:07.148776 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: eaf35fa9-e032-40af-9452-955864320874) /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.08.27 19:20:07.153021 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Loading data parts 2024.08.27 19:20:07.154889 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): There are no data parts 2024.08.27 19:20:07.160366 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): This table /clickhouse/tables/1/fields_i64_local is already created, will add new replica 2024.08.27 19:20:07.163812 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Creating replica /clickhouse/tables/1/fields_i64_local/replicas/3 2024.08.27 19:20:07.225489 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Creating shared ID for table oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) 2024.08.27 19:20:07.227182 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Initializing table shared ID with cf08e0ee-71a3-4243-81ae-d52967c1399a 2024.08.27 19:20:07.228669 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Starting up table 2024.08.27 19:20:07.229425 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Became leader 2024.08.27 19:20:07.229488 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:07.229598 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.08.27 19:20:07.229660 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:07.240664 [ 136 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.08.27 19:20:07.240707 [ 136 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.08.27 19:20:07.240737 [ 136 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Will mimic 2 2024.08.27 19:20:07.251774 [ 136 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Queued 1 parts to be fetched, 0 parts ignored 2024.08.27 19:20:07.251820 [ 136 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Copied 0 queue entries, 0 entries ignored 2024.08.27 19:20:07.252244 [ 136 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Parts in ZooKeeper after mimic: 2024.08.27 19:20:07.252287 [ 136 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Enqueued fetches after mimic: all_0_0_0 2024.08.27 19:20:07.255672 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:07.256514 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:07.256555 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/3/queue 2024.08.27 19:20:07.257008 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:07.257423 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.08.27 19:20:07.262412 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:07.265085 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:07.265202 [ 121 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 6326ms 2024.08.27 19:20:07.265823 [ 248 ] {180fcf30-422f-4e9b-ac99-a1a919baa6de} DDLWorker: Executed query: /* ddl_entry=query-0000000014 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64_local UUID 'cc75e148-9558-4f31-b2f3-d34667f6e2df' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_i64_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:07.271957 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.272385 [ 109 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks 2024.08.27 19:20:07.272502 [ 229 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/2 2024.08.27 19:20:07.273348 [ 229 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19402/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F2&part=all_0_0_0&client_protocol_version=8&compress=false 2024.08.27 19:20:07.273617 [ 229 ] {} HTTPSessionAdapter: Created HTTP(S) session with ::1:19402 (::1:19402) 2024.08.27 19:20:07.275227 [ 229 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:07.275306 [ 229 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:07.275321 [ 229 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:07.275350 [ 229 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.08.27 19:20:07.277532 [ 229 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.08.27 19:20:07.277620 [ 229 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:07.277850 [ 229 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Committing part all_0_0_0 to zookeeper 2024.08.27 19:20:07.282240 [ 229 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Part all_0_0_0 committed to zookeeper 2024.08.27 19:20:07.282401 [ 229 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_i64_local/replicas/2 2024.08.27 19:20:07.282516 [ 109 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue) 2024.08.27 19:20:07.282581 [ 109 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 7944ms 2024.08.27 19:20:07.294705 [ 3 ] {eaf35fa9-e032-40af-9452-955864320874} executeQuery: Read 3 rows, 141.00 B in 0.173226 sec., 17.31841640400402 rows/sec., 813.97 B/sec. 2024.08.27 19:20:07.295299 [ 3 ] {eaf35fa9-e032-40af-9452-955864320874} DynamicQueryHandler: Done processing query 2024.08.27 19:20:07.295328 [ 3 ] {eaf35fa9-e032-40af-9452-955864320874} MemoryTracker: Peak memory usage (for query): 4.96 MiB. 2024.08.27 19:20:07.295342 [ 3 ] {} HTTP-Session: d292d02d-3fa9-446f-b23d-acc320b547d1 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.296408 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 226, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:07.296510 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:07.296532 [ 3 ] {} HTTP-Session: b77bf941-a4eb-41c7-8048-e8700ca302cb Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:07.296556 [ 3 ] {} HTTP-Session: b77bf941-a4eb-41c7-8048-e8700ca302cb Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.296574 [ 3 ] {} HTTP-Session: b77bf941-a4eb-41c7-8048-e8700ca302cb Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.296631 [ 3 ] {} HTTP-Session: b77bf941-a4eb-41c7-8048-e8700ca302cb Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:07.296909 [ 3 ] {8f0c970b-a421-4abd-b2da-5fbaf796d1ae} executeQuery: (from [::1]:37610) CREATE TABLE IF NOT EXISTS oximeter.fields_i64 ON CLUSTER oximeter_cluster AS oximeter.fields_i64_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.296984 [ 3 ] {8f0c970b-a421-4abd-b2da-5fbaf796d1ae} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64 2024.08.27 19:20:07.297040 [ 3 ] {8f0c970b-a421-4abd-b2da-5fbaf796d1ae} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:07.297067 [ 3 ] {8f0c970b-a421-4abd-b2da-5fbaf796d1ae} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:07.297187 [ 3 ] {8f0c970b-a421-4abd-b2da-5fbaf796d1ae} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_i64 2024.08.27 19:20:07.297203 [ 3 ] {8f0c970b-a421-4abd-b2da-5fbaf796d1ae} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:07.304244 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.304276 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.309809 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=16, queue_size=16, entries=query-0000000000..query-0000000015, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000014, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:07.309865 [ 248 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000015 2024.08.27 19:20:07.309924 [ 248 ] {} DDLWorker: Checking task query-0000000015 2024.08.27 19:20:07.319121 [ 248 ] {} DDLWorker: Processing task query-0000000015 (CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:07.324967 [ 248 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.328255 [ 248 ] {21b92d29-86f3-44b1-a7b5-41cec5a9ea55} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 8f0c970b-a421-4abd-b2da-5fbaf796d1ae) /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.331432 [ 248 ] {21b92d29-86f3-44b1-a7b5-41cec5a9ea55} StorageDistributed (fields_i64): Auto-increment is 0 2024.08.27 19:20:07.335596 [ 248 ] {21b92d29-86f3-44b1-a7b5-41cec5a9ea55} DDLWorker: Executed query: /* ddl_entry=query-0000000015 */ CREATE TABLE IF NOT EXISTS oximeter.fields_i64 UUID '16f356dc-f4c0-47fe-90c6-f57160280ccd' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` Int64, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_i64_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.341126 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.422923 [ 3 ] {8f0c970b-a421-4abd-b2da-5fbaf796d1ae} executeQuery: Read 3 rows, 141.00 B in 0.126148 sec., 23.781589878555344 rows/sec., 1.09 KiB/sec. 2024.08.27 19:20:07.423465 [ 3 ] {8f0c970b-a421-4abd-b2da-5fbaf796d1ae} DynamicQueryHandler: Done processing query 2024.08.27 19:20:07.423521 [ 3 ] {8f0c970b-a421-4abd-b2da-5fbaf796d1ae} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.08.27 19:20:07.423540 [ 3 ] {} HTTP-Session: b77bf941-a4eb-41c7-8048-e8700ca302cb Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.424753 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 441, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:07.424869 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:07.424894 [ 3 ] {} HTTP-Session: 2eb42084-431e-4dd3-b5f1-c637e072a951 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:07.424919 [ 3 ] {} HTTP-Session: 2eb42084-431e-4dd3-b5f1-c637e072a951 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.424938 [ 3 ] {} HTTP-Session: 2eb42084-431e-4dd3-b5f1-c637e072a951 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.424998 [ 3 ] {} HTTP-Session: 2eb42084-431e-4dd3-b5f1-c637e072a951 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:07.425435 [ 3 ] {35f235fc-dba9-407f-b58a-0f191ba3745f} executeQuery: (from [::1]:37610) CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local ON CLUSTER oximeter_cluster ( timeseries_name String, timeseries_key UInt64, field_name String, field_value UUID, last_updated_at DateTime MATERIALIZED now() ) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + INTERVAL 30 DAY (stage: Complete) 2024.08.27 19:20:07.425549 [ 3 ] {35f235fc-dba9-407f-b58a-0f191ba3745f} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid_local 2024.08.27 19:20:07.425953 [ 3 ] {35f235fc-dba9-407f-b58a-0f191ba3745f} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid_local 2024.08.27 19:20:07.432727 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.433084 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.437099 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=17, queue_size=17, entries=query-0000000000..query-0000000016, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000015, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:07.437158 [ 248 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000016 2024.08.27 19:20:07.437172 [ 248 ] {} DDLWorker: Checking task query-0000000016 2024.08.27 19:20:07.439157 [ 248 ] {} DDLWorker: Processing task query-0000000016 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30)) 2024.08.27 19:20:07.453434 [ 248 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:07.453943 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 35f235fc-dba9-407f-b58a-0f191ba3745f) /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) (stage: Complete) 2024.08.27 19:20:07.458148 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Loading data parts 2024.08.27 19:20:07.459171 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): There are no data parts 2024.08.27 19:20:07.464783 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): This table /clickhouse/tables/1/fields_uuid_local is already created, will add new replica 2024.08.27 19:20:07.471480 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Creating replica /clickhouse/tables/1/fields_uuid_local/replicas/3 2024.08.27 19:20:07.507474 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Creating shared ID for table oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) 2024.08.27 19:20:07.508117 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Initializing table shared ID with a9e89244-7177-439d-9410-6c84872c1664 2024.08.27 19:20:07.509568 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Starting up table 2024.08.27 19:20:07.510046 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Became leader 2024.08.27 19:20:07.510076 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:07.510116 [ 109 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.08.27 19:20:07.510190 [ 109 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:07.517949 [ 109 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.08.27 19:20:07.517988 [ 109 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.08.27 19:20:07.518025 [ 109 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Will mimic 1 2024.08.27 19:20:07.529781 [ 109 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Queued 1 parts to be fetched, 0 parts ignored 2024.08.27 19:20:07.529822 [ 109 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Copied 0 queue entries, 0 entries ignored 2024.08.27 19:20:07.530246 [ 109 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Parts in ZooKeeper after mimic: 2024.08.27 19:20:07.530303 [ 109 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Enqueued fetches after mimic: all_0_0_0 2024.08.27 19:20:07.533578 [ 109 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:07.534170 [ 109 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:07.534208 [ 109 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/3/queue 2024.08.27 19:20:07.534584 [ 109 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:07.534989 [ 109 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.08.27 19:20:07.539375 [ 109 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:07.542824 [ 109 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:07.542942 [ 143 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 6593ms 2024.08.27 19:20:07.543215 [ 248 ] {aa898f06-93c6-49c6-b801-0faccb91de2e} DDLWorker: Executed query: /* ddl_entry=query-0000000016 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid_local UUID 'af987f8a-6ad4-4eb1-9f4c-341572c583d8' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/fields_uuid_local', '{replica}') ORDER BY (timeseries_name, field_name, field_value, timeseries_key) TTL last_updated_at + toIntervalDay(30) 2024.08.27 19:20:07.547946 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.548632 [ 137 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks 2024.08.27 19:20:07.549459 [ 209 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Fetching part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1 2024.08.27 19:20:07.550113 [ 209 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.08.27 19:20:07.552043 [ 209 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:07.552117 [ 209 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:07.552241 [ 209 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:07.552343 [ 209 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.08.27 19:20:07.555112 [ 209 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.08.27 19:20:07.555187 [ 209 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:07.555311 [ 209 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Committing part all_0_0_0 to zookeeper 2024.08.27 19:20:07.561731 [ 209 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Part all_0_0_0 committed to zookeeper 2024.08.27 19:20:07.561878 [ 209 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Fetched part all_0_0_0 from default:/clickhouse/tables/1/fields_uuid_local/replicas/1 2024.08.27 19:20:07.561980 [ 121 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue) 2024.08.27 19:20:07.562070 [ 121 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 8162ms 2024.08.27 19:20:07.596237 [ 3 ] {35f235fc-dba9-407f-b58a-0f191ba3745f} executeQuery: Read 3 rows, 141.00 B in 0.171069 sec., 17.53678340318819 rows/sec., 824.23 B/sec. 2024.08.27 19:20:07.596928 [ 3 ] {35f235fc-dba9-407f-b58a-0f191ba3745f} DynamicQueryHandler: Done processing query 2024.08.27 19:20:07.597188 [ 3 ] {35f235fc-dba9-407f-b58a-0f191ba3745f} MemoryTracker: Peak memory usage (for query): 4.95 MiB. 2024.08.27 19:20:07.597215 [ 3 ] {} HTTP-Session: 2eb42084-431e-4dd3-b5f1-c637e072a951 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.598006 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 229, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:07.598106 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:07.598157 [ 3 ] {} HTTP-Session: e0ffc06c-1e82-4274-af19-71047c55b3ca Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:07.598228 [ 3 ] {} HTTP-Session: e0ffc06c-1e82-4274-af19-71047c55b3ca Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.598242 [ 3 ] {} HTTP-Session: e0ffc06c-1e82-4274-af19-71047c55b3ca Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.598308 [ 3 ] {} HTTP-Session: e0ffc06c-1e82-4274-af19-71047c55b3ca Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:07.598833 [ 3 ] {6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8} executeQuery: (from [::1]:37610) CREATE TABLE IF NOT EXISTS oximeter.fields_uuid ON CLUSTER oximeter_cluster AS oximeter.fields_uuid_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.598907 [ 3 ] {6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid 2024.08.27 19:20:07.598922 [ 3 ] {6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:07.598935 [ 3 ] {6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:07.599084 [ 3 ] {6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.fields_uuid 2024.08.27 19:20:07.599106 [ 3 ] {6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:07.609188 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.609230 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.616335 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=18, queue_size=18, entries=query-0000000000..query-0000000017, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000016, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:07.616377 [ 248 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000017 2024.08.27 19:20:07.616387 [ 248 ] {} DDLWorker: Checking task query-0000000017 2024.08.27 19:20:07.620030 [ 248 ] {} DDLWorker: Processing task query-0000000017 (CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:07.623108 [ 248 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.623418 [ 248 ] {0fcb1ae0-9de0-4085-b3f3-6bc7b39d50b2} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8) /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.625621 [ 248 ] {0fcb1ae0-9de0-4085-b3f3-6bc7b39d50b2} StorageDistributed (fields_uuid): Auto-increment is 0 2024.08.27 19:20:07.627124 [ 248 ] {0fcb1ae0-9de0-4085-b3f3-6bc7b39d50b2} DDLWorker: Executed query: /* ddl_entry=query-0000000017 */ CREATE TABLE IF NOT EXISTS oximeter.fields_uuid UUID '2b52b8a3-b685-4132-829f-3e585cb8fc0c' (`timeseries_name` String, `timeseries_key` UInt64, `field_name` String, `field_value` UUID, `last_updated_at` DateTime MATERIALIZED now()) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'fields_uuid_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.633183 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.726482 [ 3 ] {6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8} executeQuery: Read 3 rows, 141.00 B in 0.128048 sec., 23.42871423216294 rows/sec., 1.08 KiB/sec. 2024.08.27 19:20:07.727239 [ 3 ] {6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8} DynamicQueryHandler: Done processing query 2024.08.27 19:20:07.727305 [ 3 ] {6d0c1870-8e29-4f27-a2ef-a5d0c53a03e8} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.08.27 19:20:07.727351 [ 3 ] {} HTTP-Session: e0ffc06c-1e82-4274-af19-71047c55b3ca Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.728783 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 1525, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:07.729955 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:07.730087 [ 3 ] {} HTTP-Session: 4c04a274-0e59-43f6-b2ae-937d393c1c88 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:07.730173 [ 3 ] {} HTTP-Session: 4c04a274-0e59-43f6-b2ae-937d393c1c88 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.730189 [ 3 ] {} HTTP-Session: 4c04a274-0e59-43f6-b2ae-937d393c1c88 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.731404 [ 3 ] {} HTTP-Session: 4c04a274-0e59-43f6-b2ae-937d393c1c88 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:07.732274 [ 3 ] {6d401fb3-1fb6-4626-9ac6-8c45c8759efc} executeQuery: (from [::1]:37610) /* The timeseries schema table stores the extracted schema for the samples * oximeter collects. */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local ON CLUSTER oximeter_cluster ( timeseries_name String, fields Nested( name String, type Enum( 'Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13 ), source Enum( 'Target' = 1, 'Metric' = 2 ) ), datum_type Enum( 'Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27 ), created DateTime64(9, 'UTC') ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) 2024.08.27 19:20:07.732609 [ 3 ] {6d401fb3-1fb6-4626-9ac6-8c45c8759efc} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema_local 2024.08.27 19:20:07.733876 [ 3 ] {6d401fb3-1fb6-4626-9ac6-8c45c8759efc} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema_local 2024.08.27 19:20:07.743040 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.743142 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.743785 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=19, queue_size=19, entries=query-0000000000..query-0000000018, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000017, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:07.743879 [ 248 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000018 2024.08.27 19:20:07.743901 [ 248 ] {} DDLWorker: Checking task query-0000000018 2024.08.27 19:20:07.756233 [ 248 ] {} DDLWorker: Processing task query-0000000018 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name)) 2024.08.27 19:20:07.763883 [ 248 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.08.27 19:20:07.764787 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: 6d401fb3-1fb6-4626-9ac6-8c45c8759efc) /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) (stage: Complete) 2024.08.27 19:20:07.768114 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Loading data parts 2024.08.27 19:20:07.769079 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): There are no data parts 2024.08.27 19:20:07.773237 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): This table /clickhouse/tables/1/timeseries_schema_local is already created, will add new replica 2024.08.27 19:20:07.776900 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Creating replica /clickhouse/tables/1/timeseries_schema_local/replicas/3 2024.08.27 19:20:07.832144 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Creating shared ID for table oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) 2024.08.27 19:20:07.832597 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Initializing table shared ID with 95e71a20-0d77-40b6-ae4f-41a6e9863749 2024.08.27 19:20:07.835441 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Starting up table 2024.08.27 19:20:07.836343 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Became leader 2024.08.27 19:20:07.836365 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:07.836446 [ 121 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Activating replica. 2024.08.27 19:20:07.836466 [ 121 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:07.842143 [ 121 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Replica 2 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.08.27 19:20:07.842187 [ 121 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Replica 1 has log pointer '1', approximate 0 queue lag and 0 queue size 2024.08.27 19:20:07.842198 [ 121 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Will mimic 2 2024.08.27 19:20:07.851339 [ 121 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Queued 1 parts to be fetched, 0 parts ignored 2024.08.27 19:20:07.851479 [ 121 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Copied 0 queue entries, 0 entries ignored 2024.08.27 19:20:07.851958 [ 121 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Parts in ZooKeeper after mimic: 2024.08.27 19:20:07.851974 [ 121 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Enqueued fetches after mimic: all_0_0_0 2024.08.27 19:20:07.854964 [ 121 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:07.855412 [ 121 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:07.855441 [ 121 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/3/queue 2024.08.27 19:20:07.855849 [ 121 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 1 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:07.856410 [ 121 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_0_0_0] 2024.08.27 19:20:07.860424 [ 121 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:07.863468 [ 121 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:07.863539 [ 100 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 6063ms 2024.08.27 19:20:07.864037 [ 248 ] {8f359e17-99f4-4740-a374-62e74c1c1ab9} DDLWorker: Executed query: /* ddl_entry=query-0000000018 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema_local UUID 'f78ecec7-9835-47c4-8a33-cd49a508881e' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/timeseries_schema_local', '{replica}') ORDER BY (timeseries_name, fields.name) 2024.08.27 19:20:07.867102 [ 143 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/timeseries_schema_local/blocks 2024.08.27 19:20:07.867231 [ 229 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Fetching part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/1 2024.08.27 19:20:07.867632 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:07.868148 [ 229 ] {} ReadWriteBufferFromHTTP: Sending request to http://[::1]:19401/?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ftimeseries_schema_local%2Freplicas%2F1&part=all_0_0_0&client_protocol_version=8&compress=false 2024.08.27 19:20:07.869719 [ 229 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:07.869776 [ 229 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:07.869810 [ 229 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (Fetcher): Disk for fetch is not provided, getting disk from reservation default with type 'local' 2024.08.27 19:20:07.869842 [ 229 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (Fetcher): Downloading part all_0_0_0 onto disk default. 2024.08.27 19:20:07.872410 [ 229 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (Fetcher): Download of part all_0_0_0 onto disk default finished. 2024.08.27 19:20:07.872467 [ 229 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Renaming temporary part tmp-fetch_all_0_0_0 to all_0_0_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:07.872578 [ 229 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Committing part all_0_0_0 to zookeeper 2024.08.27 19:20:07.878507 [ 229 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Part all_0_0_0 committed to zookeeper 2024.08.27 19:20:07.878575 [ 229 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Fetched part all_0_0_0 from default:/clickhouse/tables/1/timeseries_schema_local/replicas/1 2024.08.27 19:20:07.878680 [ 143 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue) 2024.08.27 19:20:07.878748 [ 143 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 7318ms 2024.08.27 19:20:07.889576 [ 3 ] {6d401fb3-1fb6-4626-9ac6-8c45c8759efc} executeQuery: Read 3 rows, 141.00 B in 0.157876 sec., 19.0022549342522 rows/sec., 893.11 B/sec. 2024.08.27 19:20:07.890398 [ 3 ] {6d401fb3-1fb6-4626-9ac6-8c45c8759efc} DynamicQueryHandler: Done processing query 2024.08.27 19:20:07.890466 [ 3 ] {6d401fb3-1fb6-4626-9ac6-8c45c8759efc} MemoryTracker: Peak memory usage (for query): 5.93 MiB. 2024.08.27 19:20:07.890489 [ 3 ] {} HTTP-Session: 4c04a274-0e59-43f6-b2ae-937d393c1c88 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.892459 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 247, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:07.892639 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:07.892677 [ 3 ] {} HTTP-Session: c2680f76-b95b-41c2-94d6-3ce5ad3b450d Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:07.892713 [ 3 ] {} HTTP-Session: c2680f76-b95b-41c2-94d6-3ce5ad3b450d Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.892754 [ 3 ] {} HTTP-Session: c2680f76-b95b-41c2-94d6-3ce5ad3b450d Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:07.892985 [ 3 ] {} HTTP-Session: c2680f76-b95b-41c2-94d6-3ce5ad3b450d Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:07.894118 [ 3 ] {d848e6a3-a4e5-4966-94fc-a41a0fa3e828} executeQuery: (from [::1]:37610) CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema ON CLUSTER oximeter_cluster AS oximeter.timeseries_schema_local ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.894237 [ 3 ] {d848e6a3-a4e5-4966-94fc-a41a0fa3e828} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema 2024.08.27 19:20:07.894260 [ 3 ] {d848e6a3-a4e5-4966-94fc-a41a0fa3e828} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:07.894292 [ 3 ] {d848e6a3-a4e5-4966-94fc-a41a0fa3e828} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:07.894792 [ 3 ] {d848e6a3-a4e5-4966-94fc-a41a0fa3e828} ContextAccess (default): Access granted: CREATE TABLE ON oximeter.timeseries_schema 2024.08.27 19:20:07.894826 [ 3 ] {d848e6a3-a4e5-4966-94fc-a41a0fa3e828} ContextAccess (default): Access granted: REMOTE ON *.* 2024.08.27 19:20:07.902617 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:07.902716 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:07.906664 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000018, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:07.906695 [ 248 ] {} DDLWorker: Will schedule 1 tasks starting from query-0000000019 2024.08.27 19:20:07.906731 [ 248 ] {} DDLWorker: Checking task query-0000000019 2024.08.27 19:20:07.914984 [ 248 ] {} DDLWorker: Processing task query-0000000019 (CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1]))) 2024.08.27 19:20:07.923860 [ 248 ] {} DDLWorker: Executing query: CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.924340 [ 248 ] {7f7ef255-1a46-495f-9cb8-90330b2394ee} executeQuery: (from 0.0.0.0:0, user: , initial_query_id: d848e6a3-a4e5-4966-94fc-a41a0fa3e828) /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) (stage: Complete) 2024.08.27 19:20:07.925650 [ 248 ] {7f7ef255-1a46-495f-9cb8-90330b2394ee} StorageDistributed (timeseries_schema): Auto-increment is 0 2024.08.27 19:20:07.927679 [ 248 ] {7f7ef255-1a46-495f-9cb8-90330b2394ee} DDLWorker: Executed query: /* ddl_entry=query-0000000019 */ CREATE TABLE IF NOT EXISTS oximeter.timeseries_schema UUID 'fadb2a5d-ad97-4b5c-bce4-6397d5f9323d' (`timeseries_name` String, `fields.name` Array(String), `fields.type` Array(Enum8('Bool' = 1, 'I64' = 2, 'IpAddr' = 3, 'String' = 4, 'Uuid' = 6, 'I8' = 7, 'U8' = 8, 'I16' = 9, 'U16' = 10, 'I32' = 11, 'U32' = 12, 'U64' = 13)), `fields.source` Array(Enum8('Target' = 1, 'Metric' = 2)), `datum_type` Enum8('Bool' = 1, 'I64' = 2, 'F64' = 3, 'String' = 4, 'Bytes' = 5, 'CumulativeI64' = 6, 'CumulativeF64' = 7, 'HistogramI64' = 8, 'HistogramF64' = 9, 'I8' = 10, 'U8' = 11, 'I16' = 12, 'U16' = 13, 'I32' = 14, 'U32' = 15, 'U64' = 16, 'F32' = 17, 'CumulativeU64' = 18, 'CumulativeF32' = 19, 'HistogramI8' = 20, 'HistogramU8' = 21, 'HistogramI16' = 22, 'HistogramU16' = 23, 'HistogramI32' = 24, 'HistogramU32' = 25, 'HistogramU64' = 26, 'HistogramF32' = 27), `created` DateTime64(9, 'UTC')) ENGINE = Distributed('oximeter_cluster', 'oximeter', 'timeseries_schema_local', xxHash64(splitByChar(':', timeseries_name)[1])) 2024.08.27 19:20:07.931528 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:08.013786 [ 3 ] {d848e6a3-a4e5-4966-94fc-a41a0fa3e828} executeQuery: Read 3 rows, 141.00 B in 0.120438 sec., 24.909081851242963 rows/sec., 1.14 KiB/sec. 2024.08.27 19:20:08.014516 [ 3 ] {d848e6a3-a4e5-4966-94fc-a41a0fa3e828} DynamicQueryHandler: Done processing query 2024.08.27 19:20:08.014549 [ 3 ] {d848e6a3-a4e5-4966-94fc-a41a0fa3e828} MemoryTracker: Peak memory usage (for query): 3.98 MiB. 2024.08.27 19:20:08.014567 [ 3 ] {} HTTP-Session: c2680f76-b95b-41c2-94d6-3ce5ad3b450d Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:08.017691 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 60, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:08.017796 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:08.017815 [ 3 ] {} HTTP-Session: 355db7d2-8762-46bd-85f1-ed91f5737770 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:08.017837 [ 3 ] {} HTTP-Session: 355db7d2-8762-46bd-85f1-ed91f5737770 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:08.017861 [ 3 ] {} HTTP-Session: 355db7d2-8762-46bd-85f1-ed91f5737770 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:08.017910 [ 3 ] {} HTTP-Session: 355db7d2-8762-46bd-85f1-ed91f5737770 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:08.018118 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} executeQuery: (from [::1]:37610) SELECT * FROM oximeter.timeseries_schema FORMAT JSONEachRow; (stage: Complete) 2024.08.27 19:20:08.018665 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema 2024.08.27 19:20:08.019024 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema 2024.08.27 19:20:08.019679 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} ContextAccess (default): Access granted: SELECT(timeseries_name, `fields.name`, `fields.type`, `fields.source`, datum_type, created) ON oximeter.timeseries_schema_local 2024.08.27 19:20:08.019969 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:08.020259 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:08.020885 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (SelectExecutor): Key condition: unknown 2024.08.27 19:20:08.020984 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.08.27 19:20:08.021044 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:08.021135 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 1 rows starting from 0 2024.08.27 19:20:08.025324 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} executeQuery: Read 1 rows, 126.00 B in 0.007279 sec., 137.38150844896276 rows/sec., 16.90 KiB/sec. 2024.08.27 19:20:08.026813 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} DynamicQueryHandler: Done processing query 2024.08.27 19:20:08.026847 [ 3 ] {85af7bc2-d661-4c86-b646-8cc870a4095f} MemoryTracker: Peak memory usage (for query): 4.00 MiB. 2024.08.27 19:20:08.026864 [ 3 ] {} HTTP-Session: 355db7d2-8762-46bd-85f1-ed91f5737770 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:08.029076 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:08.029474 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:08.029505 [ 3 ] {} HTTP-Session: 7c1b5d79-b8ec-4312-b79d-4e0498677285 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:08.029559 [ 3 ] {} HTTP-Session: 7c1b5d79-b8ec-4312-b79d-4e0498677285 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:08.029610 [ 3 ] {} HTTP-Session: 7c1b5d79-b8ec-4312-b79d-4e0498677285 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:08.029693 [ 3 ] {} HTTP-Session: 7c1b5d79-b8ec-4312-b79d-4e0498677285 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:08.030870 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} executeQuery: (from [::1]:37610) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:08.033183 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:08.034959 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:08.037099 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:08.038486 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:08.046492 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:08.046951 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e6158f0) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:08.046997 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e6158f0) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:08.047241 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e6158f0) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.08.27 19:20:08.047917 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:08.048832 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:08.048983 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e615320) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:08.049015 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e615320) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:08.049992 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:08.050425 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:08.050879 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:08.050923 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:08.051179 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.08.27 19:20:08.051260 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:08.051320 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:08.051422 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e653050) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0) 2024.08.27 19:20:08.051436 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e653050) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)] 2024.08.27 19:20:08.052005 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:08.052829 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:08.053191 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:08.053552 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:08.053588 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:08.053827 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.08.27 19:20:08.053932 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:08.054016 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:08.054144 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e6fcc90) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:08.054187 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e6fcc90) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:08.054388 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e615320) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.08.27 19:20:08.055075 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:08.055650 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:08.056207 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:08.056258 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:08.056590 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.08.27 19:20:08.056720 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:08.056828 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:08.056851 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:08.056893 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.08.27 19:20:08.057119 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:08.057211 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:08.057286 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:08.057326 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.08.27 19:20:08.058543 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:08.058659 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:08.058869 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:08.058912 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:08.058927 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:08.058962 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.08.27 19:20:08.058993 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:08.059238 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:08.059288 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 8 rows starting from 0 2024.08.27 19:20:08.059725 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:08.059784 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:08.059829 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:08.059858 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.08.27 19:20:08.059874 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:08.059930 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.08.27 19:20:08.059998 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:08.060312 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:08.060345 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0 2024.08.27 19:20:08.060495 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.08.27 19:20:08.060534 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:08.060680 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:08.060710 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:08.060731 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:08.060742 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:08.060757 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:08.060782 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.08.27 19:20:08.060795 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:08.060888 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:08.060908 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 16 rows starting from 0 2024.08.27 19:20:08.060983 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:08.061010 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.08.27 19:20:08.065058 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} executeQuery: Read 40 rows, 2.89 KiB in 0.034711 sec., 1152.3724467747977 rows/sec., 83.28 KiB/sec. 2024.08.27 19:20:08.065255 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e6fcc90) Join data is being destroyed, 12800 bytes and 8 rows in hash table 2024.08.27 19:20:08.065381 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} HashJoin: (0x1e653050) Join data is being destroyed, 12544 bytes and 8 rows in hash table 2024.08.27 19:20:08.066215 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} DynamicQueryHandler: Done processing query 2024.08.27 19:20:08.066247 [ 3 ] {b303ea62-1220-4746-928e-6fc20e341fbd} MemoryTracker: Peak memory usage (for query): 4.00 MiB. 2024.08.27 19:20:08.066275 [ 3 ] {} HTTP-Session: 7c1b5d79-b8ec-4312-b79d-4e0498677285 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:08.067597 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 409, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:08.067691 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:08.067716 [ 3 ] {} HTTP-Session: 42024ec7-261f-4da3-bec7-9ba1ac60fcb4 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:08.067741 [ 3 ] {} HTTP-Session: 42024ec7-261f-4da3-bec7-9ba1ac60fcb4 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:08.067752 [ 3 ] {} HTTP-Session: 42024ec7-261f-4da3-bec7-9ba1ac60fcb4 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:08.067814 [ 3 ] {} HTTP-Session: 42024ec7-261f-4da3-bec7-9ba1ac60fcb4 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:08.068667 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} executeQuery: (from [::1]:37610) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (627643266003148065,4866144566314509062,5109363932695672526,6133729158133445591,6418373900407287174,7614030865733607559,9495597746874019221,15640909565249536871)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:08.069905 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.08.27 19:20:08.071009 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.08.27 19:20:08.071681 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:08.071731 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (627643266003148065, 4866144566314509062, 5109363932695672526, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 15640909565249536871)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:08.072170 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local 2024.08.27 19:20:08.072275 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:08.072401 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:08.072951 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (SelectExecutor): Key condition: (column 1 in 8-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:08.073076 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps 2024.08.27 19:20:08.073123 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (SelectExecutor): Selected 1/1 parts by partition key, 1 parts by primary key, 1/1 marks by primary key, 1 marks to read from 1 ranges 2024.08.27 19:20:08.073141 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (SelectExecutor): Spreading ranges among streams with order 2024.08.27 19:20:08.073311 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (627643266003148065, 4866144566314509062, 5109363932695672526, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 15640909565249536871))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:08.073339 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 2024.08.27 19:20:08.076409 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} executeQuery: Read 400 rows, 25.78 KiB in 0.008309 sec., 48140.570465760014 rows/sec., 3.03 MiB/sec. 2024.08.27 19:20:08.077602 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} DynamicQueryHandler: Done processing query 2024.08.27 19:20:08.077642 [ 3 ] {e50669fc-097c-45c7-9551-3c01b6003dee} MemoryTracker: Peak memory usage (for query): 3.99 MiB. 2024.08.27 19:20:08.077659 [ 3 ] {} HTTP-Session: 42024ec7-261f-4da3-bec7-9ba1ac60fcb4 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.000698 [ 244 ] {} AsynchronousMetrics: MemoryTracking: was 106.61 MiB, peak 113.50 MiB, free memory in arenas 0.00 B, will set to 111.01 MiB (RSS), difference: 4.40 MiB 2024.08.27 19:20:09.097559 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 1032, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:09.097728 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:09.097772 [ 3 ] {} HTTP-Session: 8f01c568-b3f7-41fa-af13-4159f3894ffb Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:09.097800 [ 3 ] {} HTTP-Session: 8f01c568-b3f7-41fa-af13-4159f3894ffb Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.097813 [ 3 ] {} HTTP-Session: 8f01c568-b3f7-41fa-af13-4159f3894ffb Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.097889 [ 3 ] {} HTTP-Session: 8f01c568-b3f7-41fa-af13-4159f3894ffb Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:09.098294 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} executeQuery: (from [::1]:37610) INSERT INTO oximeter.fields_i64 FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:09.098439 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.099105 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} ParallelParsingInputFormat: Parallel parsing is used 2024.08.27 19:20:09.100331 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.08.27 19:20:09.101991 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:09.102078 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:09.102982 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} MergedBlockOutputStream: filled checksums all_1_1_0 (state Temporary) 2024.08.27 19:20:09.103578 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (Replicated OutputStream): Wrote block with ID 'all_15739620614661294925_10102116574324921387', 8 rows 2024.08.27 19:20:09.107723 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:09.112536 [ 105 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807713280, merge_with_ttl_allowedtrue) 2024.08.27 19:20:09.112589 [ 105 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 10435ms 2024.08.27 19:20:09.112849 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} executeQuery: Read 8 rows, 512.00 B in 0.014682 sec., 544.8848930663397 rows/sec., 34.06 KiB/sec. 2024.08.27 19:20:09.113367 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} DynamicQueryHandler: Done processing query 2024.08.27 19:20:09.113465 [ 3 ] {ca02ae71-f94f-419f-b43a-fb13fea5ff8f} MemoryTracker: Peak memory usage (for query): 4.27 MiB. 2024.08.27 19:20:09.113490 [ 3 ] {} HTTP-Session: 8f01c568-b3f7-41fa-af13-4159f3894ffb Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.114068 [ 123 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.08.27 19:20:09.115056 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 2678, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:09.115182 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:09.115209 [ 3 ] {} HTTP-Session: 7b245fda-5a58-479b-8063-e8c2c6dfd159 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:09.115229 [ 3 ] {} HTTP-Session: 7b245fda-5a58-479b-8063-e8c2c6dfd159 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.115245 [ 3 ] {} HTTP-Session: 7b245fda-5a58-479b-8063-e8c2c6dfd159 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.115345 [ 3 ] {} HTTP-Session: 7b245fda-5a58-479b-8063-e8c2c6dfd159 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:09.115627 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} executeQuery: (from [::1]:37610) INSERT INTO oximeter.fields_uuid FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:09.115788 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.116594 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} ParallelParsingInputFormat: Parallel parsing is used 2024.08.27 19:20:09.117582 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.08.27 19:20:09.118488 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:09.118584 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:09.119434 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} MergedBlockOutputStream: filled checksums all_1_1_0 (state Temporary) 2024.08.27 19:20:09.120151 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (Replicated OutputStream): Wrote block with ID 'all_9411880981918726155_778612520008162082', 16 rows 2024.08.27 19:20:09.122745 [ 123 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.08.27 19:20:09.122799 [ 123 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:09.125548 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:09.129577 [ 5 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:40616, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:09.129719 [ 5 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.08.27 19:20:09.129770 [ 5 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (Replicated PartsService): Sending part all_1_1_0 2024.08.27 19:20:09.130595 [ 5 ] {} InterserverIOHTTPHandler: Done processing query 2024.08.27 19:20:09.148674 [ 105 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71807512576, merge_with_ttl_allowedtrue) 2024.08.27 19:20:09.148711 [ 105 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 10635ms 2024.08.27 19:20:09.149923 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} executeQuery: Read 16 rows, 1.20 KiB in 0.034411 sec., 464.96759757054434 rows/sec., 34.74 KiB/sec. 2024.08.27 19:20:09.150610 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} DynamicQueryHandler: Done processing query 2024.08.27 19:20:09.150640 [ 3 ] {294dd144-8072-4061-81ed-db75dd8ae351} MemoryTracker: Peak memory usage (for query): 4.27 MiB. 2024.08.27 19:20:09.150656 [ 3 ] {} HTTP-Session: 7b245fda-5a58-479b-8063-e8c2c6dfd159 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.160017 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 74637, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:09.160830 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:09.161165 [ 3 ] {} HTTP-Session: b45565b1-9287-4a03-a655-ee18883188a1 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:09.161201 [ 3 ] {} HTTP-Session: b45565b1-9287-4a03-a655-ee18883188a1 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.161216 [ 3 ] {} HTTP-Session: b45565b1-9287-4a03-a655-ee18883188a1 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.161767 [ 3 ] {} HTTP-Session: b45565b1-9287-4a03-a655-ee18883188a1 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:09.162572 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} executeQuery: (from [::1]:37610) INSERT INTO oximeter.measurements_cumulativef64 FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:09.162665 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.08.27 19:20:09.162796 [ 100 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.08.27 19:20:09.163047 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} ParallelParsingInputFormat: Parallel parsing is used 2024.08.27 19:20:09.168082 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local 2024.08.27 19:20:09.170383 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:09.170519 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:09.172375 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} MergedBlockOutputStream: filled checksums all_1_1_0 (state Temporary) 2024.08.27 19:20:09.173248 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (Replicated OutputStream): Wrote block with ID 'all_11255894017954617061_18162384509904755242', 400 rows 2024.08.27 19:20:09.180219 [ 100 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.08.27 19:20:09.180269 [ 100 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:09.192768 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:09.199188 [ 123 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:09.199227 [ 123 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 9882ms 2024.08.27 19:20:09.199840 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} executeQuery: Read 400 rows, 25.78 KiB in 0.037685 sec., 10614.302772986599 rows/sec., 684.12 KiB/sec. 2024.08.27 19:20:09.200045 [ 5 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:40616, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:09.200245 [ 5 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_uuid_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.08.27 19:20:09.200282 [ 5 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (Replicated PartsService): Sending part all_1_1_0 2024.08.27 19:20:09.200515 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} DynamicQueryHandler: Done processing query 2024.08.27 19:20:09.200579 [ 3 ] {4c4531ba-3097-44a8-972f-3ffb2de82fcb} MemoryTracker: Peak memory usage (for query): 4.47 MiB. 2024.08.27 19:20:09.200656 [ 3 ] {} HTTP-Session: b45565b1-9287-4a03-a655-ee18883188a1 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.200972 [ 105 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000001 - log-0000000001 2024.08.27 19:20:09.201655 [ 5 ] {} InterserverIOHTTPHandler: Done processing query 2024.08.27 19:20:09.209462 [ 105 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000001 to queue with type GET_PART with virtual parts [all_1_1_0] 2024.08.27 19:20:09.209546 [ 105 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:09.213415 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 919, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:09.214159 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:09.214208 [ 3 ] {} HTTP-Session: f0690990-1089-4b00-88ad-fecf61eddb38 Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:09.214238 [ 3 ] {} HTTP-Session: f0690990-1089-4b00-88ad-fecf61eddb38 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.214253 [ 3 ] {} HTTP-Session: f0690990-1089-4b00-88ad-fecf61eddb38 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.214383 [ 3 ] {} HTTP-Session: f0690990-1089-4b00-88ad-fecf61eddb38 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:09.215179 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} executeQuery: (from [::1]:37610) SELECT filter_on_cpu_id.timeseries_key AS timeseries_key, filter_on_cpu_id.field_value AS cpu_id, filter_on_instance_id.field_value AS instance_id, filter_on_project_id.field_value AS project_id FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'cpu_id' ) AS filter_on_cpu_id INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'instance_id' ) AS filter_on_instance_id ON filter_on_instance_id.timeseries_key = filter_on_cpu_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'virtual_machine:cpu_busy' AND field_name = 'project_id' ) AS filter_on_project_id ON filter_on_project_id.timeseries_key = filter_on_instance_id.timeseries_key FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:09.216049 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.217684 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.218661 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.219823 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.220236 [ 5 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:40616, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:09.220332 [ 5 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Fmeasurements_cumulativef64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.08.27 19:20:09.220358 [ 5 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (Replicated PartsService): Sending part all_1_1_0 2024.08.27 19:20:09.221303 [ 5 ] {} InterserverIOHTTPHandler: Done processing query 2024.08.27 19:20:09.222559 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.223423 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e6efda0) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:09.223499 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e6efda0) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:09.223769 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e6efda0) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.08.27 19:20:09.225093 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.226524 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.226759 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e704b70) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:09.226886 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e704b70) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:09.228406 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.228861 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.230214 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:09.230249 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'project_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:09.230498 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.08.27 19:20:09.230584 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.230651 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:09.230829 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e6ffcc0) Datatype: EMPTY, kind: Inner, strictness: All, right header: timeseries_key UInt64 UInt64(size = 0), field_value UUID UUID(size = 0) 2024.08.27 19:20:09.230852 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e6ffcc0) Keys: [(--filter_on_instance_id.timeseries_key) = (timeseries_key)] 2024.08.27 19:20:09.231925 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.233840 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.234475 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:09.234907 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:09.234947 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'instance_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:09.235189 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.08.27 19:20:09.235271 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.235337 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:09.236275 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e42ce30) Datatype: EMPTY, kind: Inner, strictness: All, right header: filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0) 2024.08.27 19:20:09.236300 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e42ce30) Keys: [(timeseries_key) = (--filter_on_instance_id.timeseries_key)] 2024.08.27 19:20:09.236623 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e704b70) Join data is being destroyed, 12288 bytes and 0 rows in hash table 2024.08.27 19:20:09.237171 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.237766 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:09.238231 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:09.238270 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(field_name = 'cpu_id') AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:09.238526 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.08.27 19:20:09.238649 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.238738 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:09.238757 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.238786 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.08.27 19:20:09.238821 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.238862 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.238893 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.238923 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.239522 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Key condition: (column 1 in ['cpu_id', 'cpu_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:09.239691 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:09.239710 [ 256 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.08.27 19:20:09.239731 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.239767 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:09.239779 [ 256 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.239793 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.239805 [ 256 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:09.239827 [ 256 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.239990 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.08.27 19:20:09.240024 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:09.240409 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.08.27 19:20:09.240450 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (SelectExecutor): Reading approx. 16 rows with 2 streams 2024.08.27 19:20:09.240537 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.240699 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'cpu_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.240897 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Key condition: (column 1 in ['instance_id', 'instance_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:09.241030 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.08.27 19:20:09.241060 [ 256 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:09.241071 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.241110 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.08.27 19:20:09.241123 [ 256 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.241138 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.241148 [ 256 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (RIGHT) boundary mark: 1 2024.08.27 19:20:09.241170 [ 256 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.241310 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.08.27 19:20:09.241342 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:09.241621 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.08.27 19:20:09.241657 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Reading approx. 32 rows with 2 streams 2024.08.27 19:20:09.241870 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.242145 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'instance_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.242373 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} JoiningTransform: Before join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0)' 2024.08.27 19:20:09.242435 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} JoiningTransform: After join block: 'timeseries_key UInt64 UInt64(size = 0), field_value Int64 Int64(size = 0), filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.242854 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Key condition: (column 1 in ['project_id', 'project_id']), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:09.243107 [ 259 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Running binary search on index range for part all_0_0_0 (2 marks) 2024.08.27 19:20:09.243163 [ 259 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.243190 [ 259 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:09.243209 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Running binary search on index range for part all_1_1_0 (2 marks) 2024.08.27 19:20:09.243338 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (LEFT) boundary mark: 0 2024.08.27 19:20:09.243367 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found (RIGHT) boundary mark: 2 2024.08.27 19:20:09.243225 [ 259 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.243383 [ 257 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Found continuous range in 2 steps 2024.08.27 19:20:09.244669 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.08.27 19:20:09.244724 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Spreading mark ranges among streams (default reading) 2024.08.27 19:20:09.245098 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} MergeTreeReadPool: min_marks_for_concurrent_read=24 2024.08.27 19:20:09.245145 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (SelectExecutor): Reading approx. 32 rows with 2 streams 2024.08.27 19:20:09.245442 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.245543 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "equals(field_name, 'project_id')", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.245676 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} JoiningTransform: Before join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.245716 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} JoiningTransform: After join block: '--filter_on_cpu_id.field_value Int64 Int64(size = 0), --filter_on_cpu_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.timeseries_key UInt64 UInt64(size = 0), --filter_on_instance_id.field_value UUID UUID(size = 0), field_value UUID UUID(size = 0)' 2024.08.27 19:20:09.252604 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} executeQuery: Read 80 rows, 5.78 KiB in 0.037981 sec., 2106.3163160527633 rows/sec., 152.21 KiB/sec. 2024.08.27 19:20:09.254387 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e42ce30) Join data is being destroyed, 13312 bytes and 16 rows in hash table 2024.08.27 19:20:09.254815 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} HashJoin: (0x1e6ffcc0) Join data is being destroyed, 12800 bytes and 16 rows in hash table 2024.08.27 19:20:09.255816 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} DynamicQueryHandler: Done processing query 2024.08.27 19:20:09.255993 [ 3 ] {2f8962fb-7b1e-4b46-bb4a-63fde4fa8674} MemoryTracker: Peak memory usage (for query): 5.16 MiB. 2024.08.27 19:20:09.256034 [ 3 ] {} HTTP-Session: f0690990-1089-4b00-88ad-fecf61eddb38 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.258496 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 574, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:09.258618 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:09.258650 [ 3 ] {} HTTP-Session: 58c6647e-044b-46bf-aee5-6ca862b9a22c Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:09.258681 [ 3 ] {} HTTP-Session: 58c6647e-044b-46bf-aee5-6ca862b9a22c Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.258698 [ 3 ] {} HTTP-Session: 58c6647e-044b-46bf-aee5-6ca862b9a22c Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:09.258773 [ 3 ] {} HTTP-Session: 58c6647e-044b-46bf-aee5-6ca862b9a22c Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:09.259529 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} executeQuery: (from [::1]:37610) SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativef64 WHERE timeseries_name = 'virtual_machine:cpu_busy' AND (timeseries_key IN (627643266003148065,875477573237006945,4866144566314509062,5109363932695672526,5458299684297804759,6133729158133445591,6418373900407287174,7614030865733607559,9495597746874019221,10554623360235070440,15640909565249536871,15773007174814909684,16012973074142820055,16258445060165149256,17045523200003126967,18285850980281983665)) ORDER BY timeseries_key, start_time, timestamp LIMIT 1000001 FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:09.260803 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.08.27 19:20:09.261557 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64 2024.08.27 19:20:09.262098 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} InterpreterSelectQuery: The min valid primary key position for moving to the tail of PREWHERE is 1 2024.08.27 19:20:09.262144 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "(timeseries_key IN (627643266003148065, 875477573237006945, 4866144566314509062, 5109363932695672526, 5458299684297804759, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 10554623360235070440, 15640909565249536871, 15773007174814909684, 16012973074142820055, 16258445060165149256, 17045523200003126967, 18285850980281983665)) AND (timeseries_name = 'virtual_machine:cpu_busy')" moved to PREWHERE 2024.08.27 19:20:09.262818 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} ContextAccess (default): Access granted: SELECT(timeseries_name, timeseries_key, start_time, timestamp, datum) ON oximeter.measurements_cumulativef64_local 2024.08.27 19:20:09.262950 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} InterpreterSelectQuery: FetchColumns -> Complete 2024.08.27 19:20:09.263071 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} InterpreterSelectQuery: Complete -> Complete 2024.08.27 19:20:09.263343 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (SelectExecutor): Key condition: (column 1 in 16-element set), (column 0 in ['virtual_machine:cpu_busy', 'virtual_machine:cpu_busy']), and 2024.08.27 19:20:09.263575 [ 261 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (SelectExecutor): Used generic exclusion search over index for part all_0_0_0 with 1 steps 2024.08.27 19:20:09.263605 [ 257 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (SelectExecutor): Used generic exclusion search over index for part all_1_1_0 with 1 steps 2024.08.27 19:20:09.263782 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, 2/2 marks by primary key, 2 marks to read from 2 ranges 2024.08.27 19:20:09.263816 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (SelectExecutor): Spreading ranges among streams with order 2024.08.27 19:20:09.264095 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (627643266003148065, 875477573237006945, 4866144566314509062, 5109363932695672526, 5458299684297804759, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 10554623360235070440, 15640909565249536871, 15773007174814909684, 16012973074142820055, 16258445060165149256, 17045523200003126967, 18285850980281983665))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.264132 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_1_1_0, approx. 400 rows starting from 0 2024.08.27 19:20:09.264330 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} MergeTreeBaseSelectProcessor: PREWHERE condition was split into 2 steps: "in(timeseries_key, (627643266003148065, 875477573237006945, 4866144566314509062, 5109363932695672526, 5458299684297804759, 6133729158133445591, 6418373900407287174, 7614030865733607559, 9495597746874019221, 10554623360235070440, 15640909565249536871, 15773007174814909684, 16012973074142820055, 16258445060165149256, 17045523200003126967, 18285850980281983665))", "equals(timeseries_name, 'virtual_machine:cpu_busy')" 2024.08.27 19:20:09.264364 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part all_0_0_0, approx. 400 rows starting from 0 2024.08.27 19:20:09.267534 [ 261 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} MergingSortedTransform: Merge sorted 1 blocks, 800 rows in 0.002935075 sec., 272565.4369990545 rows/sec., 10.98 MiB/sec 2024.08.27 19:20:09.269242 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} executeQuery: Read 800 rows, 51.56 KiB in 0.010268 sec., 77911.95948578107 rows/sec., 4.90 MiB/sec. 2024.08.27 19:20:09.271803 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} DynamicQueryHandler: Done processing query 2024.08.27 19:20:09.271889 [ 3 ] {d02cbeb7-38cb-4cad-942d-d1543c8fc928} MemoryTracker: Peak memory usage (for query): 4.14 MiB. 2024.08.27 19:20:09.271913 [ 3 ] {} HTTP-Session: 58c6647e-044b-46bf-aee5-6ca862b9a22c Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:10.471335 [ 264 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:62703, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:10.471490 [ 264 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_1_1_0&client_protocol_version=8&compress=false 2024.08.27 19:20:10.471529 [ 264 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (Replicated PartsService): Sending part all_1_1_0 2024.08.27 19:20:10.472326 [ 264 ] {} InterserverIOHTTPHandler: Done processing query 2024.08.27 19:20:10.893422 [ 253 ] {} ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::Exception::Exception, std::allocator > >(int, FormatStringHelperImpl::type, std::type_identity, std::allocator > >::type>, unsigned long&, std::__cxx11::basic_string, std::allocator >&&) @ 0x000000000ac3631e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000ac360fa in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::receiveEvent() @ 0x0000000016bafed2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. Coordination::ZooKeeper::receiveThread() @ 0x0000000016baf7d8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. std::_Function_handler::ThreadFromGlobalPoolImpl > const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional >&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector > const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional >&&)::$_1&&)::{lambda()#1}>::_M_invoke(std::_Any_data const&) @ 0x0000000016bb4b98 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. ThreadPoolImpl::worker(std::_List_iterator) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32 9. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 (version 23.8.7.1) 2024.08.27 19:20:10.893528 [ 253 ] {} ZooKeeperClient: Finalizing session 6. finalization_started: false, queue_finished: false, reason: 'Exception in receiveThread' 2024.08.27 19:20:10.893691 [ 253 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:10.893747 [ 253 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:10.893776 [ 253 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:10.893782 [ 105 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:10.893809 [ 121 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:10.893859 [ 105 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/3/is_active since session has been expired 2024.08.27 19:20:10.893828 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:10.893891 [ 105 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Waiting for threads to finish 2024.08.27 19:20:10.893901 [ 121 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/is_active since session has been expired 2024.08.27 19:20:10.893910 [ 136 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/3/is_active since session has been expired 2024.08.27 19:20:10.893937 [ 121 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Waiting for threads to finish 2024.08.27 19:20:10.893947 [ 136 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Waiting for threads to finish 2024.08.27 19:20:10.894003 [ 253 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:10.894039 [ 253 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:10.894071 [ 117 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:10.894127 [ 108 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:10.894166 [ 117 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/3/is_active since session has been expired 2024.08.27 19:20:10.894211 [ 117 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Waiting for threads to finish 2024.08.27 19:20:10.894220 [ 108 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/3/is_active since session has been expired 2024.08.27 19:20:10.894261 [ 108 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Waiting for threads to finish 2024.08.27 19:20:10.894227 [ 253 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 134, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): (version 23.8.7.1) 2024.08.27 19:20:10.894473 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:10.894494 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:10.895096 [ 105 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Threads finished 2024.08.27 19:20:10.895140 [ 105 ] {} Context: Trying to establish a new connection with ZooKeeper 2024.08.27 19:20:10.895569 [ 108 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Threads finished 2024.08.27 19:20:10.899886 [ 105 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19003 with session_id 9 2024.08.27 19:20:10.900386 [ 105 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.08.27 19:20:10.900410 [ 105 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.08.27 19:20:10.900421 [ 105 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.08.27 19:20:10.900434 [ 105 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19002,[::1]:19003 2024.08.27 19:20:10.900451 [ 105 ] {} Context: Establishing a new connection with ZooKeeper took 5 ms 2024.08.27 19:20:10.900481 [ 105 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:10.900504 [ 108 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:10.902918 [ 117 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Threads finished 2024.08.27 19:20:10.903103 [ 117 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:10.903318 [ 121 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Threads finished 2024.08.27 19:20:10.903356 [ 121 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:10.903794 [ 136 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Threads finished 2024.08.27 19:20:10.903850 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:10.909260 [ 248 ] {} DDLWorker: Lost ZooKeeper connection, will try to connect again: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::Exception::Exception(int, char const (&) [16]) @ 0x000000000ffe19c6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x0000000016bb6e38 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x0000000016bb14ce in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. Coordination::ZooKeeper::list(std::__cxx11::basic_string, std::allocator > const&, Coordination::ListRequestType, std::function, std::shared_ptr >) @ 0x0000000016bb37d3 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(std::__cxx11::basic_string, std::allocator > const&, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b76078 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. zkutil::ZooKeeper::getChildrenImpl(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b75c75 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. zkutil::ZooKeeper::tryGetChildrenWatch(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr >, Coordination::ListRequestType) @ 0x0000000016b7679a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. zkutil::ZooKeeper::tryGetChildren(std::__cxx11::basic_string, std::allocator > const&, std::vector, std::allocator >, std::allocator, std::allocator > > >&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000016b762bf in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. zkutil::ZooKeeper::getChildren(std::__cxx11::basic_string, std::allocator > const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x0000000016b7618d in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::DDLWorker::scheduleTasks(bool) @ 0x0000000014ebf5c2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. DB::DDLWorker::runMainThread() @ 0x0000000014ebbf2e in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::{lambda()#1}::operator()() @ 0x0000000014ecd995 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. ThreadPoolImpl::worker(std::_List_iterator) @ 0x0000000019092c5c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. ? @ 0x000000000014d750 in /usr/gcc/13/lib/amd64/libstdc++.so.6.0.32 16. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 (version 23.8.7.1) 2024.08.27 19:20:10.918167 [ 105 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:10.918387 [ 108 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:10.928070 [ 105 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:10.928102 [ 105 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/3/queue 2024.08.27 19:20:10.928274 [ 108 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:10.928321 [ 108 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/3/queue 2024.08.27 19:20:10.937732 [ 108 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:10.937747 [ 105 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:10.937784 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:10.937837 [ 117 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:10.938194 [ 108 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:10.938213 [ 121 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:10.938237 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:10.938270 [ 105 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:10.938290 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/3/queue 2024.08.27 19:20:10.938656 [ 117 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:10.938714 [ 117 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/3/queue 2024.08.27 19:20:10.938861 [ 121 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:10.938900 [ 121 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/queue 2024.08.27 19:20:10.939223 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:10.939438 [ 121 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:10.939456 [ 117 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:10.939873 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:10.940104 [ 121 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:10.940121 [ 117 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:10.942901 [ 108 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:10.943244 [ 157 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:10.943319 [ 157 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 13821ms 2024.08.27 19:20:10.944285 [ 105 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:10.944358 [ 108 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 7545ms 2024.08.27 19:20:10.944987 [ 136 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:10.945139 [ 138 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:10.945202 [ 138 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 12889ms 2024.08.27 19:20:10.946484 [ 149 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_uuid_local/blocks 2024.08.27 19:20:10.946520 [ 121 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:10.946676 [ 150 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:10.946727 [ 150 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 12130ms 2024.08.27 19:20:10.946958 [ 117 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:10.947092 [ 136 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:10.947156 [ 136 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 9457ms 2024.08.27 19:20:10.948648 [ 115 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks 2024.08.27 19:20:10.948806 [ 159 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 4162ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:10.949016 [ 149 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 3400ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:10.949447 [ 125 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/measurements_cumulativef64_local/blocks 2024.08.27 19:20:10.951183 [ 115 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 3678ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:10.951598 [ 125 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 4034ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:10.951613 [ 148 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 3083ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:11.000846 [ 244 ] {} AsynchronousMetrics: MemoryTracking: was 112.02 MiB, peak 117.65 MiB, free memory in arenas 0.00 B, will set to 117.77 MiB (RSS), difference: 5.75 MiB 2024.08.27 19:20:11.760181 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 1029, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:11.760294 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:11.760317 [ 3 ] {} HTTP-Session: c3ffa652-267c-4a86-8684-c9389eb249db Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:11.760343 [ 3 ] {} HTTP-Session: c3ffa652-267c-4a86-8684-c9389eb249db Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:11.760352 [ 3 ] {} HTTP-Session: c3ffa652-267c-4a86-8684-c9389eb249db Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:11.760410 [ 3 ] {} HTTP-Session: c3ffa652-267c-4a86-8684-c9389eb249db Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:11.760642 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} executeQuery: (from [::1]:37610) INSERT INTO oximeter.fields_i64 FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:11.760726 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64 2024.08.27 19:20:11.761159 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} ParallelParsingInputFormat: Parallel parsing is used 2024.08.27 19:20:11.761765 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_i64_local 2024.08.27 19:20:11.762301 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:11.762351 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:11.762947 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} MergedBlockOutputStream: filled checksums all_2_2_0 (state Temporary) 2024.08.27 19:20:11.763559 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (Replicated OutputStream): Wrote block with ID 'all_14711270729314053939_3610161331250086363', 8 rows 2024.08.27 19:20:11.766700 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Renaming temporary part tmp_insert_all_2_2_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:11.770818 [ 125 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:11.770865 [ 125 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 15817ms 2024.08.27 19:20:11.771036 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} executeQuery: Read 8 rows, 512.00 B in 0.010447 sec., 765.7700775342204 rows/sec., 47.86 KiB/sec. 2024.08.27 19:20:11.771558 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} DynamicQueryHandler: Done processing query 2024.08.27 19:20:11.771603 [ 3 ] {404825e9-fd9a-4121-8720-4e1bf1c9d774} MemoryTracker: Peak memory usage (for query): 4.27 MiB. 2024.08.27 19:20:11.771619 [ 3 ] {} HTTP-Session: c3ffa652-267c-4a86-8684-c9389eb249db Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:11.772080 [ 148 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulling 1 entries to queue: log-0000000002 - log-0000000002 2024.08.27 19:20:11.775536 [ 3 ] {} HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: [::1]:37610, User-Agent: (none), Length: 2672, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:11.775658 [ 3 ] {} DynamicQueryHandler: Request URI: /?output_format_json_quote_64bit_integers=0&wait_end_of_query=1 2024.08.27 19:20:11.775683 [ 3 ] {} HTTP-Session: 7907fb5b-f079-4bd9-b171-7c6e1249de3d Authenticating user 'default' from [::1]:37610 2024.08.27 19:20:11.775711 [ 3 ] {} HTTP-Session: 7907fb5b-f079-4bd9-b171-7c6e1249de3d Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:11.775722 [ 3 ] {} HTTP-Session: 7907fb5b-f079-4bd9-b171-7c6e1249de3d Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:11.775789 [ 3 ] {} HTTP-Session: 7907fb5b-f079-4bd9-b171-7c6e1249de3d Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.08.27 19:20:11.776051 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} executeQuery: (from [::1]:37610) INSERT INTO oximeter.fields_uuid FORMAT JSONEachRow (stage: Complete) 2024.08.27 19:20:11.776138 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid 2024.08.27 19:20:11.776594 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} ParallelParsingInputFormat: Parallel parsing is used 2024.08.27 19:20:11.777051 [ 148 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type GET_PART with virtual parts [all_2_2_0] 2024.08.27 19:20:11.777100 [ 148 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Pulled 1 entries to queue. 2024.08.27 19:20:11.777408 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} ContextAccess (default): Access granted: INSERT(timeseries_name, timeseries_key, field_name, field_value) ON oximeter.fields_uuid_local 2024.08.27 19:20:11.777952 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.08.27 19:20:11.778007 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 133.75 GiB. 2024.08.27 19:20:11.778740 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} MergedBlockOutputStream: filled checksums all_2_2_0 (state Temporary) 2024.08.27 19:20:11.779065 [ 245 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml' 2024.08.27 19:20:11.779623 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (Replicated OutputStream): Wrote block with ID 'all_13336696651781048406_18181722677089142657', 16 rows 2024.08.27 19:20:11.779637 [ 5 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::1]:40616, User-Agent: ClickHouse/23.8.7.1, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2024.08.27 19:20:11.779901 [ 5 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3A%2Fclickhouse%2Ftables%2F1%2Ffields_i64_local%2Freplicas%2F3&part=all_2_2_0&client_protocol_version=8&compress=false 2024.08.27 19:20:11.779918 [ 246 ] {} ConfigReloader: Loading config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml' 2024.08.27 19:20:11.779959 [ 5 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (Replicated PartsService): Sending part all_2_2_0 2024.08.27 19:20:11.784410 [ 245 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration 2024.08.27 19:20:11.786204 [ 246 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performing update on configuration 2024.08.27 19:20:11.786304 [ 5 ] {} InterserverIOHTTPHandler: Done processing query 2024.08.27 19:20:11.786576 [ 245 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration 2024.08.27 19:20:11.787243 [ 246 ] {} Application: Setting max_server_memory_usage was set to 28.79 GiB (31.99 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) 2024.08.27 19:20:11.787263 [ 246 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 16.00 GiB (31.99 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.08.27 19:20:11.787276 [ 246 ] {} Application: Merges and mutations memory limit is set to 16.00 GiB 2024.08.27 19:20:11.787677 [ 246 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (16) and max tasks count (32) for MergeMutateExecutor 2024.08.27 19:20:11.787709 [ 246 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for MoveExecutor 2024.08.27 19:20:11.787722 [ 246 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for FetchExecutor 2024.08.27 19:20:11.787731 [ 246 ] {} MergeTreeBackgroundExecutor: Loaded new threads count (8) and max tasks count (8) for CommonExecutor 2024.08.27 19:20:11.787768 [ 246 ] {} ZooKeeperClient: Finalizing session 9. finalization_started: false, queue_finished: false, reason: 'Config changed' 2024.08.27 19:20:11.787936 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Renaming temporary part tmp_insert_all_2_2_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.08.27 19:20:11.787977 [ 246 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:11.788046 [ 246 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:11.788087 [ 246 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:11.788121 [ 246 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:11.788097 [ 125 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:11.788166 [ 246 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2024.08.27 19:20:11.788140 [ 148 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:11.788169 [ 138 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:11.788209 [ 125 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/version/replicas/3/is_active since session has been expired 2024.08.27 19:20:11.788250 [ 148 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/is_active since session has been expired 2024.08.27 19:20:11.788248 [ 138 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_i64_local/replicas/3/is_active since session has been expired 2024.08.27 19:20:11.788268 [ 125 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Waiting for threads to finish 2024.08.27 19:20:11.788295 [ 148 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Waiting for threads to finish 2024.08.27 19:20:11.788296 [ 138 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Waiting for threads to finish 2024.08.27 19:20:11.788260 [ 139 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:11.788355 [ 139 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/timeseries_schema_local/replicas/3/is_active since session has been expired 2024.08.27 19:20:11.788368 [ 139 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Waiting for threads to finish 2024.08.27 19:20:11.788344 [ 115 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): ZooKeeper session has expired. Switching to a new session. 2024.08.27 19:20:11.788412 [ 115 ] {} EphemeralNodeHolder: Cannot remove /clickhouse/tables/1/fields_uuid_local/replicas/3/is_active since session has been expired 2024.08.27 19:20:11.788421 [ 115 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Waiting for threads to finish 2024.08.27 19:20:11.789010 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: setUserError: error=319 message=Unknown status, client must retry. Reason: Session expired 2024.08.27 19:20:11.789096 [ 125 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Threads finished 2024.08.27 19:20:11.789730 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} EphemeralLockInZooKeeper: ZooKeeper communication error during unlock: code=Session expired message='Session expired' 2024.08.27 19:20:11.789767 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: will retry due to error: retry_count=1 timeout=100ms error=319 message=Unknown status, client must retry. Reason: Session expired 2024.08.27 19:20:11.789782 [ 115 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Threads finished 2024.08.27 19:20:11.790106 [ 139 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Threads finished 2024.08.27 19:20:11.790554 [ 138 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Threads finished 2024.08.27 19:20:11.790807 [ 148 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Threads finished 2024.08.27 19:20:11.794734 [ 246 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:19001 with session_id 10 2024.08.27 19:20:11.797146 [ 246 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.08.27 19:20:11.797169 [ 246 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.08.27 19:20:11.797176 [ 246 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: disabled 2024.08.27 19:20:11.797187 [ 246 ] {} ZooKeeper: Initialized, hosts: [::1]:19001,[::1]:19003 2024.08.27 19:20:11.797254 [ 148 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:11.797276 [ 138 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:11.797300 [ 139 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:11.797337 [ 115 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:11.797357 [ 125 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2024.08.27 19:20:11.797498 [ 246 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.08.27 19:20:11.797523 [ 246 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.08.27 19:20:11.798115 [ 246 ] {} CertificateReloader: One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again. 2024.08.27 19:20:11.798146 [ 246 ] {} ConfigReloader: Loaded config '/var/tmp/omicron_tmp/integration_test-d3cf6f268a434f6c-test_cluster.21020.1-oximeter-clickward-test/clickhouse-3/clickhouse-config.xml', performed update on configuration 2024.08.27 19:20:11.812260 [ 148 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:11.814907 [ 138 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:11.814941 [ 115 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:11.814953 [ 139 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:11.814996 [ 148 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:11.815055 [ 148 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/measurements_cumulativef64_local/replicas/3/queue 2024.08.27 19:20:11.815229 [ 125 ] {} oximeter.version (ReplicatedMergeTreeQueue): Initializing parts in queue 2024.08.27 19:20:11.815320 [ 138 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:11.815323 [ 115 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:11.815364 [ 148 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:11.815371 [ 138 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_i64_local/replicas/3/queue 2024.08.27 19:20:11.815414 [ 139 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:11.815438 [ 115 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/fields_uuid_local/replicas/3/queue 2024.08.27 19:20:11.815474 [ 139 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/timeseries_schema_local/replicas/3/queue 2024.08.27 19:20:11.815712 [ 125 ] {} oximeter.version (ReplicatedMergeTreeQueue): Queue initialized 2024.08.27 19:20:11.815747 [ 125 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/1/version/replicas/3/queue 2024.08.27 19:20:11.815772 [ 138 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:11.815795 [ 139 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:11.815782 [ 115 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:11.815802 [ 148 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:11.816082 [ 125 ] {} oximeter.version (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2024.08.27 19:20:11.816124 [ 139 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:11.816125 [ 138 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:11.816313 [ 115 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:11.816385 [ 125 ] {} oximeter.version (ReplicatedMergeTreeQueue): Loaded queue 2024.08.27 19:20:11.818680 [ 148 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:11.818743 [ 159 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:11.818816 [ 159 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 15927ms 2024.08.27 19:20:11.818851 [ 139 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:11.819038 [ 125 ] {} oximeter.version (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:11.819060 [ 138 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:11.819233 [ 117 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:11.819493 [ 125 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 9180ms 2024.08.27 19:20:11.820214 [ 115 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeRestartingThread): Table started successfully 2024.08.27 19:20:11.820188 [ 106 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:11.820263 [ 117 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 12006ms 2024.08.27 19:20:11.820386 [ 106 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 19163ms 2024.08.27 19:20:11.820468 [ 115 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803805696, merge_with_ttl_allowedtrue) 2024.08.27 19:20:11.820493 [ 115 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 17706ms 2024.08.27 19:20:11.821431 [ 98 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/1/fields_i64_local/blocks 2024.08.27 19:20:11.821638 [ 110 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 870ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:11.821805 [ 136 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 870ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:11.821841 [ 130 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 873ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:11.822102 [ 127 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 873ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:11.822393 [ 98 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 871ms, ratio: 0, points per minute: 0) 2024.08.27 19:20:11.890762 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: setUserError: error=244 message=Insert failed due to zookeeper error. Please retry. Reason: Session expired 2024.08.27 19:20:11.890822 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (Replicated OutputStream): ZooKeeperRetriesControl: ReplicatedMergeTreeSink::consume/commitPart: stop retries on request: retry_count=1 timeout=200ms error=244 message=Insert failed due to zookeeper error. Please retry. Reason: Session expired 2024.08.27 19:20:11.890880 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} oximeter.fields_uuid_local (ReplicatedMergeTreePartCheckThread): Enqueueing all_2_2_0 for check after after 300s 2024.08.27 19:20:11.906723 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} executeQuery: Code: 244. DB::Exception: Insert failed due to zookeeper error. Please retry. Reason: Session expired. (UNEXPECTED_ZOOKEEPER_ERROR) (version 23.8.7.1) (from [::1]:37610) (in query: INSERT INTO oximeter.fields_uuid FORMAT JSONEachRow ), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::ZooKeeperRetriesControl::setUserError(int, std::__cxx11::basic_string, std::allocator >) @ 0x0000000015a0e8de in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool)::{lambda()#1}::operator()() const @ 0x0000000015a11f03 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. void DB::ZooKeeperRetriesControl::retryLoop::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool)::{lambda()#1}, DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool)::{lambda()#2}>(DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool)::{lambda()#1}&&, DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool)::{lambda()#2}&&) @ 0x0000000015a043b8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool) @ 0x0000000015a03df2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x00000000159f86fd in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x0000000015a02e3f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000015cadc28 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. std::_Function_handler::_M_invoke(std::_Any_data const&) @ 0x0000000015c400d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x0000000015c3fec5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::ExceptionKeepingTransform::work() @ 0x0000000015c3f807 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. DB::ExecutionThreadContext::executeTask() @ 0x000000001695a188 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000015b7556c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000015b75173 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. DB::DistributedSink::writeToLocal(DB::Cluster::ShardInfo const&, DB::Block const&, unsigned long) @ 0x000000001572dc10 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 16. DB::DistributedSink::writeAsyncImpl(DB::Block const&, unsigned long) @ 0x000000001572a4e6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 17. DB::DistributedSink::consume(DB::Chunk) @ 0x00000000157295a8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 18. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000015cadc28 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 19. std::_Function_handler::_M_invoke(std::_Any_data const&) @ 0x0000000015c400d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 20. DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x0000000015c3fec5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 21. DB::ExceptionKeepingTransform::work() @ 0x0000000015c3f807 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 22. DB::ExecutionThreadContext::executeTask() @ 0x000000001695a188 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 23. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000015b7556c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 24. DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000015b74f97 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 25. DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000015b74d81 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 26. DB::CompletedPipelineExecutor::execute() @ 0x0000000015b73c39 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 27. DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&) @ 0x000000001518d6cc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 28. DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x00000000168a421a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 29. DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x00000000168a714c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 30. DB::HTTPServerConnection::run() @ 0x00000000168c50ab in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 31. Poco::Net::TCPServerConnection::start() @ 0x000000001954534c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 32. Poco::Net::TCPServerDispatcher::run() @ 0x0000000019545821 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 33. Poco::PooledThread::run() @ 0x00000000195aa732 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 34. Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000195a81e5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 35. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 2024.08.27 19:20:11.907303 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} DynamicQueryHandler: Code: 244. DB::Exception: Insert failed due to zookeeper error. Please retry. Reason: Session expired. (UNEXPECTED_ZOOKEEPER_ERROR), Stack trace (when copying this message, always include the lines below): 0. StackTrace::tryCapture() @ 0x0000000010014f57 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 1. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000ffe797f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 2. DB::ZooKeeperRetriesControl::setUserError(int, std::__cxx11::basic_string, std::allocator >) @ 0x0000000015a0e8de in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 3. DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool)::{lambda()#1}::operator()() const @ 0x0000000015a11f03 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 4. void DB::ZooKeeperRetriesControl::retryLoop::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool)::{lambda()#1}, DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool)::{lambda()#2}>(DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool)::{lambda()#1}&&, DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool)::{lambda()#2}&&) @ 0x0000000015a043b8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 5. DB::ReplicatedMergeTreeSinkImpl::commitPart(std::shared_ptr const&, std::shared_ptr&, std::__cxx11::basic_string, std::allocator > const&, unsigned long, bool) @ 0x0000000015a03df2 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 6. DB::ReplicatedMergeTreeSinkImpl::finishDelayedChunk(std::shared_ptr const&) @ 0x00000000159f86fd in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 7. DB::ReplicatedMergeTreeSinkImpl::consume(DB::Chunk) @ 0x0000000015a02e3f in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 8. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000015cadc28 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 9. std::_Function_handler::_M_invoke(std::_Any_data const&) @ 0x0000000015c400d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 10. DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x0000000015c3fec5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 11. DB::ExceptionKeepingTransform::work() @ 0x0000000015c3f807 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 12. DB::ExecutionThreadContext::executeTask() @ 0x000000001695a188 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 13. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000015b7556c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 14. DB::PipelineExecutor::executeStep(std::atomic*) @ 0x0000000015b75173 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 15. DB::DistributedSink::writeToLocal(DB::Cluster::ShardInfo const&, DB::Block const&, unsigned long) @ 0x000000001572dc10 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 16. DB::DistributedSink::writeAsyncImpl(DB::Block const&, unsigned long) @ 0x000000001572a4e6 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 17. DB::DistributedSink::consume(DB::Chunk) @ 0x00000000157295a8 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 18. DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000015cadc28 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 19. std::_Function_handler::_M_invoke(std::_Any_data const&) @ 0x0000000015c400d1 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 20. DB::runStep(std::function, DB::ThreadStatus*, std::atomic*) @ 0x0000000015c3fec5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 21. DB::ExceptionKeepingTransform::work() @ 0x0000000015c3f807 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 22. DB::ExecutionThreadContext::executeTask() @ 0x000000001695a188 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 23. DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x0000000015b7556c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 24. DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x0000000015b74f97 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 25. DB::PipelineExecutor::execute(unsigned long, bool) @ 0x0000000015b74d81 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 26. DB::CompletedPipelineExecutor::execute() @ 0x0000000015b73c39 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 27. DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr, std::function, std::optional const&) @ 0x000000001518d6cc in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 28. DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional&) @ 0x00000000168a421a in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 29. DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&) @ 0x00000000168a714c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 30. DB::HTTPServerConnection::run() @ 0x00000000168c50ab in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 31. Poco::Net::TCPServerConnection::start() @ 0x000000001954534c in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 32. Poco::Net::TCPServerDispatcher::run() @ 0x0000000019545821 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 33. Poco::PooledThread::run() @ 0x00000000195aa732 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 34. Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000195a81e5 in /work/oxidecomputer/omicron/out/clickhouse/clickhouse 35. _thrp_setup @ 0x0000000000114f37 in /lib/amd64/libc.so.1 (version 23.8.7.1) 2024.08.27 19:20:11.907597 [ 3 ] {a636843f-e7e4-4933-b559-ae08636bf57e} MemoryTracker: Peak memory usage (for query): 4.27 MiB. 2024.08.27 19:20:11.907619 [ 3 ] {} HTTP-Session: 7907fb5b-f079-4bd9-b171-7c6e1249de3d Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.08.27 19:20:11.909441 [ 248 ] {} DDLWorker: Initializing DDLWorker thread 2024.08.27 19:20:11.913494 [ 248 ] {} DDLWorker: Initialized DDLWorker thread 2024.08.27 19:20:11.913549 [ 248 ] {} DDLWorker: Scheduling tasks 2024.08.27 19:20:11.913560 [ 248 ] {} DDLWorker: Have 1 unfinished tasks, will check them 2024.08.27 19:20:11.913577 [ 249 ] {} DDLWorker: Too early to clean queue, will do it later. 2024.08.27 19:20:11.913996 [ 248 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=20, queue_size=20, entries=query-0000000000..query-0000000019, first_failed_task_name=none, current_tasks_size=1, last_current_task=query-0000000019, last_skipped_entry_name=query-0000000009 2024.08.27 19:20:11.914073 [ 248 ] {} DDLWorker: No tasks to schedule 2024.08.27 19:20:11.914085 [ 248 ] {} DDLWorker: Waiting for queue updates 2024.08.27 19:20:12.000562 [ 244 ] {} AsynchronousMetrics: MemoryTracking: was 122.40 MiB, peak 137.14 MiB, free memory in arenas 0.00 B, will set to 132.55 MiB (RSS), difference: 10.15 MiB 2024.08.27 19:20:20.690067 [ 127 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:20:20.690149 [ 127 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:20:20.999891 [ 127 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 12024ms 2024.08.27 19:20:23.826651 [ 127 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71805102080, merge_with_ttl_allowedtrue) 2024.08.27 19:20:23.826688 [ 127 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 14502ms 2024.08.27 19:20:27.746132 [ 130 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803183104, merge_with_ttl_allowedtrue) 2024.08.27 19:20:27.746237 [ 130 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 20669ms 2024.08.27 19:20:29.526751 [ 130 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803604992, merge_with_ttl_allowedtrue) 2024.08.27 19:20:29.526826 [ 130 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 21288ms 2024.08.27 19:20:30.983968 [ 130 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71803604992, merge_with_ttl_allowedtrue) 2024.08.27 19:20:30.984143 [ 130 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 23343ms 2024.08.27 19:20:33.024263 [ 110 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 15799ms 2024.08.27 19:20:35.690331 [ 136 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:20:35.690411 [ 136 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:20:38.328989 [ 128 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71802693632, merge_with_ttl_allowedtrue) 2024.08.27 19:20:38.329074 [ 128 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 18480ms 2024.08.27 19:20:48.415527 [ 136 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71799371776, merge_with_ttl_allowedtrue) 2024.08.27 19:20:48.415582 [ 136 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 25239ms 2024.08.27 19:20:48.823779 [ 136 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 19357ms 2024.08.27 19:20:50.690584 [ 148 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:20:50.690667 [ 148 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:20:50.815195 [ 148 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815053312, merge_with_ttl_allowedtrue) 2024.08.27 19:20:50.815282 [ 148 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 26647ms 2024.08.27 19:20:54.327743 [ 148 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814950912, merge_with_ttl_allowedtrue) 2024.08.27 19:20:54.327860 [ 148 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 29539ms 2024.08.27 19:20:56.809641 [ 149 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814950912, merge_with_ttl_allowedtrue) 2024.08.27 19:20:56.809721 [ 149 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 22218ms 2024.08.27 19:21:05.690811 [ 115 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:21:05.690880 [ 115 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:21:08.181108 [ 149 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 23834ms 2024.08.27 19:21:13.654981 [ 107 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71811354624, merge_with_ttl_allowedtrue) 2024.08.27 19:21:13.655039 [ 107 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 31930ms 2024.08.27 19:21:17.462608 [ 107 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814668288, merge_with_ttl_allowedtrue) 2024.08.27 19:21:17.462682 [ 107 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 34137ms 2024.08.27 19:21:19.028131 [ 107 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814668288, merge_with_ttl_allowedtrue) 2024.08.27 19:21:19.028236 [ 107 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 28980ms 2024.08.27 19:21:20.691121 [ 149 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:21:20.691270 [ 149 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:21:23.867286 [ 103 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71812986880, merge_with_ttl_allowedtrue) 2024.08.27 19:21:23.867343 [ 103 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 36867ms 2024.08.27 19:21:32.015405 [ 117 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 30821ms 2024.08.27 19:21:35.691505 [ 117 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:21:35.691646 [ 117 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:21:45.585267 [ 106 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71811112960, merge_with_ttl_allowedtrue) 2024.08.27 19:21:45.585329 [ 106 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 38381ms 2024.08.27 19:21:48.008422 [ 106 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71811112960, merge_with_ttl_allowedtrue) 2024.08.27 19:21:48.008465 [ 106 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 37450ms 2024.08.27 19:21:50.691810 [ 106 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:21:50.691901 [ 106 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:21:51.599945 [ 106 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71809474560, merge_with_ttl_allowedtrue) 2024.08.27 19:21:51.599992 [ 106 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 44595ms 2024.08.27 19:22:00.734630 [ 118 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71806851072, merge_with_ttl_allowedtrue) 2024.08.27 19:22:00.734734 [ 118 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 47484ms 2024.08.27 19:22:02.836849 [ 111 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 39667ms 2024.08.27 19:22:05.692065 [ 111 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:22:05.692144 [ 111 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:22:06.001597 [ 244 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000643298 sec. 2024.08.27 19:22:20.692380 [ 113 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:22:20.692556 [ 113 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:22:23.966615 [ 113 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71800838144, merge_with_ttl_allowedtrue) 2024.08.27 19:22:23.966662 [ 113 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 47533ms 2024.08.27 19:22:25.458713 [ 113 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71800086528, merge_with_ttl_allowedtrue) 2024.08.27 19:22:25.458772 [ 113 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 46234ms 2024.08.27 19:22:35.692690 [ 113 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:22:35.692764 [ 113 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:22:36.195367 [ 113 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71797106688, merge_with_ttl_allowedtrue) 2024.08.27 19:22:36.195506 [ 113 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 57426ms 2024.08.27 19:22:42.504237 [ 59 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 52348ms 2024.08.27 19:22:48.219110 [ 59 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71794593792, merge_with_ttl_allowedtrue) 2024.08.27 19:22:48.219217 [ 59 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:22:50.692948 [ 59 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:22:50.693023 [ 59 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:23:05.693266 [ 92 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:23:05.693412 [ 92 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:23:11.500340 [ 96 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71787026432, merge_with_ttl_allowedtrue) 2024.08.27 19:23:11.500541 [ 96 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 58643ms 2024.08.27 19:23:11.693077 [ 96 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71787026432, merge_with_ttl_allowedtrue) 2024.08.27 19:23:11.693146 [ 96 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 55796ms 2024.08.27 19:23:20.693692 [ 94 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:23:20.693790 [ 94 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:23:33.621799 [ 94 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71781558272, merge_with_ttl_allowedtrue) 2024.08.27 19:23:33.621854 [ 94 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:23:34.852583 [ 94 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:23:35.693964 [ 94 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:23:35.694026 [ 94 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:23:48.219521 [ 93 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71777220608, merge_with_ttl_allowedtrue) 2024.08.27 19:23:48.219587 [ 93 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:23:50.694191 [ 71 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:23:50.694318 [ 71 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:24:05.694541 [ 82 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:24:05.694717 [ 82 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:24:06.001298 [ 244 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000507045 sec. 2024.08.27 19:24:07.489445 [ 71 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71772272640, merge_with_ttl_allowedtrue) 2024.08.27 19:24:07.489526 [ 71 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:24:10.144047 [ 71 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71770662912, merge_with_ttl_allowedtrue) 2024.08.27 19:24:10.144112 [ 71 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:24:20.694959 [ 71 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:24:20.695073 [ 71 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:24:33.622139 [ 82 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71766054912, merge_with_ttl_allowedtrue) 2024.08.27 19:24:33.622263 [ 82 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:24:34.852869 [ 82 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:24:35.695299 [ 82 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:24:35.695443 [ 82 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:24:48.219818 [ 79 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71761907712, merge_with_ttl_allowedtrue) 2024.08.27 19:24:48.219874 [ 79 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:24:50.695715 [ 79 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:24:50.695792 [ 79 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:25:05.695919 [ 79 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:25:05.696050 [ 79 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:25:07.489848 [ 84 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71756374016, merge_with_ttl_allowedtrue) 2024.08.27 19:25:07.489904 [ 84 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:25:10.144317 [ 79 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71755329536, merge_with_ttl_allowedtrue) 2024.08.27 19:25:10.144373 [ 79 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:25:13.302803 [ 79 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301481ms, ratio: 0, points per minute: 0) 2024.08.27 19:25:14.047957 [ 18 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 302225ms, ratio: 0, points per minute: 0) 2024.08.27 19:25:15.663072 [ 18 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 303841ms, ratio: 0, points per minute: 0) 2024.08.27 19:25:18.684901 [ 18 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 306863ms, ratio: 0, points per minute: 0) 2024.08.27 19:25:20.696313 [ 18 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:25:20.696469 [ 18 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:25:21.156798 [ 18 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309335ms, ratio: 0, points per minute: 0) 2024.08.27 19:25:33.622519 [ 74 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71749781504, merge_with_ttl_allowedtrue) 2024.08.27 19:25:33.622572 [ 74 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:25:34.853172 [ 74 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:25:35.696601 [ 74 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:25:35.696665 [ 74 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:25:48.220249 [ 75 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71744983040, merge_with_ttl_allowedtrue) 2024.08.27 19:25:48.220355 [ 75 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:25:50.696953 [ 75 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:25:50.697079 [ 75 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:26:05.697239 [ 12 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:26:05.697352 [ 12 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:26:06.001777 [ 244 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000625352 sec. 2024.08.27 19:26:07.490284 [ 89 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71739009024, merge_with_ttl_allowedtrue) 2024.08.27 19:26:07.490384 [ 89 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:26:10.144793 [ 89 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71737534464, merge_with_ttl_allowedtrue) 2024.08.27 19:26:10.144892 [ 89 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:26:20.697512 [ 86 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:26:20.697632 [ 86 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:26:33.622895 [ 70 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71732097024, merge_with_ttl_allowedtrue) 2024.08.27 19:26:33.622974 [ 70 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:26:34.853437 [ 70 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:26:35.697773 [ 89 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:26:35.697830 [ 89 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:26:48.220714 [ 89 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71725854720, merge_with_ttl_allowedtrue) 2024.08.27 19:26:48.220804 [ 89 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:26:50.697963 [ 89 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:26:50.698059 [ 89 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:27:05.698175 [ 87 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:27:05.698266 [ 87 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:27:07.490628 [ 87 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71719892992, merge_with_ttl_allowedtrue) 2024.08.27 19:27:07.490669 [ 87 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:27:10.145172 [ 87 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71718647808, merge_with_ttl_allowedtrue) 2024.08.27 19:27:10.145227 [ 87 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:27:20.698502 [ 89 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:27:20.698574 [ 89 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:27:33.623234 [ 77 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71712577536, merge_with_ttl_allowedtrue) 2024.08.27 19:27:33.623299 [ 77 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:27:34.853698 [ 77 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:27:35.698708 [ 77 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:27:35.698757 [ 77 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:27:48.221075 [ 77 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71707080704, merge_with_ttl_allowedtrue) 2024.08.27 19:27:48.221155 [ 77 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:27:50.698934 [ 77 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:27:50.699078 [ 77 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:28:05.699390 [ 34 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:28:05.699592 [ 34 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:28:06.001169 [ 244 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.00038937 sec. 2024.08.27 19:28:07.491244 [ 46 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71798714368, merge_with_ttl_allowedtrue) 2024.08.27 19:28:07.491352 [ 46 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:28:10.145581 [ 46 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814113280, merge_with_ttl_allowedtrue) 2024.08.27 19:28:10.145682 [ 46 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:28:20.699996 [ 42 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:28:20.700182 [ 42 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:28:33.623916 [ 30 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814295552, merge_with_ttl_allowedtrue) 2024.08.27 19:28:33.624031 [ 30 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:28:34.854342 [ 30 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:28:35.700404 [ 30 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:28:35.700518 [ 30 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:28:48.221510 [ 28 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814305792, merge_with_ttl_allowedtrue) 2024.08.27 19:28:48.221630 [ 28 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:28:50.700953 [ 28 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:28:50.701090 [ 28 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:29:05.701301 [ 28 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:29:05.701438 [ 28 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:29:07.492008 [ 37 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814318080, merge_with_ttl_allowedtrue) 2024.08.27 19:29:07.492122 [ 37 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:29:10.146233 [ 28 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814506496, merge_with_ttl_allowedtrue) 2024.08.27 19:29:10.146350 [ 28 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:29:20.701643 [ 6 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:29:20.701811 [ 6 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:29:33.624519 [ 6 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814318080, merge_with_ttl_allowedtrue) 2024.08.27 19:29:33.624633 [ 6 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:29:34.854752 [ 6 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:29:35.702251 [ 6 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:29:35.702364 [ 6 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:29:48.222198 [ 14 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814326272, merge_with_ttl_allowedtrue) 2024.08.27 19:29:48.222293 [ 14 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:29:50.702584 [ 14 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:29:50.702729 [ 14 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:30:05.703158 [ 6 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:30:05.703312 [ 6 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:30:06.001391 [ 244 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000530271 sec. 2024.08.27 19:30:07.492516 [ 17 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814522880, merge_with_ttl_allowedtrue) 2024.08.27 19:30:07.492599 [ 17 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:30:10.146789 [ 17 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814526976, merge_with_ttl_allowedtrue) 2024.08.27 19:30:10.146909 [ 17 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:30:15.307255 [ 13 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 302005ms, ratio: 0, points per minute: 0) 2024.08.27 19:30:18.819247 [ 13 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304772ms, ratio: 0, points per minute: 0) 2024.08.27 19:30:20.667454 [ 13 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 305004ms, ratio: 0, points per minute: 0) 2024.08.27 19:30:20.703738 [ 13 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:30:20.703850 [ 13 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:30:24.834081 [ 21 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 303678ms, ratio: 0, points per minute: 0) 2024.08.27 19:30:25.847081 [ 21 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 307163ms, ratio: 0, points per minute: 0) 2024.08.27 19:30:33.625240 [ 6 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814543360, merge_with_ttl_allowedtrue) 2024.08.27 19:30:33.625340 [ 6 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:30:34.855339 [ 6 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:30:35.704058 [ 6 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:30:35.704171 [ 6 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:30:48.222900 [ 21 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814529024, merge_with_ttl_allowedtrue) 2024.08.27 19:30:48.223000 [ 21 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:30:50.704608 [ 21 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:30:50.704735 [ 21 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:31:05.705014 [ 36 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:31:05.705182 [ 36 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:31:07.492970 [ 21 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814588416, merge_with_ttl_allowedtrue) 2024.08.27 19:31:07.493057 [ 21 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:31:10.147482 [ 21 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814576128, merge_with_ttl_allowedtrue) 2024.08.27 19:31:10.147581 [ 21 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:31:20.705620 [ 21 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:31:20.705770 [ 21 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:31:33.625928 [ 44 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814633472, merge_with_ttl_allowedtrue) 2024.08.27 19:31:33.626056 [ 44 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:31:34.855943 [ 44 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:31:35.706214 [ 44 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:31:35.706319 [ 44 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:31:48.223620 [ 49 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814647808, merge_with_ttl_allowedtrue) 2024.08.27 19:31:48.223725 [ 49 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:31:50.706555 [ 49 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:31:50.706682 [ 49 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:32:05.706898 [ 45 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:32:05.707062 [ 45 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:32:06.001257 [ 244 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000431294 sec. 2024.08.27 19:32:07.493609 [ 45 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814668288, merge_with_ttl_allowedtrue) 2024.08.27 19:32:07.493690 [ 45 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:32:10.148122 [ 45 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71814678528, merge_with_ttl_allowedtrue) 2024.08.27 19:32:10.148222 [ 45 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:32:20.707281 [ 47 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:32:20.707429 [ 47 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:32:33.626384 [ 45 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815030784, merge_with_ttl_allowedtrue) 2024.08.27 19:32:33.626482 [ 45 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:32:34.856402 [ 45 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:32:35.707854 [ 45 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:32:35.707977 [ 45 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:32:48.224042 [ 53 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815442432, merge_with_ttl_allowedtrue) 2024.08.27 19:32:48.224139 [ 53 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:32:50.708266 [ 53 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:32:50.708416 [ 53 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:33:05.708644 [ 54 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:33:05.708811 [ 54 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:33:07.494245 [ 54 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815194624, merge_with_ttl_allowedtrue) 2024.08.27 19:33:07.494333 [ 54 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:33:10.148795 [ 54 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815522304, merge_with_ttl_allowedtrue) 2024.08.27 19:33:10.148880 [ 54 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:33:20.709185 [ 54 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:33:20.709305 [ 54 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:33:33.626787 [ 54 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815901184, merge_with_ttl_allowedtrue) 2024.08.27 19:33:33.626921 [ 54 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:33:34.856986 [ 54 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:33:35.709770 [ 54 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:33:35.709883 [ 54 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:33:48.224565 [ 67 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815925760, merge_with_ttl_allowedtrue) 2024.08.27 19:33:48.224684 [ 67 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:33:50.710121 [ 67 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:33:50.710273 [ 67 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:34:05.710450 [ 66 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:34:05.710571 [ 66 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:34:06.001441 [ 244 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000435131 sec. 2024.08.27 19:34:07.494901 [ 66 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815909376, merge_with_ttl_allowedtrue) 2024.08.27 19:34:07.494999 [ 66 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:34:10.149372 [ 54 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71815913472, merge_with_ttl_allowedtrue) 2024.08.27 19:34:10.149469 [ 54 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:34:20.710982 [ 62 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:34:20.711145 [ 62 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:34:33.627451 [ 62 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816097792, merge_with_ttl_allowedtrue) 2024.08.27 19:34:33.627562 [ 62 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:34:34.857580 [ 62 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:34:35.711525 [ 62 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:34:35.711659 [ 62 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:34:48.225340 [ 62 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816282112, merge_with_ttl_allowedtrue) 2024.08.27 19:34:48.225463 [ 62 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:34:50.712124 [ 62 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:34:50.712278 [ 62 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:35:05.712755 [ 50 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:35:05.712915 [ 50 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:35:07.495389 [ 50 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816062976, merge_with_ttl_allowedtrue) 2024.08.27 19:35:07.495494 [ 50 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:35:10.150046 [ 50 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816062976, merge_with_ttl_allowedtrue) 2024.08.27 19:35:10.150157 [ 50 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:35:20.713289 [ 55 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:35:20.713445 [ 55 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:35:23.766652 [ 41 ] {} oximeter.fields_i64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304947ms, ratio: 0, points per minute: 0) 2024.08.27 19:35:25.095582 [ 41 ] {} oximeter.measurements_cumulativef64_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309788ms, ratio: 0, points per minute: 0) 2024.08.27 19:35:25.601779 [ 41 ] {} oximeter.fields_uuid_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 304934ms, ratio: 0, points per minute: 0) 2024.08.27 19:35:26.388328 [ 41 ] {} oximeter.version (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 301554ms, ratio: 0, points per minute: 0) 2024.08.27 19:35:33.628144 [ 38 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816243200, merge_with_ttl_allowedtrue) 2024.08.27 19:35:33.628258 [ 38 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:35:34.858170 [ 38 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:35:35.306376 [ 38 ] {} oximeter.timeseries_schema_local (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 300000ms (points: 0, interval: 309459ms, ratio: 0, points per minute: 0) 2024.08.27 19:35:35.713639 [ 38 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:35:35.713769 [ 38 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:35:48.225868 [ 35 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816636416, merge_with_ttl_allowedtrue) 2024.08.27 19:35:48.225981 [ 35 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:35:50.714190 [ 35 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:35:50.714325 [ 35 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:36:05.714726 [ 38 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:36:05.714862 [ 38 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:36:06.001045 [ 244 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000342425 sec. 2024.08.27 19:36:07.496096 [ 31 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816622080, merge_with_ttl_allowedtrue) 2024.08.27 19:36:07.496189 [ 31 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:36:10.150510 [ 31 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816607744, merge_with_ttl_allowedtrue) 2024.08.27 19:36:10.150609 [ 31 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:36:20.715300 [ 32 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:36:20.715484 [ 32 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:36:33.628865 [ 68 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816609792, merge_with_ttl_allowedtrue) 2024.08.27 19:36:33.628966 [ 68 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:36:34.858798 [ 31 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:36:35.715935 [ 31 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:36:35.716068 [ 31 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:36:48.226285 [ 31 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816775680, merge_with_ttl_allowedtrue) 2024.08.27 19:36:48.226378 [ 31 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:36:50.716543 [ 31 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:36:50.716678 [ 31 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:37:05.717097 [ 141 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:37:05.717268 [ 141 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:37:07.496694 [ 141 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816771584, merge_with_ttl_allowedtrue) 2024.08.27 19:37:07.496775 [ 141 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:37:10.151181 [ 141 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816783872, merge_with_ttl_allowedtrue) 2024.08.27 19:37:10.151284 [ 141 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:37:20.717659 [ 133 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:37:20.717844 [ 133 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:37:33.629273 [ 141 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816738816, merge_with_ttl_allowedtrue) 2024.08.27 19:37:33.629368 [ 141 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:37:34.859170 [ 141 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:37:35.718258 [ 141 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:37:35.718375 [ 141 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:37:48.227013 [ 99 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816732672, merge_with_ttl_allowedtrue) 2024.08.27 19:37:48.227117 [ 99 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:37:50.718633 [ 133 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:37:50.718773 [ 133 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:38:05.719173 [ 102 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:38:05.719317 [ 102 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:38:06.001415 [ 244 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.000578238 sec. 2024.08.27 19:38:07.497165 [ 177 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816706048, merge_with_ttl_allowedtrue) 2024.08.27 19:38:07.497245 [ 177 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:38:10.151794 [ 177 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816892416, merge_with_ttl_allowedtrue) 2024.08.27 19:38:10.151887 [ 177 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:38:20.719499 [ 129 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:38:20.719636 [ 129 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:38:33.629904 [ 177 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816869888, merge_with_ttl_allowedtrue) 2024.08.27 19:38:33.630026 [ 177 ] {} oximeter.fields_uuid_local (af987f8a-6ad4-4eb1-9f4c-341572c583d8): Scheduling next merge selecting task after 60000ms 2024.08.27 19:38:34.859721 [ 177 ] {} oximeter.version (0c252196-de3a-41fe-af04-c96ffeb5b03e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:38:35.720032 [ 177 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:38:35.720144 [ 177 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:38:48.227522 [ 185 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71816863744, merge_with_ttl_allowedtrue) 2024.08.27 19:38:48.227635 [ 185 ] {} oximeter.fields_i64_local (cc75e148-9558-4f31-b2f3-d34667f6e2df): Scheduling next merge selecting task after 60000ms 2024.08.27 19:38:50.720594 [ 185 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:38:50.720730 [ 185 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:39:05.721210 [ 169 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:39:05.721426 [ 169 ] {} DNSResolver: Updated DNS cache 2024.08.27 19:39:07.497816 [ 176 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71817039872, merge_with_ttl_allowedtrue) 2024.08.27 19:39:07.497900 [ 176 ] {} oximeter.timeseries_schema_local (f78ecec7-9835-47c4-8a33-cd49a508881e): Scheduling next merge selecting task after 60000ms 2024.08.27 19:39:10.152254 [ 176 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [](max_total_size_to_merge=71817027584, merge_with_ttl_allowedtrue) 2024.08.27 19:39:10.152369 [ 176 ] {} oximeter.measurements_cumulativef64_local (c3418791-a716-4326-9bd3-a6cb615bf6fe): Scheduling next merge selecting task after 60000ms 2024.08.27 19:39:20.721850 [ 176 ] {} DNSResolver: Updating DNS cache 2024.08.27 19:39:20.721985 [ 176 ] {} DNSResolver: Updated DNS cache