Max level shown:
1 [ Jul 1 22:41:39 Enabled. ]
2 [ Jul 1 22:41:39 Rereading configuration. ]
3 [ Jul 1 22:41:42 Rereading configuration. ]
4 [ Jul 1 22:41:49 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 &"). ]
5 [ Jul 1 22:41:49 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-07-01T22:41:49.375ZDEBGoximeter: registered DTrace probes
82026-07-01T22:41:49.376ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:301
92026-07-01T22:41:49.392ZDEBGoximeter: creating ClickHouse client
102026-07-01T22:41:49.399ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
112026-07-01T22:41:55.766ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:890 id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
122026-07-01T22:41:55.766ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d
132026-07-01T22:41:55.766ZINFOoximeter (clickhouse-client): reading db version collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:790 id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
142026-07-01T22:41:55.767ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:890 id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
152026-07-01T22:41:55.767ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:795 id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 version = 0
162026-07-01T22:41:55.767ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
172026-07-01T22:41:55.767ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
182026-07-01T22:41:56.939ZINFOoximeter (clickhouse-client): inserting current version collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:821 id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 version = 14
192026-07-01T22:41:56.960ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 7fc5e056-b715-494b-a948-e92b6729c68e
202026-07-01T22:41:56.977ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-07-01T22:41:56.977ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-07-01T22:41:56.977ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-07-01T22:41:56.977ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all starting from 2.0.0
242026-07-01T22:41:56.977ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all ending with 2.0.0
252026-07-01T22:41:56.977ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
262026-07-01T22:41:56.980ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
272026-07-01T22:41:56.980ZDEBGoximeter: registered USDT probes
282026-07-01T22:41:56.980ZDEBGoximeter: contacting nexus
292026-07-01T22:41:57.000ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
302026-07-01T22:41:57.001ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
312026-07-01T22:41:57.001ZWARNoximeter: failed to contact nexus, will retry in 367.076347ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
322026-07-01T22:41:57.369ZDEBGoximeter: contacting nexus
332026-07-01T22:41:57.369ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
342026-07-01T22:41:57.577ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "80e22ffb-c532-4001-ac2d-5b37894207eb", "date": "Wed, 01 Jul 2026 22:41:57 GMT"} })
352026-07-01T22:41:57.577ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:464 id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1
362026-07-01T22:41:57.577ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
372026-07-01T22:41:57.578ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
382026-07-01T22:41:57.582ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
392026-07-01T22:41:57.690ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9f2d3b4-599b-4c94-a58a-c38253fb46b7", "content-length": "29", "date": "Wed, 01 Jul 2026 22:41:57 GMT"} })
402026-07-01T22:41:57.693ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 0 n_pruned_tasks = 0
412026-07-01T22:42:01.960ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d
422026-07-01T22:42:01.961ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d
432026-07-01T22:42:06.961ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d
442026-07-01T22:42:06.961ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d
452026-07-01T22:42:11.960ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d
462026-07-01T22:42:11.960ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d
472026-07-01T22:42:12.579ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
482026-07-01T22:42:12.579ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
492026-07-01T22:42:12.597ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "096a9423-ec78-40d1-a4ea-c943c6bbe233", "content-length": "300", "date": "Wed, 01 Jul 2026 22:42:12 GMT"} })
502026-07-01T22:42:12.597ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
512026-07-01T22:42:12.600ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c8ab5d8-eb98-41bd-b425-2ac7ff95671a", "content-length": "29", "date": "Wed, 01 Jul 2026 22:42:12 GMT"} })
522026-07-01T22:42:12.600ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:62492 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436
532026-07-01T22:42:12.600ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 1 n_pruned_tasks = 0
542026-07-01T22:42:12.602ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
552026-07-01T22:42:12.612ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
562026-07-01T22:42:12.612ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
572026-07-01T22:42:12.645ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
582026-07-01T22:42:16.960ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 141
592026-07-01T22:42:16.960ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 141
602026-07-01T22:42:16.960ZDEBGoximeter (clickhouse-client): unrolling 141 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
612026-07-01T22:42:16.966ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
622026-07-01T22:42:16.970ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.966366109Z } timeseries_name = dendrite:sample_collection_duration
632026-07-01T22:42:16.970ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.961586544Z } timeseries_name = oximeter_collector:collections
642026-07-01T22:42:16.970ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.961708826Z } timeseries_name = switch_data_link:link_enabled
652026-07-01T22:42:16.970ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.961795208Z } timeseries_name = switch_data_link:link_up
662026-07-01T22:42:16.970ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.961938121Z } timeseries_name = switch_table:capacity
672026-07-01T22:42:16.970ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.962308858Z } timeseries_name = switch_table:collisions
682026-07-01T22:42:16.970ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.962432781Z } timeseries_name = switch_table:delete_misses
692026-07-01T22:42:16.970ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.962182386Z } timeseries_name = switch_table:deletes
702026-07-01T22:42:16.970ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.962495632Z } timeseries_name = switch_table:exhaustion
712026-07-01T22:42:16.971ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.962116605Z } timeseries_name = switch_table:inserts
722026-07-01T22:42:16.971ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.962050433Z } timeseries_name = switch_table:occupancy
732026-07-01T22:42:16.971ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.962371820Z } timeseries_name = switch_table:update_misses
742026-07-01T22:42:16.971ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:16.962245657Z } timeseries_name = switch_table:updates
752026-07-01T22:42:16.979ZDEBGoximeter (clickhouse-client): inserting 13 new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
762026-07-01T22:42:16.987ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 280 table_name = fields_i16
772026-07-01T22:42:16.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 2 table_name = fields_ipaddr
782026-07-01T22:42:16.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 722 table_name = fields_string
792026-07-01T22:42:16.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 142 table_name = fields_u16
802026-07-01T22:42:16.995ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 145 table_name = fields_u32
812026-07-01T22:42:16.996ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 144 table_name = fields_u8
822026-07-01T22:42:16.998ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 422 table_name = fields_uuid
832026-07-01T22:42:17.000ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = measurements_bool
842026-07-01T22:42:17.003ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 106 table_name = measurements_cumulativeu64
852026-07-01T22:42:17.005ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1 table_name = measurements_f64
862026-07-01T22:42:17.007ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
872026-07-01T22:42:17.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
882026-07-01T22:42:21.961ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d
892026-07-01T22:42:21.961ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d
902026-07-01T22:42:22.614ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
912026-07-01T22:42:22.614ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
922026-07-01T22:42:22.628ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
932026-07-01T22:42:26.960ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 140
942026-07-01T22:42:26.960ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 140
952026-07-01T22:42:26.961ZDEBGoximeter (clickhouse-client): unrolling 140 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
962026-07-01T22:42:26.965ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
972026-07-01T22:42:27.007ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 280 table_name = fields_i16
982026-07-01T22:42:27.009ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 721 table_name = fields_string
992026-07-01T22:42:27.010ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 140 table_name = fields_u16
1002026-07-01T22:42:27.012ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 145 table_name = fields_u32
1012026-07-01T22:42:27.013ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 144 table_name = fields_u8
1022026-07-01T22:42:27.015ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 420 table_name = fields_uuid
1032026-07-01T22:42:27.017ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = measurements_bool
1042026-07-01T22:42:27.018ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 105 table_name = measurements_cumulativeu64
1052026-07-01T22:42:27.020ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1 table_name = measurements_f64
1062026-07-01T22:42:27.021ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
1072026-07-01T22:42:27.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
1082026-07-01T22:42:27.578ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
1092026-07-01T22:42:27.578ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
1102026-07-01T22:42:27.583ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d60f681-86b3-42ca-80c7-23e78fb8ee76", "content-length": "574", "date": "Wed, 01 Jul 2026 22:42:27 GMT"} })
1112026-07-01T22:42:27.584ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
1122026-07-01T22:42:27.587ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "adc1744b-3ed2-4ea4-bade-bdcc42bc6b4d", "content-length": "29", "date": "Wed, 01 Jul 2026 22:42:27 GMT"} })
1132026-07-01T22:42:27.587ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7
1142026-07-01T22:42:27.587ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:33342 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d
1152026-07-01T22:42:27.587ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 3 n_pruned_tasks = 0
1162026-07-01T22:42:27.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
1172026-07-01T22:42:27.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1182026-07-01T22:42:27.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1192026-07-01T22:42:27.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
1202026-07-01T22:42:27.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1212026-07-01T22:42:27.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
1222026-07-01T22:42:27.595ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 14 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
1232026-07-01T22:42:27.596ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1242026-07-01T22:42:28.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1252026-07-01T22:42:28.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1262026-07-01T22:42:28.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1272026-07-01T22:42:29.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1282026-07-01T22:42:29.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1292026-07-01T22:42:29.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1302026-07-01T22:42:30.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1312026-07-01T22:42:30.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1322026-07-01T22:42:30.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1332026-07-01T22:42:31.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1342026-07-01T22:42:31.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1352026-07-01T22:42:31.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1362026-07-01T22:42:31.960ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 146
1372026-07-01T22:42:31.960ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 146
1382026-07-01T22:42:31.960ZDEBGoximeter (clickhouse-client): unrolling 146 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
1392026-07-01T22:42:31.965ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
1402026-07-01T22:42:31.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.961480415Z } timeseries_name = collection_target:cpus_provisioned
1412026-07-01T22:42:31.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.961540046Z } timeseries_name = collection_target:ram_provisioned
1422026-07-01T22:42:31.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.961600078Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1432026-07-01T22:42:31.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.961820262Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1442026-07-01T22:42:31.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.961760701Z } timeseries_name = ddm_router:originated_underlay_prefixes
1452026-07-01T22:42:31.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.962062947Z } timeseries_name = ddm_session:advertisements_received
1462026-07-01T22:42:31.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.962003135Z } timeseries_name = ddm_session:advertisements_sent
1472026-07-01T22:42:31.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.962562527Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1482026-07-01T22:42:31.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.962494065Z } timeseries_name = ddm_session:imported_underlay_prefixes
1492026-07-01T22:42:31.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.962193409Z } timeseries_name = ddm_session:peer_address_changes
1502026-07-01T22:42:31.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.962121858Z } timeseries_name = ddm_session:peer_expirations
1512026-07-01T22:42:31.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.962254820Z } timeseries_name = ddm_session:peer_sessions_established
1522026-07-01T22:42:31.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.961943924Z } timeseries_name = ddm_session:solicitations_received
1532026-07-01T22:42:31.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.961884063Z } timeseries_name = ddm_session:solicitations_sent
1542026-07-01T22:42:31.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.962433774Z } timeseries_name = ddm_session:update_send_fail
1552026-07-01T22:42:31.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.962373303Z } timeseries_name = ddm_session:updates_received
1562026-07-01T22:42:31.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.962314452Z } timeseries_name = ddm_session:updates_sent
1572026-07-01T22:42:31.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:42:31.961209880Z } timeseries_name = http_service:request_latency_histogram
1582026-07-01T22:42:31.971ZDEBGoximeter (clickhouse-client): inserting 18 new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
1592026-07-01T22:42:31.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = fields_ipaddr
1602026-07-01T22:42:31.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 68 table_name = fields_string
1612026-07-01T22:42:31.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 12 table_name = fields_u16
1622026-07-01T22:42:31.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 70 table_name = fields_uuid
1632026-07-01T22:42:31.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 102 table_name = measurements_cumulativeu64
1642026-07-01T22:42:31.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 8 table_name = measurements_histogramu64
1652026-07-01T22:42:31.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 6 table_name = measurements_i64
1662026-07-01T22:42:31.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
1672026-07-01T22:42:32.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
1682026-07-01T22:42:32.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1692026-07-01T22:42:32.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1702026-07-01T22:42:32.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1712026-07-01T22:42:32.614ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
1722026-07-01T22:42:32.614ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
1732026-07-01T22:42:32.628ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
1742026-07-01T22:42:33.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1752026-07-01T22:42:33.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1762026-07-01T22:42:33.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1772026-07-01T22:42:34.587ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1782026-07-01T22:42:34.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1792026-07-01T22:42:34.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-07-01T22:42:35.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-07-01T22:42:35.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1822026-07-01T22:42:35.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1832026-07-01T22:42:36.587ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1842026-07-01T22:42:36.587ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1852026-07-01T22:42:36.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-07-01T22:42:36.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 270
1872026-07-01T22:42:36.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 270
1882026-07-01T22:42:36.961ZDEBGoximeter (clickhouse-client): unrolling 270 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
1892026-07-01T22:42:36.970ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
1902026-07-01T22:42:36.985ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 280 table_name = fields_i16
1912026-07-01T22:42:36.987ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 771 table_name = fields_string
1922026-07-01T22:42:36.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 140 table_name = fields_u16
1932026-07-01T22:42:36.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 145 table_name = fields_u32
1942026-07-01T22:42:36.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 144 table_name = fields_u8
1952026-07-01T22:42:36.994ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 472 table_name = fields_uuid
1962026-07-01T22:42:36.996ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = measurements_bool
1972026-07-01T22:42:36.998ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 205 table_name = measurements_cumulativeu64
1982026-07-01T22:42:36.999ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1 table_name = measurements_f64
1992026-07-01T22:42:37.001ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = measurements_u64
2002026-07-01T22:42:37.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
2012026-07-01T22:42:37.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2022026-07-01T22:42:37.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2032026-07-01T22:42:37.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
2042026-07-01T22:42:37.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
2052026-07-01T22:42:37.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2062026-07-01T22:42:37.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 37 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
2072026-07-01T22:42:38.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2082026-07-01T22:42:38.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2092026-07-01T22:42:38.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2102026-07-01T22:42:39.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2112026-07-01T22:42:39.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2122026-07-01T22:42:39.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2132026-07-01T22:42:40.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2142026-07-01T22:42:40.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2152026-07-01T22:42:40.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2162026-07-01T22:42:41.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2172026-07-01T22:42:41.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2182026-07-01T22:42:41.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2192026-07-01T22:42:41.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 167
2202026-07-01T22:42:41.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 167
2212026-07-01T22:42:41.961ZDEBGoximeter (clickhouse-client): unrolling 167 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
2222026-07-01T22:42:41.966ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
2232026-07-01T22:42:41.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 94 table_name = fields_string
2242026-07-01T22:42:41.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 22 table_name = fields_u16
2252026-07-01T22:42:41.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 82 table_name = fields_uuid
2262026-07-01T22:42:41.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = measurements_cumulativeu64
2272026-07-01T22:42:41.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 22 table_name = measurements_histogramu64
2282026-07-01T22:42:41.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 15 table_name = measurements_i64
2292026-07-01T22:42:41.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
2302026-07-01T22:42:42.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
2312026-07-01T22:42:42.579ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
2322026-07-01T22:42:42.579ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
2332026-07-01T22:42:42.585ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e88b08e-3ae8-4356-8bd7-2f88955ea7d0", "content-length": "574", "date": "Wed, 01 Jul 2026 22:42:42 GMT"} })
2342026-07-01T22:42:42.585ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
2352026-07-01T22:42:42.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-07-01T22:42:42.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2372026-07-01T22:42:42.589ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bacb8bf-6142-4765-ad12-f0dd34f25237", "content-length": "29", "date": "Wed, 01 Jul 2026 22:42:42 GMT"} })
2382026-07-01T22:42:42.589ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 3 n_pruned_tasks = 0
2392026-07-01T22:42:42.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2402026-07-01T22:42:42.614ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
2412026-07-01T22:42:42.614ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
2422026-07-01T22:42:42.626ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
2432026-07-01T22:42:43.587ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2442026-07-01T22:42:43.587ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2452026-07-01T22:42:43.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2462026-07-01T22:42:44.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2472026-07-01T22:42:44.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2482026-07-01T22:42:44.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2492026-07-01T22:42:45.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2502026-07-01T22:42:45.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2512026-07-01T22:42:45.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2522026-07-01T22:42:46.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2532026-07-01T22:42:46.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2542026-07-01T22:42:46.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2552026-07-01T22:42:46.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 270
2562026-07-01T22:42:46.961ZDEBGoximeter (clickhouse-client): unrolling 270 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
2572026-07-01T22:42:46.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 270
2582026-07-01T22:42:46.970ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
2592026-07-01T22:42:46.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 280 table_name = fields_i16
2602026-07-01T22:42:46.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 771 table_name = fields_string
2612026-07-01T22:42:46.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 140 table_name = fields_u16
2622026-07-01T22:42:46.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 145 table_name = fields_u32
2632026-07-01T22:42:46.985ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 144 table_name = fields_u8
2642026-07-01T22:42:46.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 472 table_name = fields_uuid
2652026-07-01T22:42:46.987ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = measurements_bool
2662026-07-01T22:42:46.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 205 table_name = measurements_cumulativeu64
2672026-07-01T22:42:46.990ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1 table_name = measurements_f64
2682026-07-01T22:42:46.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = measurements_u64
2692026-07-01T22:42:47.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
2702026-07-01T22:42:47.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2712026-07-01T22:42:47.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2722026-07-01T22:42:47.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
2732026-07-01T22:42:47.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
2742026-07-01T22:42:47.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2752026-07-01T22:42:47.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
2762026-07-01T22:42:48.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2772026-07-01T22:42:48.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2782026-07-01T22:42:48.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2792026-07-01T22:42:49.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2802026-07-01T22:42:49.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2812026-07-01T22:42:49.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2822026-07-01T22:42:50.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2832026-07-01T22:42:50.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-07-01T22:42:50.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2852026-07-01T22:42:51.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2862026-07-01T22:42:51.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2872026-07-01T22:42:51.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2882026-07-01T22:42:51.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
2892026-07-01T22:42:51.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
2902026-07-01T22:42:51.961ZDEBGoximeter (clickhouse-client): unrolling 153 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
2912026-07-01T22:42:51.966ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
2922026-07-01T22:42:51.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 96 table_name = fields_string
2932026-07-01T22:42:51.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = fields_u16
2942026-07-01T22:42:51.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 75 table_name = fields_uuid
2952026-07-01T22:42:51.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = measurements_cumulativeu64
2962026-07-01T22:42:51.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
2972026-07-01T22:42:51.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
2982026-07-01T22:42:52.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
2992026-07-01T22:42:52.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3002026-07-01T22:42:52.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3012026-07-01T22:42:52.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3022026-07-01T22:42:52.614ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
3032026-07-01T22:42:52.614ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
3042026-07-01T22:42:52.626ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
3052026-07-01T22:42:53.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3062026-07-01T22:42:53.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3072026-07-01T22:42:53.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3082026-07-01T22:42:54.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3092026-07-01T22:42:54.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3102026-07-01T22:42:54.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-07-01T22:42:55.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-07-01T22:42:55.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3132026-07-01T22:42:55.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3142026-07-01T22:42:56.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3152026-07-01T22:42:56.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3162026-07-01T22:42:56.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-07-01T22:42:56.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 270
3182026-07-01T22:42:56.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 270
3192026-07-01T22:42:56.961ZDEBGoximeter (clickhouse-client): unrolling 270 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
3202026-07-01T22:42:56.970ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
3212026-07-01T22:42:56.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 280 table_name = fields_i16
3222026-07-01T22:42:56.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 771 table_name = fields_string
3232026-07-01T22:42:56.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 140 table_name = fields_u16
3242026-07-01T22:42:56.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 145 table_name = fields_u32
3252026-07-01T22:42:56.985ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 144 table_name = fields_u8
3262026-07-01T22:42:56.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 472 table_name = fields_uuid
3272026-07-01T22:42:56.987ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = measurements_bool
3282026-07-01T22:42:56.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 205 table_name = measurements_cumulativeu64
3292026-07-01T22:42:56.990ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1 table_name = measurements_f64
3302026-07-01T22:42:56.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = measurements_u64
3312026-07-01T22:42:57.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
3322026-07-01T22:42:57.579ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
3332026-07-01T22:42:57.579ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
3342026-07-01T22:42:57.583ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9d34688-ab2c-4245-a9cd-3f8b14ea0c71", "content-length": "574", "date": "Wed, 01 Jul 2026 22:42:57 GMT"} })
3352026-07-01T22:42:57.583ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
3362026-07-01T22:42:57.587ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8d193d2-5cd2-46b8-98c0-3ea864fdb88d", "content-length": "29", "date": "Wed, 01 Jul 2026 22:42:57 GMT"} })
3372026-07-01T22:42:57.587ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 3 n_pruned_tasks = 0
3382026-07-01T22:42:57.587ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3392026-07-01T22:42:57.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
3402026-07-01T22:42:57.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3412026-07-01T22:42:57.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
3422026-07-01T22:42:57.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3432026-07-01T22:42:57.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
3442026-07-01T22:42:58.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3452026-07-01T22:42:58.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3462026-07-01T22:42:58.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3472026-07-01T22:42:59.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3482026-07-01T22:42:59.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3492026-07-01T22:42:59.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3502026-07-01T22:43:00.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3512026-07-01T22:43:00.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3522026-07-01T22:43:00.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3532026-07-01T22:43:01.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3542026-07-01T22:43:01.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3552026-07-01T22:43:01.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3562026-07-01T22:43:01.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
3572026-07-01T22:43:01.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
3582026-07-01T22:43:01.962ZDEBGoximeter (clickhouse-client): unrolling 153 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
3592026-07-01T22:43:01.966ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
3602026-07-01T22:43:01.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 96 table_name = fields_string
3612026-07-01T22:43:01.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = fields_u16
3622026-07-01T22:43:01.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 75 table_name = fields_uuid
3632026-07-01T22:43:01.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = measurements_cumulativeu64
3642026-07-01T22:43:01.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
3652026-07-01T22:43:01.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
3662026-07-01T22:43:02.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
3672026-07-01T22:43:02.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3682026-07-01T22:43:02.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3692026-07-01T22:43:02.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3702026-07-01T22:43:02.614ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
3712026-07-01T22:43:02.614ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
3722026-07-01T22:43:02.625ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
3732026-07-01T22:43:03.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3742026-07-01T22:43:03.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3752026-07-01T22:43:03.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3762026-07-01T22:43:04.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3772026-07-01T22:43:04.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3782026-07-01T22:43:04.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3792026-07-01T22:43:05.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3802026-07-01T22:43:05.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3812026-07-01T22:43:05.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3822026-07-01T22:43:06.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3832026-07-01T22:43:06.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3842026-07-01T22:43:06.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3852026-07-01T22:43:06.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 270
3862026-07-01T22:43:06.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 270
3872026-07-01T22:43:06.961ZDEBGoximeter (clickhouse-client): unrolling 270 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
3882026-07-01T22:43:06.970ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
3892026-07-01T22:43:06.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 280 table_name = fields_i16
3902026-07-01T22:43:06.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 771 table_name = fields_string
3912026-07-01T22:43:06.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 140 table_name = fields_u16
3922026-07-01T22:43:06.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 145 table_name = fields_u32
3932026-07-01T22:43:06.984ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 144 table_name = fields_u8
3942026-07-01T22:43:06.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 472 table_name = fields_uuid
3952026-07-01T22:43:06.987ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = measurements_bool
3962026-07-01T22:43:06.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 205 table_name = measurements_cumulativeu64
3972026-07-01T22:43:06.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1 table_name = measurements_f64
3982026-07-01T22:43:06.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = measurements_u64
3992026-07-01T22:43:07.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
4002026-07-01T22:43:07.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4012026-07-01T22:43:07.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4022026-07-01T22:43:07.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
4032026-07-01T22:43:07.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
4042026-07-01T22:43:07.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4052026-07-01T22:43:07.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
4062026-07-01T22:43:08.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4072026-07-01T22:43:08.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4082026-07-01T22:43:08.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4092026-07-01T22:43:09.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4102026-07-01T22:43:09.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4112026-07-01T22:43:09.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4122026-07-01T22:43:10.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4132026-07-01T22:43:10.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4142026-07-01T22:43:10.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4152026-07-01T22:43:11.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4162026-07-01T22:43:11.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4172026-07-01T22:43:11.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4182026-07-01T22:43:11.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
4192026-07-01T22:43:11.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
4202026-07-01T22:43:11.961ZDEBGoximeter (clickhouse-client): unrolling 153 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
4212026-07-01T22:43:11.966ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
4222026-07-01T22:43:11.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 96 table_name = fields_string
4232026-07-01T22:43:11.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = fields_u16
4242026-07-01T22:43:11.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 75 table_name = fields_uuid
4252026-07-01T22:43:11.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = measurements_cumulativeu64
4262026-07-01T22:43:11.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
4272026-07-01T22:43:11.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
4282026-07-01T22:43:12.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
4292026-07-01T22:43:12.580ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
4302026-07-01T22:43:12.580ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
4312026-07-01T22:43:12.584ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "ceeeca0a-bf25-4269-8be4-8f10167c5362", "content-length": "991", "date": "Wed, 01 Jul 2026 22:43:12 GMT"} })
4322026-07-01T22:43:12.584ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
4332026-07-01T22:43:12.587ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb79b5b9-e126-44c7-9d4d-3eba809fd009", "content-length": "29", "date": "Wed, 01 Jul 2026 22:43:12 GMT"} })
4342026-07-01T22:43:12.587ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:50026 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0
4352026-07-01T22:43:12.587ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:34774 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50
4362026-07-01T22:43:12.587ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:64505 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8
4372026-07-01T22:43:12.587ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 6 n_pruned_tasks = 0
4382026-07-01T22:43:12.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
4392026-07-01T22:43:12.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
4402026-07-01T22:43:12.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4412026-07-01T22:43:12.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4422026-07-01T22:43:12.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
4432026-07-01T22:43:12.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
4442026-07-01T22:43:12.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
4452026-07-01T22:43:12.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
4462026-07-01T22:43:12.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
4472026-07-01T22:43:12.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
4482026-07-01T22:43:12.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
4492026-07-01T22:43:12.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4502026-07-01T22:43:12.596ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 6 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
4512026-07-01T22:43:12.596ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 8 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
4522026-07-01T22:43:12.602ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
4532026-07-01T22:43:12.614ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
4542026-07-01T22:43:12.614ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
4552026-07-01T22:43:12.626ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
4562026-07-01T22:43:13.127ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 8724 producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
4572026-07-01T22:43:13.182ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 8908
4582026-07-01T22:43:13.185ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 8908
4592026-07-01T22:43:13.185ZDEBGoximeter (clickhouse-client): unrolling 8908 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
4602026-07-01T22:43:13.283ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
4612026-07-01T22:43:13.435ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
4622026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.187609402Z } timeseries_name = database_transaction:retry_data
4632026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:expired_targets"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.418086184Z } timeseries_name = kstat_sampler:expired_targets
4642026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.253108129Z } timeseries_name = sled_cpu:cpu_nsec
4652026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.192133322Z } timeseries_name = sled_data_link:bytes_received
4662026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.192245364Z } timeseries_name = sled_data_link:bytes_sent
4672026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.192018659Z } timeseries_name = sled_data_link:errors_received
4682026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.192076260Z } timeseries_name = sled_data_link:errors_sent
4692026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.192189503Z } timeseries_name = sled_data_link:packets_received
4702026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.192301345Z } timeseries_name = sled_data_link:packets_sent
4712026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.419346049Z } timeseries_name = zfs_dataset:bytes_used
4722026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.418582124Z } timeseries_name = zfs_pool:bytes_allocated
4732026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.418639575Z } timeseries_name = zfs_pool:bytes_total
4742026-07-01T22:43:13.439ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:13.199022328Z } timeseries_name = zone:cpu_nsec
4752026-07-01T22:43:13.478ZDEBGoximeter (clickhouse-client): inserting 13 new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
4762026-07-01T22:43:13.481ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 280 table_name = fields_i16
4772026-07-01T22:43:13.483ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 8 table_name = fields_ipaddr
4782026-07-01T22:43:13.486ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 3994 table_name = fields_string
4792026-07-01T22:43:13.488ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 164 table_name = fields_u16
4802026-07-01T22:43:13.489ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1099 table_name = fields_u32
4812026-07-01T22:43:13.491ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 144 table_name = fields_u8
4822026-07-01T22:43:13.493ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 2299 table_name = fields_uuid
4832026-07-01T22:43:13.494ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = measurements_bool
4842026-07-01T22:43:13.499ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 8236 table_name = measurements_cumulativeu64
4852026-07-01T22:43:13.500ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 2 table_name = measurements_f64
4862026-07-01T22:43:13.502ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 16 table_name = measurements_histogramu64
4872026-07-01T22:43:13.503ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 6 table_name = measurements_i64
4882026-07-01T22:43:13.504ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 644 table_name = measurements_u64
4892026-07-01T22:43:13.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4902026-07-01T22:43:13.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4912026-07-01T22:43:13.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4922026-07-01T22:43:14.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4932026-07-01T22:43:14.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4942026-07-01T22:43:14.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4952026-07-01T22:43:15.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4962026-07-01T22:43:15.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4972026-07-01T22:43:15.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4982026-07-01T22:43:16.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4992026-07-01T22:43:16.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5002026-07-01T22:43:16.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5012026-07-01T22:43:16.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 104
5022026-07-01T22:43:16.962ZDEBGoximeter (clickhouse-client): unrolling 104 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
5032026-07-01T22:43:16.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 104
5042026-07-01T22:43:16.965ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
5052026-07-01T22:43:16.971ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 50 table_name = fields_string
5062026-07-01T22:43:16.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 52 table_name = fields_uuid
5072026-07-01T22:43:16.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 80 table_name = measurements_cumulativeu64
5082026-07-01T22:43:16.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 24 table_name = measurements_u64
5092026-07-01T22:43:17.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
5102026-07-01T22:43:17.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5112026-07-01T22:43:17.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5122026-07-01T22:43:17.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
5132026-07-01T22:43:17.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
5142026-07-01T22:43:17.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5152026-07-01T22:43:17.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
5162026-07-01T22:43:18.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5172026-07-01T22:43:18.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5182026-07-01T22:43:18.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5192026-07-01T22:43:19.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5202026-07-01T22:43:19.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5212026-07-01T22:43:19.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5222026-07-01T22:43:20.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5232026-07-01T22:43:20.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5242026-07-01T22:43:20.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5252026-07-01T22:43:21.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5262026-07-01T22:43:21.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5272026-07-01T22:43:21.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5282026-07-01T22:43:21.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
5292026-07-01T22:43:21.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
5302026-07-01T22:43:21.962ZDEBGoximeter (clickhouse-client): unrolling 153 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
5312026-07-01T22:43:21.966ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
5322026-07-01T22:43:21.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 96 table_name = fields_string
5332026-07-01T22:43:21.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = fields_u16
5342026-07-01T22:43:21.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 75 table_name = fields_uuid
5352026-07-01T22:43:21.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = measurements_cumulativeu64
5362026-07-01T22:43:21.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
5372026-07-01T22:43:21.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
5382026-07-01T22:43:22.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
5392026-07-01T22:43:22.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402026-07-01T22:43:22.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5412026-07-01T22:43:22.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
5422026-07-01T22:43:22.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
5432026-07-01T22:43:22.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
5442026-07-01T22:43:22.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
5452026-07-01T22:43:22.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
5462026-07-01T22:43:22.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
5472026-07-01T22:43:22.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5482026-07-01T22:43:22.615ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
5492026-07-01T22:43:22.615ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
5502026-07-01T22:43:22.626ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
5512026-07-01T22:43:23.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5522026-07-01T22:43:23.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5532026-07-01T22:43:23.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5542026-07-01T22:43:24.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5552026-07-01T22:43:24.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5562026-07-01T22:43:24.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5572026-07-01T22:43:25.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5582026-07-01T22:43:25.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5592026-07-01T22:43:25.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5602026-07-01T22:43:26.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5612026-07-01T22:43:26.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5622026-07-01T22:43:26.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5632026-07-01T22:43:26.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 277
5642026-07-01T22:43:26.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 277
5652026-07-01T22:43:26.961ZDEBGoximeter (clickhouse-client): unrolling 277 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
5662026-07-01T22:43:26.970ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
5672026-07-01T22:43:26.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 280 table_name = fields_i16
5682026-07-01T22:43:26.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 785 table_name = fields_string
5692026-07-01T22:43:26.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 147 table_name = fields_u16
5702026-07-01T22:43:26.984ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 145 table_name = fields_u32
5712026-07-01T22:43:26.985ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 144 table_name = fields_u8
5722026-07-01T22:43:26.987ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 479 table_name = fields_uuid
5732026-07-01T22:43:26.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = measurements_bool
5742026-07-01T22:43:26.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 205 table_name = measurements_cumulativeu64
5752026-07-01T22:43:26.990ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1 table_name = measurements_f64
5762026-07-01T22:43:26.992ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 7 table_name = measurements_histogramu64
5772026-07-01T22:43:26.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = measurements_u64
5782026-07-01T22:43:27.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
5792026-07-01T22:43:27.579ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
5802026-07-01T22:43:27.579ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
5812026-07-01T22:43:27.584ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f793d06b-d5d2-4177-a879-7fdfc56a8fa2", "content-length": "991", "date": "Wed, 01 Jul 2026 22:43:27 GMT"} })
5822026-07-01T22:43:27.584ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
5832026-07-01T22:43:27.587ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "064ed11d-2b39-4c6e-8e82-00aef657a97a", "content-length": "29", "date": "Wed, 01 Jul 2026 22:43:27 GMT"} })
5842026-07-01T22:43:27.587ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:54287 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436
5852026-07-01T22:43:27.587ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:54287 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
5862026-07-01T22:43:27.587ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
5872026-07-01T22:43:27.587ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 6 n_pruned_tasks = 0
5882026-07-01T22:43:27.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
5892026-07-01T22:43:27.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
5902026-07-01T22:43:27.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
5912026-07-01T22:43:27.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5922026-07-01T22:43:27.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5932026-07-01T22:43:27.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5942026-07-01T22:43:27.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
5952026-07-01T22:43:27.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
5962026-07-01T22:43:27.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5972026-07-01T22:43:27.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
5982026-07-01T22:43:27.631ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 408 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
5992026-07-01T22:43:28.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6002026-07-01T22:43:28.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6012026-07-01T22:43:28.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6022026-07-01T22:43:29.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6032026-07-01T22:43:29.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6042026-07-01T22:43:29.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6052026-07-01T22:43:30.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6062026-07-01T22:43:30.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6072026-07-01T22:43:30.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6082026-07-01T22:43:31.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6092026-07-01T22:43:31.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6102026-07-01T22:43:31.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6112026-07-01T22:43:31.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 563
6122026-07-01T22:43:31.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 563
6132026-07-01T22:43:31.962ZDEBGoximeter (clickhouse-client): unrolling 563 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
6142026-07-01T22:43:31.978ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
6152026-07-01T22:43:31.981ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:31.964403224Z } timeseries_name = switch_port_control_data_link:bytes_received
6162026-07-01T22:43:31.981ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:31.964522706Z } timeseries_name = switch_port_control_data_link:bytes_sent
6172026-07-01T22:43:31.981ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:31.964281311Z } timeseries_name = switch_port_control_data_link:errors_received
6182026-07-01T22:43:31.981ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:31.964342583Z } timeseries_name = switch_port_control_data_link:errors_sent
6192026-07-01T22:43:31.981ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:31.964463205Z } timeseries_name = switch_port_control_data_link:packets_received
6202026-07-01T22:43:31.981ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:43:31.964581857Z } timeseries_name = switch_port_control_data_link:packets_sent
6212026-07-01T22:43:31.985ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
6222026-07-01T22:43:31.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 24 table_name = fields_i16
6232026-07-01T22:43:31.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = fields_ipaddr
6242026-07-01T22:43:31.990ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 218 table_name = fields_string
6252026-07-01T22:43:31.992ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 39 table_name = fields_u16
6262026-07-01T22:43:31.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 24 table_name = fields_u32
6272026-07-01T22:43:31.994ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 12 table_name = fields_u8
6282026-07-01T22:43:31.995ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 115 table_name = fields_uuid
6292026-07-01T22:43:31.997ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 510 table_name = measurements_cumulativeu64
6302026-07-01T22:43:31.999ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
6312026-07-01T22:43:32.000ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
6322026-07-01T22:43:32.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
6332026-07-01T22:43:32.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6342026-07-01T22:43:32.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6352026-07-01T22:43:32.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
6362026-07-01T22:43:32.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
6372026-07-01T22:43:32.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
6382026-07-01T22:43:32.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
6392026-07-01T22:43:32.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
6402026-07-01T22:43:32.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
6412026-07-01T22:43:32.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6422026-07-01T22:43:33.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6432026-07-01T22:43:33.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6442026-07-01T22:43:33.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6452026-07-01T22:43:34.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6462026-07-01T22:43:34.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6472026-07-01T22:43:34.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6482026-07-01T22:43:35.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6492026-07-01T22:43:35.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6502026-07-01T22:43:35.593ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6512026-07-01T22:43:36.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6522026-07-01T22:43:36.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6532026-07-01T22:43:36.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6542026-07-01T22:43:36.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 137
6552026-07-01T22:43:36.962ZDEBGoximeter (clickhouse-client): unrolling 137 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
6562026-07-01T22:43:36.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 137
6572026-07-01T22:43:36.966ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
6582026-07-01T22:43:36.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 64 table_name = fields_string
6592026-07-01T22:43:36.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 7 table_name = fields_u16
6602026-07-01T22:43:36.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 59 table_name = fields_uuid
6612026-07-01T22:43:36.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = measurements_cumulativeu64
6622026-07-01T22:43:36.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 7 table_name = measurements_histogramu64
6632026-07-01T22:43:36.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
6642026-07-01T22:43:37.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
6652026-07-01T22:43:37.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6662026-07-01T22:43:37.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6672026-07-01T22:43:37.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
6682026-07-01T22:43:37.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
6692026-07-01T22:43:37.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6702026-07-01T22:43:37.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
6712026-07-01T22:43:38.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6722026-07-01T22:43:38.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6732026-07-01T22:43:38.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6742026-07-01T22:43:39.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6752026-07-01T22:43:39.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6762026-07-01T22:43:39.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6772026-07-01T22:43:40.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6782026-07-01T22:43:40.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6792026-07-01T22:43:40.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6802026-07-01T22:43:41.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6812026-07-01T22:43:41.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6822026-07-01T22:43:41.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6832026-07-01T22:43:41.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
6842026-07-01T22:43:41.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
6852026-07-01T22:43:41.962ZDEBGoximeter (clickhouse-client): unrolling 153 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
6862026-07-01T22:43:41.967ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
6872026-07-01T22:43:41.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 96 table_name = fields_string
6882026-07-01T22:43:41.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = fields_u16
6892026-07-01T22:43:41.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 75 table_name = fields_uuid
6902026-07-01T22:43:41.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = measurements_cumulativeu64
6912026-07-01T22:43:41.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
6922026-07-01T22:43:41.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
6932026-07-01T22:43:42.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
6942026-07-01T22:43:42.580ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
6952026-07-01T22:43:42.580ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
6962026-07-01T22:43:42.583ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "be008fbc-a83c-4266-8af3-7b2cb9986a5a", "content-length": "991", "date": "Wed, 01 Jul 2026 22:43:42 GMT"} })
6972026-07-01T22:43:42.583ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
6982026-07-01T22:43:42.586ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ccc44c9-1da8-4f43-99cd-424001be9f2e", "content-length": "29", "date": "Wed, 01 Jul 2026 22:43:42 GMT"} })
6992026-07-01T22:43:42.586ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 6 n_pruned_tasks = 0
7002026-07-01T22:43:42.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7012026-07-01T22:43:42.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
7022026-07-01T22:43:42.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
7032026-07-01T22:43:42.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7042026-07-01T22:43:42.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
7052026-07-01T22:43:42.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
7062026-07-01T22:43:42.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
7072026-07-01T22:43:42.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
7082026-07-01T22:43:42.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
7092026-07-01T22:43:42.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
7102026-07-01T22:43:42.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7112026-07-01T22:43:42.659ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1692 producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
7122026-07-01T22:43:42.662ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 1725
7132026-07-01T22:43:42.662ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 1725
7142026-07-01T22:43:42.662ZDEBGoximeter (clickhouse-client): unrolling 1725 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
7152026-07-01T22:43:42.710ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
7162026-07-01T22:43:42.726ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 2407 table_name = fields_string
7172026-07-01T22:43:42.727ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 16 table_name = fields_u16
7182026-07-01T22:43:42.729ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 801 table_name = fields_u32
7192026-07-01T22:43:42.731ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1283 table_name = fields_uuid
7202026-07-01T22:43:42.733ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1703 table_name = measurements_cumulativeu64
7212026-07-01T22:43:42.735ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 16 table_name = measurements_histogramu64
7222026-07-01T22:43:42.736ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 6 table_name = measurements_u64
7232026-07-01T22:43:42.763ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
7242026-07-01T22:43:43.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7252026-07-01T22:43:43.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7262026-07-01T22:43:43.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7272026-07-01T22:43:44.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7282026-07-01T22:43:44.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7292026-07-01T22:43:44.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7302026-07-01T22:43:45.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7312026-07-01T22:43:45.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7322026-07-01T22:43:45.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7332026-07-01T22:43:46.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7342026-07-01T22:43:46.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7352026-07-01T22:43:46.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7362026-07-01T22:43:46.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 104
7372026-07-01T22:43:46.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 104
7382026-07-01T22:43:46.962ZDEBGoximeter (clickhouse-client): unrolling 104 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
7392026-07-01T22:43:46.965ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
7402026-07-01T22:43:46.970ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 50 table_name = fields_string
7412026-07-01T22:43:46.971ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 52 table_name = fields_uuid
7422026-07-01T22:43:46.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 80 table_name = measurements_cumulativeu64
7432026-07-01T22:43:46.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 24 table_name = measurements_u64
7442026-07-01T22:43:47.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
7452026-07-01T22:43:47.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7462026-07-01T22:43:47.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7472026-07-01T22:43:47.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
7482026-07-01T22:43:47.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
7492026-07-01T22:43:47.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7502026-07-01T22:43:47.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
7512026-07-01T22:43:48.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7522026-07-01T22:43:48.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7532026-07-01T22:43:48.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7542026-07-01T22:43:49.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7552026-07-01T22:43:49.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7562026-07-01T22:43:49.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7572026-07-01T22:43:50.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7582026-07-01T22:43:50.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7592026-07-01T22:43:50.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7602026-07-01T22:43:51.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7612026-07-01T22:43:51.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7622026-07-01T22:43:51.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7632026-07-01T22:43:51.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
7642026-07-01T22:43:51.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 153
7652026-07-01T22:43:51.962ZDEBGoximeter (clickhouse-client): unrolling 153 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
7662026-07-01T22:43:51.967ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
7672026-07-01T22:43:51.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 96 table_name = fields_string
7682026-07-01T22:43:51.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = fields_u16
7692026-07-01T22:43:51.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 75 table_name = fields_uuid
7702026-07-01T22:43:51.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = measurements_cumulativeu64
7712026-07-01T22:43:51.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
7722026-07-01T22:43:51.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
7732026-07-01T22:43:52.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
7742026-07-01T22:43:52.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7752026-07-01T22:43:52.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7762026-07-01T22:43:52.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
7772026-07-01T22:43:52.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
7782026-07-01T22:43:52.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
7792026-07-01T22:43:52.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
7802026-07-01T22:43:52.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
7812026-07-01T22:43:52.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
7822026-07-01T22:43:52.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7832026-07-01T22:43:53.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7842026-07-01T22:43:53.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7852026-07-01T22:43:53.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7862026-07-01T22:43:54.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7872026-07-01T22:43:54.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7882026-07-01T22:43:54.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7892026-07-01T22:43:55.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7902026-07-01T22:43:55.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7912026-07-01T22:43:55.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7922026-07-01T22:43:56.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7932026-07-01T22:43:56.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7942026-07-01T22:43:56.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7952026-07-01T22:43:56.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 137
7962026-07-01T22:43:56.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 137
7972026-07-01T22:43:56.962ZDEBGoximeter (clickhouse-client): unrolling 137 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
7982026-07-01T22:43:56.966ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
7992026-07-01T22:43:56.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 64 table_name = fields_string
8002026-07-01T22:43:56.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 7 table_name = fields_u16
8012026-07-01T22:43:56.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 59 table_name = fields_uuid
8022026-07-01T22:43:56.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = measurements_cumulativeu64
8032026-07-01T22:43:56.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 7 table_name = measurements_histogramu64
8042026-07-01T22:43:56.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 30 table_name = measurements_u64
8052026-07-01T22:43:57.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
8062026-07-01T22:43:57.580ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
8072026-07-01T22:43:57.580ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
8082026-07-01T22:43:57.584ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b83dea3-67cd-45ea-8dbe-9038eaff5f24", "content-length": "1127", "date": "Wed, 01 Jul 2026 22:43:57 GMT"} })
8092026-07-01T22:43:57.584ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
8102026-07-01T22:43:57.588ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "6da04900-40d3-4ea6-b708-e210e27b285d", "content-length": "29", "date": "Wed, 01 Jul 2026 22:43:57 GMT"} })
8112026-07-01T22:43:57.588ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41
8122026-07-01T22:43:57.588ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 7 n_pruned_tasks = 0
8132026-07-01T22:43:57.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8142026-07-01T22:43:57.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
8152026-07-01T22:43:57.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
8162026-07-01T22:43:57.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8172026-07-01T22:43:57.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8182026-07-01T22:43:57.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
8192026-07-01T22:43:57.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
8202026-07-01T22:43:57.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8212026-07-01T22:43:57.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8222026-07-01T22:43:57.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8232026-07-01T22:43:57.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 36 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
8242026-07-01T22:43:57.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
8252026-07-01T22:43:57.595ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8262026-07-01T22:43:58.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8272026-07-01T22:43:58.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8282026-07-01T22:43:58.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8292026-07-01T22:43:58.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8302026-07-01T22:43:58.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8312026-07-01T22:43:58.598ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8322026-07-01T22:43:59.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8332026-07-01T22:43:59.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8342026-07-01T22:43:59.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8352026-07-01T22:43:59.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8362026-07-01T22:43:59.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8372026-07-01T22:43:59.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8382026-07-01T22:44:00.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8392026-07-01T22:44:00.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8402026-07-01T22:44:00.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8412026-07-01T22:44:00.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8422026-07-01T22:44:00.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8432026-07-01T22:44:00.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8442026-07-01T22:44:01.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8452026-07-01T22:44:01.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8462026-07-01T22:44:01.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8472026-07-01T22:44:01.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8482026-07-01T22:44:01.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8492026-07-01T22:44:01.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8502026-07-01T22:44:01.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 210
8512026-07-01T22:44:01.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 210
8522026-07-01T22:44:01.961ZDEBGoximeter (clickhouse-client): unrolling 210 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
8532026-07-01T22:44:01.968ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
8542026-07-01T22:44:01.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:44:01.965322699Z } timeseries_name = mg_lower:routes_blocked_by_link_state
8552026-07-01T22:44:01.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:44:01.965210077Z } timeseries_name = static_routing_config:static_nexthops
8562026-07-01T22:44:01.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:44:01.965153836Z } timeseries_name = static_routing_config:static_routes
8572026-07-01T22:44:01.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-01T22:44:01.965266549Z } timeseries_name = switch_rib:active_routes
8582026-07-01T22:44:01.974ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
8592026-07-01T22:44:01.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 24 table_name = fields_i16
8602026-07-01T22:44:01.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 2 table_name = fields_ipaddr
8612026-07-01T22:44:01.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 221 table_name = fields_string
8622026-07-01T22:44:01.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 37 table_name = fields_u16
8632026-07-01T22:44:01.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 24 table_name = fields_u32
8642026-07-01T22:44:01.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 12 table_name = fields_u8
8652026-07-01T22:44:01.985ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 121 table_name = fields_uuid
8662026-07-01T22:44:01.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 147 table_name = measurements_cumulativeu64
8672026-07-01T22:44:01.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
8682026-07-01T22:44:01.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 40 table_name = measurements_u64
8692026-07-01T22:44:02.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
8702026-07-01T22:44:02.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8712026-07-01T22:44:02.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8722026-07-01T22:44:02.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
8732026-07-01T22:44:02.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8742026-07-01T22:44:02.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
8752026-07-01T22:44:02.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
8762026-07-01T22:44:02.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8772026-07-01T22:44:02.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
8782026-07-01T22:44:02.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
8792026-07-01T22:44:02.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8802026-07-01T22:44:02.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
8812026-07-01T22:44:02.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8822026-07-01T22:44:03.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8832026-07-01T22:44:03.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8842026-07-01T22:44:03.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8852026-07-01T22:44:03.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8862026-07-01T22:44:03.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8872026-07-01T22:44:03.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8882026-07-01T22:44:04.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8892026-07-01T22:44:04.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8902026-07-01T22:44:04.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8912026-07-01T22:44:04.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8922026-07-01T22:44:04.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8932026-07-01T22:44:04.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8942026-07-01T22:44:05.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8952026-07-01T22:44:05.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8962026-07-01T22:44:05.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8972026-07-01T22:44:05.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8982026-07-01T22:44:05.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8992026-07-01T22:44:05.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9002026-07-01T22:44:06.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9012026-07-01T22:44:06.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9022026-07-01T22:44:06.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9032026-07-01T22:44:06.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9042026-07-01T22:44:06.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9052026-07-01T22:44:06.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9062026-07-01T22:44:06.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 157
9072026-07-01T22:44:06.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 157
9082026-07-01T22:44:06.962ZDEBGoximeter (clickhouse-client): unrolling 157 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
9092026-07-01T22:44:06.967ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
9102026-07-01T22:44:06.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 68 table_name = fields_string
9112026-07-01T22:44:06.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 7 table_name = fields_u16
9122026-07-01T22:44:06.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 67 table_name = fields_uuid
9132026-07-01T22:44:06.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 110 table_name = measurements_cumulativeu64
9142026-07-01T22:44:06.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 7 table_name = measurements_histogramu64
9152026-07-01T22:44:06.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 40 table_name = measurements_u64
9162026-07-01T22:44:07.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
9172026-07-01T22:44:07.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9182026-07-01T22:44:07.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
9192026-07-01T22:44:07.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9202026-07-01T22:44:07.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
9212026-07-01T22:44:07.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9222026-07-01T22:44:07.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9232026-07-01T22:44:07.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9242026-07-01T22:44:07.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9252026-07-01T22:44:07.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
9262026-07-01T22:44:08.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9272026-07-01T22:44:08.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9282026-07-01T22:44:08.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9292026-07-01T22:44:08.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9302026-07-01T22:44:08.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9312026-07-01T22:44:08.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9322026-07-01T22:44:09.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9332026-07-01T22:44:09.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9342026-07-01T22:44:09.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9352026-07-01T22:44:09.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9362026-07-01T22:44:09.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9372026-07-01T22:44:09.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9382026-07-01T22:44:10.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9392026-07-01T22:44:10.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9402026-07-01T22:44:10.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9412026-07-01T22:44:10.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9422026-07-01T22:44:10.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9432026-07-01T22:44:10.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9442026-07-01T22:44:11.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9452026-07-01T22:44:11.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9462026-07-01T22:44:11.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9472026-07-01T22:44:11.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9482026-07-01T22:44:11.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9492026-07-01T22:44:11.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9502026-07-01T22:44:11.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 173
9512026-07-01T22:44:11.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 173
9522026-07-01T22:44:11.962ZDEBGoximeter (clickhouse-client): unrolling 173 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
9532026-07-01T22:44:11.968ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
9542026-07-01T22:44:11.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = fields_string
9552026-07-01T22:44:11.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = fields_u16
9562026-07-01T22:44:11.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 83 table_name = fields_uuid
9572026-07-01T22:44:11.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 110 table_name = measurements_cumulativeu64
9582026-07-01T22:44:11.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
9592026-07-01T22:44:11.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 40 table_name = measurements_u64
9602026-07-01T22:44:12.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
9612026-07-01T22:44:12.580ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
9622026-07-01T22:44:12.580ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
9632026-07-01T22:44:12.583ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ad97453-df25-4228-9d32-73063a812d9d", "content-length": "1276", "date": "Wed, 01 Jul 2026 22:44:12 GMT"} })
9642026-07-01T22:44:12.583ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
9652026-07-01T22:44:12.586ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e13f2603-ad1b-48be-9610-e0447beb2347", "content-length": "29", "date": "Wed, 01 Jul 2026 22:44:12 GMT"} })
9662026-07-01T22:44:12.586ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:38883 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b
9672026-07-01T22:44:12.586ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 8 n_pruned_tasks = 0
9682026-07-01T22:44:12.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
9692026-07-01T22:44:12.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
9702026-07-01T22:44:12.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
9712026-07-01T22:44:12.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9722026-07-01T22:44:12.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9732026-07-01T22:44:12.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
9742026-07-01T22:44:12.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
9752026-07-01T22:44:12.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
9762026-07-01T22:44:12.588ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
9772026-07-01T22:44:12.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9782026-07-01T22:44:12.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9792026-07-01T22:44:12.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
9802026-07-01T22:44:12.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
9812026-07-01T22:44:12.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
9822026-07-01T22:44:12.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
9832026-07-01T22:44:12.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
9842026-07-01T22:44:12.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9852026-07-01T22:44:12.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
9862026-07-01T22:44:12.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
9872026-07-01T22:44:12.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9882026-07-01T22:44:12.596ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
9892026-07-01T22:44:12.602ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
9902026-07-01T22:44:12.669ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1844 producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
9912026-07-01T22:44:12.673ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 1897
9922026-07-01T22:44:12.673ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 1897
9932026-07-01T22:44:12.673ZDEBGoximeter (clickhouse-client): unrolling 1897 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
9942026-07-01T22:44:12.726ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
9952026-07-01T22:44:12.744ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 10 table_name = fields_ipaddr
9962026-07-01T22:44:12.747ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 3298 table_name = fields_string
9972026-07-01T22:44:12.748ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 37 table_name = fields_u16
9982026-07-01T22:44:12.749ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 953 table_name = fields_u32
9992026-07-01T22:44:12.751ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1894 table_name = fields_uuid
10002026-07-01T22:44:12.753ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1710 table_name = measurements_cumulativeu64
10012026-07-01T22:44:12.755ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 27 table_name = measurements_histogramu64
10022026-07-01T22:44:12.756ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 160 table_name = measurements_u64
10032026-07-01T22:44:12.773ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
10042026-07-01T22:44:13.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10052026-07-01T22:44:13.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10062026-07-01T22:44:13.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10072026-07-01T22:44:13.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10082026-07-01T22:44:13.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10092026-07-01T22:44:13.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10102026-07-01T22:44:14.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10112026-07-01T22:44:14.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10122026-07-01T22:44:14.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10132026-07-01T22:44:14.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10142026-07-01T22:44:14.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10152026-07-01T22:44:14.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10162026-07-01T22:44:15.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10172026-07-01T22:44:15.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10182026-07-01T22:44:15.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10192026-07-01T22:44:15.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10202026-07-01T22:44:15.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10212026-07-01T22:44:15.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10222026-07-01T22:44:16.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10232026-07-01T22:44:16.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10242026-07-01T22:44:16.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10252026-07-01T22:44:16.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10262026-07-01T22:44:16.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10272026-07-01T22:44:16.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10282026-07-01T22:44:16.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 120
10292026-07-01T22:44:16.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 120
10302026-07-01T22:44:16.962ZDEBGoximeter (clickhouse-client): unrolling 120 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
10312026-07-01T22:44:16.966ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
10322026-07-01T22:44:16.971ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 54 table_name = fields_string
10332026-07-01T22:44:16.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = fields_uuid
10342026-07-01T22:44:16.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 88 table_name = measurements_cumulativeu64
10352026-07-01T22:44:16.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 32 table_name = measurements_u64
10362026-07-01T22:44:17.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
10372026-07-01T22:44:17.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10382026-07-01T22:44:17.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10392026-07-01T22:44:17.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
10402026-07-01T22:44:17.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
10412026-07-01T22:44:17.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10422026-07-01T22:44:17.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10432026-07-01T22:44:17.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10442026-07-01T22:44:17.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10452026-07-01T22:44:17.593ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
10462026-07-01T22:44:18.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10472026-07-01T22:44:18.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10482026-07-01T22:44:18.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10492026-07-01T22:44:18.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10502026-07-01T22:44:18.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10512026-07-01T22:44:18.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10522026-07-01T22:44:19.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10532026-07-01T22:44:19.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10542026-07-01T22:44:19.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10552026-07-01T22:44:19.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10562026-07-01T22:44:19.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10572026-07-01T22:44:19.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10582026-07-01T22:44:20.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10592026-07-01T22:44:20.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10602026-07-01T22:44:20.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10612026-07-01T22:44:20.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10622026-07-01T22:44:20.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10632026-07-01T22:44:20.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10642026-07-01T22:44:21.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10652026-07-01T22:44:21.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10662026-07-01T22:44:21.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10672026-07-01T22:44:21.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10682026-07-01T22:44:21.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10692026-07-01T22:44:21.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10702026-07-01T22:44:21.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 173
10712026-07-01T22:44:21.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 173
10722026-07-01T22:44:21.961ZDEBGoximeter (clickhouse-client): unrolling 173 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
10732026-07-01T22:44:21.967ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
10742026-07-01T22:44:21.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 100 table_name = fields_string
10752026-07-01T22:44:21.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = fields_u16
10762026-07-01T22:44:21.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 83 table_name = fields_uuid
10772026-07-01T22:44:21.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 110 table_name = measurements_cumulativeu64
10782026-07-01T22:44:21.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
10792026-07-01T22:44:21.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 40 table_name = measurements_u64
10802026-07-01T22:44:22.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
10812026-07-01T22:44:22.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
10822026-07-01T22:44:22.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
10832026-07-01T22:44:22.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10842026-07-01T22:44:22.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10852026-07-01T22:44:22.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
10862026-07-01T22:44:22.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
10872026-07-01T22:44:22.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
10882026-07-01T22:44:22.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
10892026-07-01T22:44:22.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10902026-07-01T22:44:22.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10912026-07-01T22:44:22.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10922026-07-01T22:44:22.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
10932026-07-01T22:44:22.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
10942026-07-01T22:44:22.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
10952026-07-01T22:44:22.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10962026-07-01T22:44:23.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10972026-07-01T22:44:23.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10982026-07-01T22:44:23.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10992026-07-01T22:44:23.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11002026-07-01T22:44:23.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11012026-07-01T22:44:23.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11022026-07-01T22:44:24.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11032026-07-01T22:44:24.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11042026-07-01T22:44:24.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11052026-07-01T22:44:24.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11062026-07-01T22:44:24.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11072026-07-01T22:44:24.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11082026-07-01T22:44:25.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11092026-07-01T22:44:25.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11102026-07-01T22:44:25.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11112026-07-01T22:44:25.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11122026-07-01T22:44:25.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11132026-07-01T22:44:25.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11142026-07-01T22:44:26.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11152026-07-01T22:44:26.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11162026-07-01T22:44:26.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11172026-07-01T22:44:26.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11182026-07-01T22:44:26.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11192026-07-01T22:44:26.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11202026-07-01T22:44:26.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 168
11212026-07-01T22:44:26.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 168
11222026-07-01T22:44:26.962ZDEBGoximeter (clickhouse-client): unrolling 168 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
11232026-07-01T22:44:26.967ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
11242026-07-01T22:44:26.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 90 table_name = fields_string
11252026-07-01T22:44:26.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 18 table_name = fields_u16
11262026-07-01T22:44:26.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 78 table_name = fields_uuid
11272026-07-01T22:44:26.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 110 table_name = measurements_cumulativeu64
11282026-07-01T22:44:26.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 18 table_name = measurements_histogramu64
11292026-07-01T22:44:26.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 40 table_name = measurements_u64
11302026-07-01T22:44:27.062ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
11312026-07-01T22:44:27.580ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
11322026-07-01T22:44:27.580ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
11332026-07-01T22:44:27.584ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "98513c24-aa25-41ad-96d3-37e2b3d9a099", "content-length": "1412", "date": "Wed, 01 Jul 2026 22:44:27 GMT"} })
11342026-07-01T22:44:27.584ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
11352026-07-01T22:44:27.588ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4e213bb-a1cf-4a5f-af8e-b9bdc575fc20", "content-length": "29", "date": "Wed, 01 Jul 2026 22:44:27 GMT"} })
11362026-07-01T22:44:27.588ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078
11372026-07-01T22:44:27.588ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
11382026-07-01T22:44:27.589ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11392026-07-01T22:44:27.589ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11402026-07-01T22:44:27.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
11412026-07-01T22:44:27.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
11422026-07-01T22:44:27.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11432026-07-01T22:44:27.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11442026-07-01T22:44:27.589ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
11452026-07-01T22:44:27.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11462026-07-01T22:44:27.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11472026-07-01T22:44:27.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11482026-07-01T22:44:27.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11492026-07-01T22:44:27.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
11502026-07-01T22:44:27.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
11512026-07-01T22:44:27.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11522026-07-01T22:44:27.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11532026-07-01T22:44:27.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 36 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
11542026-07-01T22:44:27.593ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
11552026-07-01T22:44:27.597ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11562026-07-01T22:44:28.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11572026-07-01T22:44:28.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11582026-07-01T22:44:28.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11592026-07-01T22:44:28.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11602026-07-01T22:44:28.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11612026-07-01T22:44:28.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11622026-07-01T22:44:28.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11632026-07-01T22:44:28.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11642026-07-01T22:44:28.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11652026-07-01T22:44:29.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11662026-07-01T22:44:29.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11672026-07-01T22:44:29.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11682026-07-01T22:44:29.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11692026-07-01T22:44:29.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11702026-07-01T22:44:29.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11712026-07-01T22:44:29.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11722026-07-01T22:44:29.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11732026-07-01T22:44:29.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11742026-07-01T22:44:30.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11752026-07-01T22:44:30.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11762026-07-01T22:44:30.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11772026-07-01T22:44:30.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11782026-07-01T22:44:30.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11792026-07-01T22:44:30.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11802026-07-01T22:44:30.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11812026-07-01T22:44:30.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11822026-07-01T22:44:30.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11832026-07-01T22:44:31.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11842026-07-01T22:44:31.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11852026-07-01T22:44:31.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11862026-07-01T22:44:31.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11872026-07-01T22:44:31.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11882026-07-01T22:44:31.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11892026-07-01T22:44:31.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11902026-07-01T22:44:31.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11912026-07-01T22:44:31.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11922026-07-01T22:44:31.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 282
11932026-07-01T22:44:31.961ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 282
11942026-07-01T22:44:31.961ZDEBGoximeter (clickhouse-client): unrolling 282 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
11952026-07-01T22:44:31.970ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
11962026-07-01T22:44:31.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 24 table_name = fields_i16
11972026-07-01T22:44:31.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 6 table_name = fields_ipaddr
11982026-07-01T22:44:31.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 249 table_name = fields_string
11992026-07-01T22:44:31.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 41 table_name = fields_u16
12002026-07-01T22:44:31.984ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 24 table_name = fields_u32
12012026-07-01T22:44:31.985ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 12 table_name = fields_u8
12022026-07-01T22:44:31.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 153 table_name = fields_uuid
12032026-07-01T22:44:31.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 199 table_name = measurements_cumulativeu64
12042026-07-01T22:44:31.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
12052026-07-01T22:44:31.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = measurements_u64
12062026-07-01T22:44:32.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
12072026-07-01T22:44:32.587ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
12082026-07-01T22:44:32.587ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
12092026-07-01T22:44:32.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12102026-07-01T22:44:32.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12112026-07-01T22:44:32.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
12122026-07-01T22:44:32.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12132026-07-01T22:44:32.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12142026-07-01T22:44:32.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12152026-07-01T22:44:32.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12162026-07-01T22:44:32.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
12172026-07-01T22:44:32.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
12182026-07-01T22:44:32.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
12192026-07-01T22:44:32.589ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
12202026-07-01T22:44:32.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12212026-07-01T22:44:32.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
12222026-07-01T22:44:32.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
12232026-07-01T22:44:32.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12242026-07-01T22:44:32.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12252026-07-01T22:44:33.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12262026-07-01T22:44:33.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12272026-07-01T22:44:33.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12282026-07-01T22:44:33.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12292026-07-01T22:44:33.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12302026-07-01T22:44:33.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12312026-07-01T22:44:33.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12322026-07-01T22:44:33.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12332026-07-01T22:44:33.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12342026-07-01T22:44:34.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12352026-07-01T22:44:34.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12362026-07-01T22:44:34.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12372026-07-01T22:44:34.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12382026-07-01T22:44:34.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12392026-07-01T22:44:34.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12402026-07-01T22:44:34.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12412026-07-01T22:44:34.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12422026-07-01T22:44:34.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12432026-07-01T22:44:35.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12442026-07-01T22:44:35.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12452026-07-01T22:44:35.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12462026-07-01T22:44:35.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12472026-07-01T22:44:35.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12482026-07-01T22:44:35.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12492026-07-01T22:44:35.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12502026-07-01T22:44:35.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12512026-07-01T22:44:35.593ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12522026-07-01T22:44:36.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12532026-07-01T22:44:36.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12542026-07-01T22:44:36.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12552026-07-01T22:44:36.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12562026-07-01T22:44:36.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12572026-07-01T22:44:36.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12582026-07-01T22:44:36.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12592026-07-01T22:44:36.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12602026-07-01T22:44:36.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12612026-07-01T22:44:36.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 238
12622026-07-01T22:44:36.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 238
12632026-07-01T22:44:36.962ZDEBGoximeter (clickhouse-client): unrolling 238 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
12642026-07-01T22:44:36.969ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
12652026-07-01T22:44:36.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 116 table_name = fields_string
12662026-07-01T22:44:36.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 18 table_name = fields_u16
12672026-07-01T22:44:36.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 106 table_name = fields_uuid
12682026-07-01T22:44:36.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 160 table_name = measurements_cumulativeu64
12692026-07-01T22:44:36.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 18 table_name = measurements_histogramu64
12702026-07-01T22:44:36.984ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = measurements_u64
12712026-07-01T22:44:37.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
12722026-07-01T22:44:37.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12732026-07-01T22:44:37.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12742026-07-01T22:44:37.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12752026-07-01T22:44:37.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12762026-07-01T22:44:37.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
12772026-07-01T22:44:37.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
12782026-07-01T22:44:37.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12792026-07-01T22:44:37.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12802026-07-01T22:44:37.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12812026-07-01T22:44:37.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12822026-07-01T22:44:37.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12832026-07-01T22:44:37.593ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
12842026-07-01T22:44:38.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12852026-07-01T22:44:38.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12862026-07-01T22:44:38.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12872026-07-01T22:44:38.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12882026-07-01T22:44:38.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12892026-07-01T22:44:38.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12902026-07-01T22:44:38.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12912026-07-01T22:44:38.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12922026-07-01T22:44:38.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12932026-07-01T22:44:39.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12942026-07-01T22:44:39.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12952026-07-01T22:44:39.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12962026-07-01T22:44:39.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12972026-07-01T22:44:39.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12982026-07-01T22:44:39.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12992026-07-01T22:44:39.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13002026-07-01T22:44:39.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13012026-07-01T22:44:39.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13022026-07-01T22:44:40.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13032026-07-01T22:44:40.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13042026-07-01T22:44:40.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13052026-07-01T22:44:40.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13062026-07-01T22:44:40.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13072026-07-01T22:44:40.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13082026-07-01T22:44:40.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13092026-07-01T22:44:40.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13102026-07-01T22:44:40.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13112026-07-01T22:44:41.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13122026-07-01T22:44:41.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13132026-07-01T22:44:41.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13142026-07-01T22:44:41.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13152026-07-01T22:44:41.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13162026-07-01T22:44:41.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13172026-07-01T22:44:41.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13182026-07-01T22:44:41.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13192026-07-01T22:44:41.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13202026-07-01T22:44:41.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 243
13212026-07-01T22:44:41.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 243
13222026-07-01T22:44:41.962ZDEBGoximeter (clickhouse-client): unrolling 243 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
13232026-07-01T22:44:41.970ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
13242026-07-01T22:44:41.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 126 table_name = fields_string
13252026-07-01T22:44:41.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = fields_u16
13262026-07-01T22:44:41.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 111 table_name = fields_uuid
13272026-07-01T22:44:41.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 160 table_name = measurements_cumulativeu64
13282026-07-01T22:44:41.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
13292026-07-01T22:44:41.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = measurements_u64
13302026-07-01T22:44:42.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
13312026-07-01T22:44:42.580ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
13322026-07-01T22:44:42.580ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
13332026-07-01T22:44:42.585ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f6a0526-ac89-4df3-9e43-b125a7ec9f9d", "content-length": "1412", "date": "Wed, 01 Jul 2026 22:44:42 GMT"} })
13342026-07-01T22:44:42.585ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
13352026-07-01T22:44:42.587ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
13362026-07-01T22:44:42.587ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
13372026-07-01T22:44:42.588ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "11c942c9-2add-4767-a483-99860a75aaa4", "content-length": "29", "date": "Wed, 01 Jul 2026 22:44:42 GMT"} })
13382026-07-01T22:44:42.588ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:62492 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436
13392026-07-01T22:44:42.588ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
13402026-07-01T22:44:42.588ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
13412026-07-01T22:44:42.588ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:62492 collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
13422026-07-01T22:44:42.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
13432026-07-01T22:44:42.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
13442026-07-01T22:44:42.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
13452026-07-01T22:44:42.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
13462026-07-01T22:44:42.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
13472026-07-01T22:44:42.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
13482026-07-01T22:44:42.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
13492026-07-01T22:44:42.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
13502026-07-01T22:44:42.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13512026-07-01T22:44:42.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13522026-07-01T22:44:42.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13532026-07-01T22:44:42.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13542026-07-01T22:44:42.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13552026-07-01T22:44:42.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13562026-07-01T22:44:42.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
13572026-07-01T22:44:42.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13582026-07-01T22:44:42.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
13592026-07-01T22:44:42.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
13602026-07-01T22:44:42.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13612026-07-01T22:44:42.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13622026-07-01T22:44:42.600ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
13632026-07-01T22:44:42.658ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1692 producer_id = 67226cbd-27b3-49aa-8adb-22e1d9a4f4c0 producer_ip = fd00:1122:3344:101::1 producer_port = 50026
13642026-07-01T22:44:42.662ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 1894
13652026-07-01T22:44:42.662ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 1894
13662026-07-01T22:44:42.662ZDEBGoximeter (clickhouse-client): unrolling 1894 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
13672026-07-01T22:44:42.715ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
13682026-07-01T22:44:42.735ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 280 table_name = fields_i16
13692026-07-01T22:44:42.737ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 3180 table_name = fields_string
13702026-07-01T22:44:42.739ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 167 table_name = fields_u16
13712026-07-01T22:44:42.740ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 946 table_name = fields_u32
13722026-07-01T22:44:42.741ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 144 table_name = fields_u8
13732026-07-01T22:44:42.743ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1750 table_name = fields_uuid
13742026-07-01T22:44:42.744ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = measurements_bool
13752026-07-01T22:44:42.746ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1820 table_name = measurements_cumulativeu64
13762026-07-01T22:44:42.747ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1 table_name = measurements_f64
13772026-07-01T22:44:42.749ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 27 table_name = measurements_histogramu64
13782026-07-01T22:44:42.750ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 42 table_name = measurements_u64
13792026-07-01T22:44:42.763ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
13802026-07-01T22:44:43.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13812026-07-01T22:44:43.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13822026-07-01T22:44:43.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13832026-07-01T22:44:43.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13842026-07-01T22:44:43.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13852026-07-01T22:44:43.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13862026-07-01T22:44:43.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13872026-07-01T22:44:43.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13882026-07-01T22:44:43.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13892026-07-01T22:44:44.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13902026-07-01T22:44:44.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13912026-07-01T22:44:44.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13922026-07-01T22:44:44.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13932026-07-01T22:44:44.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13942026-07-01T22:44:44.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13952026-07-01T22:44:44.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13962026-07-01T22:44:44.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13972026-07-01T22:44:44.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13982026-07-01T22:44:45.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13992026-07-01T22:44:45.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14002026-07-01T22:44:45.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14012026-07-01T22:44:45.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14022026-07-01T22:44:45.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14032026-07-01T22:44:45.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14042026-07-01T22:44:45.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14052026-07-01T22:44:45.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14062026-07-01T22:44:45.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14072026-07-01T22:44:46.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14082026-07-01T22:44:46.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14092026-07-01T22:44:46.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14102026-07-01T22:44:46.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14112026-07-01T22:44:46.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14122026-07-01T22:44:46.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14132026-07-01T22:44:46.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14142026-07-01T22:44:46.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14152026-07-01T22:44:46.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14162026-07-01T22:44:46.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 176
14172026-07-01T22:44:46.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 176
14182026-07-01T22:44:46.962ZDEBGoximeter (clickhouse-client): unrolling 176 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
14192026-07-01T22:44:46.968ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
14202026-07-01T22:44:46.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 80 table_name = fields_string
14212026-07-01T22:44:46.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 88 table_name = fields_uuid
14222026-07-01T22:44:46.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 128 table_name = measurements_cumulativeu64
14232026-07-01T22:44:46.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 48 table_name = measurements_u64
14242026-07-01T22:44:47.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
14252026-07-01T22:44:47.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14262026-07-01T22:44:47.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14272026-07-01T22:44:47.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14282026-07-01T22:44:47.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14292026-07-01T22:44:47.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14302026-07-01T22:44:47.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14312026-07-01T22:44:47.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
14322026-07-01T22:44:47.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
14332026-07-01T22:44:47.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14342026-07-01T22:44:47.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14352026-07-01T22:44:47.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14362026-07-01T22:44:47.593ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
14372026-07-01T22:44:48.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14382026-07-01T22:44:48.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14392026-07-01T22:44:48.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14402026-07-01T22:44:48.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14412026-07-01T22:44:48.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14422026-07-01T22:44:48.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14432026-07-01T22:44:48.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14442026-07-01T22:44:48.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14452026-07-01T22:44:48.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14462026-07-01T22:44:49.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14472026-07-01T22:44:49.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14482026-07-01T22:44:49.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14492026-07-01T22:44:49.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14502026-07-01T22:44:49.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14512026-07-01T22:44:49.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14522026-07-01T22:44:49.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14532026-07-01T22:44:49.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14542026-07-01T22:44:49.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14552026-07-01T22:44:50.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14562026-07-01T22:44:50.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14572026-07-01T22:44:50.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14582026-07-01T22:44:50.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14592026-07-01T22:44:50.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14602026-07-01T22:44:50.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14612026-07-01T22:44:50.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14622026-07-01T22:44:50.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14632026-07-01T22:44:50.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14642026-07-01T22:44:51.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14652026-07-01T22:44:51.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14662026-07-01T22:44:51.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14672026-07-01T22:44:51.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14682026-07-01T22:44:51.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14692026-07-01T22:44:51.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14702026-07-01T22:44:51.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14712026-07-01T22:44:51.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14722026-07-01T22:44:51.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14732026-07-01T22:44:51.963ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 243
14742026-07-01T22:44:51.963ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 243
14752026-07-01T22:44:51.963ZDEBGoximeter (clickhouse-client): unrolling 243 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
14762026-07-01T22:44:51.971ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
14772026-07-01T22:44:51.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 126 table_name = fields_string
14782026-07-01T22:44:51.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = fields_u16
14792026-07-01T22:44:51.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 111 table_name = fields_uuid
14802026-07-01T22:44:51.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 160 table_name = measurements_cumulativeu64
14812026-07-01T22:44:51.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
14822026-07-01T22:44:51.984ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = measurements_u64
14832026-07-01T22:44:52.065ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
14842026-07-01T22:44:52.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
14852026-07-01T22:44:52.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
14862026-07-01T22:44:52.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14872026-07-01T22:44:52.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14882026-07-01T22:44:52.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
14892026-07-01T22:44:52.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
14902026-07-01T22:44:52.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14912026-07-01T22:44:52.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14922026-07-01T22:44:52.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14932026-07-01T22:44:52.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14942026-07-01T22:44:52.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
14952026-07-01T22:44:52.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
14962026-07-01T22:44:52.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
14972026-07-01T22:44:52.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
14982026-07-01T22:44:52.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14992026-07-01T22:44:52.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
15002026-07-01T22:44:52.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
15012026-07-01T22:44:52.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
15022026-07-01T22:44:52.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15032026-07-01T22:44:52.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15042026-07-01T22:44:52.600ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
15052026-07-01T22:44:53.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15062026-07-01T22:44:53.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15072026-07-01T22:44:53.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15082026-07-01T22:44:53.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15092026-07-01T22:44:53.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15102026-07-01T22:44:53.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15112026-07-01T22:44:53.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15122026-07-01T22:44:53.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15132026-07-01T22:44:53.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15142026-07-01T22:44:54.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15152026-07-01T22:44:54.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15162026-07-01T22:44:54.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15172026-07-01T22:44:54.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15182026-07-01T22:44:54.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15192026-07-01T22:44:54.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15202026-07-01T22:44:54.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15212026-07-01T22:44:54.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15222026-07-01T22:44:54.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15232026-07-01T22:44:55.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15242026-07-01T22:44:55.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15252026-07-01T22:44:55.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15262026-07-01T22:44:55.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15272026-07-01T22:44:55.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15282026-07-01T22:44:55.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15292026-07-01T22:44:55.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15302026-07-01T22:44:55.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15312026-07-01T22:44:55.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15322026-07-01T22:44:56.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15332026-07-01T22:44:56.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15342026-07-01T22:44:56.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15352026-07-01T22:44:56.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15362026-07-01T22:44:56.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15372026-07-01T22:44:56.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15382026-07-01T22:44:56.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15392026-07-01T22:44:56.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15402026-07-01T22:44:56.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15412026-07-01T22:44:56.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 378
15422026-07-01T22:44:56.963ZDEBGoximeter (clickhouse-client): unrolling 378 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
15432026-07-01T22:44:56.963ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 378
15442026-07-01T22:44:56.974ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
15452026-07-01T22:44:56.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 280 table_name = fields_i16
15462026-07-01T22:44:56.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 837 table_name = fields_string
15472026-07-01T22:44:56.987ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 158 table_name = fields_u16
15482026-07-01T22:44:56.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 145 table_name = fields_u32
15492026-07-01T22:44:56.990ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 144 table_name = fields_u8
15502026-07-01T22:44:56.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 526 table_name = fields_uuid
15512026-07-01T22:44:56.992ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 4 table_name = measurements_bool
15522026-07-01T22:44:56.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 265 table_name = measurements_cumulativeu64
15532026-07-01T22:44:56.995ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 1 table_name = measurements_f64
15542026-07-01T22:44:56.997ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 18 table_name = measurements_histogramu64
15552026-07-01T22:44:56.998ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 90 table_name = measurements_u64
15562026-07-01T22:44:57.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
15572026-07-01T22:44:57.581ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
15582026-07-01T22:44:57.581ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending
15592026-07-01T22:44:57.584ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b0ae11f-50c1-41fb-9c40-1aaa0119ec30", "content-length": "1412", "date": "Wed, 01 Jul 2026 22:44:57 GMT"} })
15602026-07-01T22:44:57.584ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D
15612026-07-01T22:44:57.587ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjllY2FiMS1mYWJiLTQwYWQtOWY5YS0wYjZlNDYxNTc0MzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d9f4ce5-38c1-496f-8075-63c67fe6642f", "content-length": "29", "date": "Wed, 01 Jul 2026 22:44:57 GMT"} })
15622026-07-01T22:44:57.588ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
15632026-07-01T22:44:57.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15642026-07-01T22:44:57.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15652026-07-01T22:44:57.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
15662026-07-01T22:44:57.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
15672026-07-01T22:44:57.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15682026-07-01T22:44:57.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15692026-07-01T22:44:57.589ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15702026-07-01T22:44:57.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15712026-07-01T22:44:57.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15722026-07-01T22:44:57.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15732026-07-01T22:44:57.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15742026-07-01T22:44:57.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15752026-07-01T22:44:57.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = a8ff36ae-1465-45d3-a058-a7b646f1671d producer_ip = fd00:1122:3344:101::b producer_port = 33342
15762026-07-01T22:44:58.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15772026-07-01T22:44:58.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15782026-07-01T22:44:58.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15792026-07-01T22:44:58.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15802026-07-01T22:44:58.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15812026-07-01T22:44:58.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15822026-07-01T22:44:58.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15832026-07-01T22:44:58.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15842026-07-01T22:44:58.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15852026-07-01T22:44:59.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15862026-07-01T22:44:59.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15872026-07-01T22:44:59.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15882026-07-01T22:44:59.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15892026-07-01T22:44:59.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15902026-07-01T22:44:59.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15912026-07-01T22:44:59.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15922026-07-01T22:44:59.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15932026-07-01T22:44:59.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15942026-07-01T22:45:00.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15952026-07-01T22:45:00.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15962026-07-01T22:45:00.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15972026-07-01T22:45:00.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15982026-07-01T22:45:00.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15992026-07-01T22:45:00.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16002026-07-01T22:45:00.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16012026-07-01T22:45:00.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16022026-07-01T22:45:00.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16032026-07-01T22:45:01.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16042026-07-01T22:45:01.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16052026-07-01T22:45:01.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16062026-07-01T22:45:01.590ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16072026-07-01T22:45:01.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16082026-07-01T22:45:01.590ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16092026-07-01T22:45:01.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16102026-07-01T22:45:01.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16112026-07-01T22:45:01.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16122026-07-01T22:45:01.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 244
16132026-07-01T22:45:01.962ZDEBGoximeter (database-inserter): inserting samples into database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_samples = 244
16142026-07-01T22:45:01.962ZDEBGoximeter (clickhouse-client): unrolling 244 total samples collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
16152026-07-01T22:45:01.970ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753
16162026-07-01T22:45:01.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 2 table_name = fields_ipaddr
16172026-07-01T22:45:01.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 127 table_name = fields_string
16182026-07-01T22:45:01.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 25 table_name = fields_u16
16192026-07-01T22:45:01.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 113 table_name = fields_uuid
16202026-07-01T22:45:01.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 161 table_name = measurements_cumulativeu64
16212026-07-01T22:45:01.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 23 table_name = measurements_histogramu64
16222026-07-01T22:45:01.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d id = 5ebd2541-1dd1-416f-9c62-ae3e0d21d753 n_rows = 60 table_name = measurements_u64
16232026-07-01T22:45:02.063ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
16242026-07-01T22:45:02.588ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
16252026-07-01T22:45:02.588ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
16262026-07-01T22:45:02.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16272026-07-01T22:45:02.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
16282026-07-01T22:45:02.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16292026-07-01T22:45:02.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
16302026-07-01T22:45:02.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
16312026-07-01T22:45:02.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
16322026-07-01T22:45:02.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492
16332026-07-01T22:45:02.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
16342026-07-01T22:45:02.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16352026-07-01T22:45:02.589ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16362026-07-01T22:45:02.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16372026-07-01T22:45:02.589ZDEBGoximeter (collection-task): collecting from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16382026-07-01T22:45:02.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = d3adb5ce-056c-4861-b376-83383a136fd8 producer_ip = fd00:1122:3344:101::c producer_port = 64505
16392026-07-01T22:45:02.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 4cf506ea-96c0-4403-8740-b5724867fd41 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16402026-07-01T22:45:02.590ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = b9692f1d-f06c-4f81-b8a4-c1ea201bbc50 producer_ip = fd00:1122:3344:101::a producer_port = 34774
16412026-07-01T22:45:02.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 4f841c08-5068-4521-8c6c-3fa127836d2b producer_ip = fd00:1122:3344:101::2 producer_port = 38883
16422026-07-01T22:45:02.591ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 930eefaf-9627-4963-9d5e-b1935bd9c078 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16432026-07-01T22:45:02.592ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 3a71fce4-037f-4b39-8725-34202da2c6f7 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16442026-07-01T22:45:02.601ZDEBGoximeter (collection-task): collected results from producer collector_id = d9a1cbb7-50cd-4da2-894e-2aa5826d0bc1 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = df9ecab1-fabb-40ad-9f9a-0b6e46157436 producer_ip = fd00:1122:3344:101::2 producer_port = 62492