Max level shown:
1 [ Jul 11 17:58:17 Enabled. ]
2 [ Jul 11 17:58:17 Rereading configuration. ]
3 [ Jul 11 17:58:18 Rereading configuration. ]
4 [ Jul 11 17:58:22 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 90b659f1-88c8-4108-a325-f055c37ec497 &"). ]
5 [ Jul 11 17:58:22 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-07-11T17:58:23.344ZDEBGoximeter: registered DTrace probes
82026-07-11T17:58:23.345ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:299
92026-07-11T17:58:23.347ZDEBGoximeter: creating ClickHouse client
102026-07-11T17:58:23.399ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
112026-07-11T17:58:28.576ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 985e94e4-d053-4031-90cb-072f76f425c6
122026-07-11T17:58:28.576ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d
132026-07-11T17:58:28.576ZINFOoximeter (clickhouse-client): reading db version collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:788 id = 985e94e4-d053-4031-90cb-072f76f425c6
142026-07-11T17:58:28.578ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 985e94e4-d053-4031-90cb-072f76f425c6
152026-07-11T17:58:28.578ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:793 id = 985e94e4-d053-4031-90cb-072f76f425c6 version = 0
162026-07-11T17:58:28.578ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:798 id = 985e94e4-d053-4031-90cb-072f76f425c6
172026-07-11T17:58:28.578ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
182026-07-11T17:58:28.741ZINFOoximeter (clickhouse-client): inserting current version collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:819 id = 985e94e4-d053-4031-90cb-072f76f425c6 version = 14
192026-07-11T17:58:28.759ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = ba4c5f13-ae1d-42fc-9d4a-52d8c6e7f1ba
202026-07-11T17:58:28.769ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-07-11T17:58:28.769ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-07-11T17:58:28.769ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-07-11T17:58:28.769ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-07-11T17:58:28.769ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-07-11T17:58:28.772ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-07-11T17:58:28.773ZDEBGoximeter: registered USDT probes
272026-07-11T17:58:28.773ZDEBGoximeter: contacting nexus
282026-07-11T17:58:28.795ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
292026-07-11T17:58:28.915ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "7dafdfb6-c4a7-48fe-9bee-b7727979b6d3", "date": "Sat, 11 Jul 2026 17:58:28 GMT"} })
302026-07-11T17:58:28.915ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:462 id = 90b659f1-88c8-4108-a325-f055c37ec497
312026-07-11T17:58:28.915ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:631
322026-07-11T17:58:28.916ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
332026-07-11T17:58:28.923ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending
342026-07-11T17:58:28.923ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
352026-07-11T17:58:28.924ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146) file = oximeter/collector/src/agent.rs:672
362026-07-11T17:58:33.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 4
372026-07-11T17:58:33.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 4
382026-07-11T17:58:33.760ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
392026-07-11T17:58:33.761ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
402026-07-11T17:58:33.763ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:33.761940038Z } timeseries_name = oximeter_collector:database_queue_depth
412026-07-11T17:58:33.764ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:33.761935358Z } timeseries_name = oximeter_collector:database_samples_dropped
422026-07-11T17:58:33.764ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
432026-07-11T17:58:33.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_ipaddr
442026-07-11T17:58:33.772ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_string
452026-07-11T17:58:33.775ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_u16
462026-07-11T17:58:33.778ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_uuid
472026-07-11T17:58:33.780ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 2 table_name = measurements_cumulativeu64
482026-07-11T17:58:33.784ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 2 table_name = measurements_histogramu64
492026-07-11T17:58:33.861ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
502026-07-11T17:58:38.760ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d
512026-07-11T17:58:38.760ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d
522026-07-11T17:58:43.760ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d
532026-07-11T17:58:43.760ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d
542026-07-11T17:58:43.916ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
552026-07-11T17:58:43.916ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending
562026-07-11T17:58:43.938ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff24075b-a3b3-45db-b465-f5f66f4c2900", "content-length": "721", "date": "Sat, 11 Jul 2026 17:58:43 GMT"} })
572026-07-11T17:58:43.940ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D
582026-07-11T17:58:43.943ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "db253636-56b9-4296-a381-8e48522a03ca", "content-length": "29", "date": "Sat, 11 Jul 2026 17:58:43 GMT"} })
592026-07-11T17:58:43.944ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8
602026-07-11T17:58:43.944ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250
612026-07-11T17:58:43.944ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:60333 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb
622026-07-11T17:58:43.944ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:44387 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73
632026-07-11T17:58:43.944ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 4 n_pruned_tasks = 0
642026-07-11T17:58:44.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
652026-07-11T17:58:44.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
662026-07-11T17:58:44.233ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
672026-07-11T17:58:44.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
682026-07-11T17:58:44.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
692026-07-11T17:58:44.815ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
702026-07-11T17:58:45.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
712026-07-11T17:58:45.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
722026-07-11T17:58:45.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
732026-07-11T17:58:45.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
742026-07-11T17:58:45.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
752026-07-11T17:58:45.810ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
762026-07-11T17:58:46.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
772026-07-11T17:58:46.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
782026-07-11T17:58:46.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
792026-07-11T17:58:46.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
802026-07-11T17:58:46.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
812026-07-11T17:58:46.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
822026-07-11T17:58:47.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
832026-07-11T17:58:47.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
842026-07-11T17:58:47.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
852026-07-11T17:58:47.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
862026-07-11T17:58:47.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
872026-07-11T17:58:47.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
882026-07-11T17:58:48.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
892026-07-11T17:58:48.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
902026-07-11T17:58:48.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
912026-07-11T17:58:48.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 174
922026-07-11T17:58:48.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 174
932026-07-11T17:58:48.760ZDEBGoximeter (clickhouse-client): unrolling 174 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
942026-07-11T17:58:48.760ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
952026-07-11T17:58:48.762ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760774496Z } timeseries_name = ddm_router:originated_tunnel_endpoints
962026-07-11T17:58:48.762ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760770286Z } timeseries_name = ddm_router:originated_underlay_prefixes
972026-07-11T17:58:48.762ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760788476Z } timeseries_name = ddm_session:advertisements_received
982026-07-11T17:58:48.762ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760786366Z } timeseries_name = ddm_session:advertisements_sent
992026-07-11T17:58:48.762ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760804406Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1002026-07-11T17:58:48.762ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760802537Z } timeseries_name = ddm_session:imported_underlay_prefixes
1012026-07-11T17:58:48.762ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760792546Z } timeseries_name = ddm_session:peer_address_changes
1022026-07-11T17:58:48.762ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760790426Z } timeseries_name = ddm_session:peer_expirations
1032026-07-11T17:58:48.763ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760794286Z } timeseries_name = ddm_session:peer_sessions_established
1042026-07-11T17:58:48.763ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760779956Z } timeseries_name = ddm_session:solicitations_received
1052026-07-11T17:58:48.763ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760777426Z } timeseries_name = ddm_session:solicitations_sent
1062026-07-11T17:58:48.763ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760799337Z } timeseries_name = ddm_session:update_send_fail
1072026-07-11T17:58:48.763ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760797877Z } timeseries_name = ddm_session:updates_received
1082026-07-11T17:58:48.763ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:48.760795837Z } timeseries_name = ddm_session:updates_sent
1092026-07-11T17:58:48.763ZDEBGoximeter (clickhouse-client): inserting 14 new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
1102026-07-11T17:58:48.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 76 table_name = fields_string
1112026-07-11T17:58:48.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 80 table_name = fields_uuid
1122026-07-11T17:58:48.772ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 130 table_name = measurements_cumulativeu64
1132026-07-11T17:58:48.774ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 44 table_name = measurements_u64
1142026-07-11T17:58:48.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1152026-07-11T17:58:48.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1162026-07-11T17:58:48.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1172026-07-11T17:58:48.861ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1182026-07-11T17:58:49.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1192026-07-11T17:58:49.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1202026-07-11T17:58:49.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1212026-07-11T17:58:49.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1222026-07-11T17:58:49.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1232026-07-11T17:58:49.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1242026-07-11T17:58:50.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1252026-07-11T17:58:50.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1262026-07-11T17:58:50.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1272026-07-11T17:58:50.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1282026-07-11T17:58:50.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1292026-07-11T17:58:50.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1302026-07-11T17:58:51.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1312026-07-11T17:58:51.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1322026-07-11T17:58:51.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1332026-07-11T17:58:51.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1342026-07-11T17:58:51.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1352026-07-11T17:58:51.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1362026-07-11T17:58:52.041ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
1372026-07-11T17:58:52.041ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
1382026-07-11T17:58:52.052ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
1392026-07-11T17:58:52.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1402026-07-11T17:58:52.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1412026-07-11T17:58:52.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1422026-07-11T17:58:52.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1432026-07-11T17:58:52.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1442026-07-11T17:58:52.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1452026-07-11T17:58:53.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1462026-07-11T17:58:53.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1472026-07-11T17:58:53.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1482026-07-11T17:58:53.614ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
1492026-07-11T17:58:53.614ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
1502026-07-11T17:58:53.638ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
1512026-07-11T17:58:53.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 351
1522026-07-11T17:58:53.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 351
1532026-07-11T17:58:53.761ZDEBGoximeter (clickhouse-client): unrolling 351 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
1542026-07-11T17:58:53.761ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
1552026-07-11T17:58:53.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761420277Z } timeseries_name = dendrite:sample_collection_duration
1562026-07-11T17:58:53.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761282904Z } timeseries_name = http_service:request_latency_histogram
1572026-07-11T17:58:53.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761305164Z } timeseries_name = switch_data_link:link_enabled
1582026-07-11T17:58:53.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761326375Z } timeseries_name = switch_data_link:link_up
1592026-07-11T17:58:53.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761333085Z } timeseries_name = switch_table:capacity
1602026-07-11T17:58:53.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761369816Z } timeseries_name = switch_table:collisions
1612026-07-11T17:58:53.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761381316Z } timeseries_name = switch_table:delete_misses
1622026-07-11T17:58:53.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761343845Z } timeseries_name = switch_table:deletes
1632026-07-11T17:58:53.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761392746Z } timeseries_name = switch_table:exhaustion
1642026-07-11T17:58:53.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761340525Z } timeseries_name = switch_table:inserts
1652026-07-11T17:58:53.776ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761336605Z } timeseries_name = switch_table:occupancy
1662026-07-11T17:58:53.776ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761373496Z } timeseries_name = switch_table:update_misses
1672026-07-11T17:58:53.776ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:58:53.761361525Z } timeseries_name = switch_table:updates
1682026-07-11T17:58:53.780ZDEBGoximeter (clickhouse-client): inserting 13 new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
1692026-07-11T17:58:53.785ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 280 table_name = fields_i16
1702026-07-11T17:58:53.787ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 819 table_name = fields_string
1712026-07-11T17:58:53.789ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 151 table_name = fields_u16
1722026-07-11T17:58:53.790ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 145 table_name = fields_u32
1732026-07-11T17:58:53.792ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 144 table_name = fields_u8
1742026-07-11T17:58:53.794ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 511 table_name = fields_uuid
1752026-07-11T17:58:53.795ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = measurements_bool
1762026-07-11T17:58:53.797ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 255 table_name = measurements_cumulativeu64
1772026-07-11T17:58:53.798ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 1 table_name = measurements_f64
1782026-07-11T17:58:53.800ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 11 table_name = measurements_histogramu64
1792026-07-11T17:58:53.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 80 table_name = measurements_u64
1802026-07-11T17:58:53.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-07-11T17:58:53.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1822026-07-11T17:58:53.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1832026-07-11T17:58:53.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1842026-07-11T17:58:54.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1852026-07-11T17:58:54.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1862026-07-11T17:58:54.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1872026-07-11T17:58:54.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882026-07-11T17:58:54.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-07-11T17:58:54.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1902026-07-11T17:58:55.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1912026-07-11T17:58:55.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1922026-07-11T17:58:55.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1932026-07-11T17:58:55.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1942026-07-11T17:58:55.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1952026-07-11T17:58:55.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1962026-07-11T17:58:56.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1972026-07-11T17:58:56.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1982026-07-11T17:58:56.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1992026-07-11T17:58:56.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2002026-07-11T17:58:56.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2012026-07-11T17:58:56.810ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2022026-07-11T17:58:57.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2032026-07-11T17:58:57.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2042026-07-11T17:58:57.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2052026-07-11T17:58:57.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2062026-07-11T17:58:57.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2072026-07-11T17:58:57.810ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2082026-07-11T17:58:58.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2092026-07-11T17:58:58.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2102026-07-11T17:58:58.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2112026-07-11T17:58:58.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 200
2122026-07-11T17:58:58.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 200
2132026-07-11T17:58:58.760ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
2142026-07-11T17:58:58.760ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
2152026-07-11T17:58:58.765ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 76 table_name = fields_string
2162026-07-11T17:58:58.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 80 table_name = fields_uuid
2172026-07-11T17:58:58.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 150 table_name = measurements_cumulativeu64
2182026-07-11T17:58:58.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 50 table_name = measurements_u64
2192026-07-11T17:58:58.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2202026-07-11T17:58:58.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2212026-07-11T17:58:58.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2222026-07-11T17:58:58.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2232026-07-11T17:58:58.916ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
2242026-07-11T17:58:58.916ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending
2252026-07-11T17:58:58.920ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "14267013-ae9f-48b0-8233-36470733c628", "content-length": "857", "date": "Sat, 11 Jul 2026 17:58:58 GMT"} })
2262026-07-11T17:58:58.920ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D
2272026-07-11T17:58:58.924ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "c92392e5-6be2-4650-ba85-10652b9512c0", "content-length": "29", "date": "Sat, 11 Jul 2026 17:58:58 GMT"} })
2282026-07-11T17:58:58.924ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d
2292026-07-11T17:58:58.924ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:51137 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73
2302026-07-11T17:58:58.924ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
2312026-07-11T17:58:58.924ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 5 n_pruned_tasks = 0
2322026-07-11T17:58:58.924ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:51137 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
2332026-07-11T17:58:59.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2342026-07-11T17:58:59.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2352026-07-11T17:58:59.037ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2362026-07-11T17:58:59.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2372026-07-11T17:58:59.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2382026-07-11T17:58:59.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2392026-07-11T17:58:59.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2402026-07-11T17:58:59.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2412026-07-11T17:58:59.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2422026-07-11T17:59:00.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2432026-07-11T17:59:00.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2442026-07-11T17:59:00.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2452026-07-11T17:59:00.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2462026-07-11T17:59:00.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2472026-07-11T17:59:00.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2482026-07-11T17:59:00.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2492026-07-11T17:59:00.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2502026-07-11T17:59:00.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2512026-07-11T17:59:01.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2522026-07-11T17:59:01.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2532026-07-11T17:59:01.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2542026-07-11T17:59:01.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2552026-07-11T17:59:01.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2562026-07-11T17:59:01.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2572026-07-11T17:59:01.734ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
2582026-07-11T17:59:01.734ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
2592026-07-11T17:59:01.755ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 168 producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
2602026-07-11T17:59:01.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2612026-07-11T17:59:01.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2622026-07-11T17:59:01.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2632026-07-11T17:59:02.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2642026-07-11T17:59:02.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2652026-07-11T17:59:02.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2662026-07-11T17:59:02.041ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
2672026-07-11T17:59:02.041ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
2682026-07-11T17:59:02.043ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
2692026-07-11T17:59:02.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2702026-07-11T17:59:02.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2712026-07-11T17:59:02.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2722026-07-11T17:59:02.564ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
2732026-07-11T17:59:02.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2742026-07-11T17:59:02.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2752026-07-11T17:59:02.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2762026-07-11T17:59:03.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2772026-07-11T17:59:03.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2782026-07-11T17:59:03.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2792026-07-11T17:59:03.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2802026-07-11T17:59:03.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2812026-07-11T17:59:03.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2822026-07-11T17:59:03.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 401
2832026-07-11T17:59:03.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 401
2842026-07-11T17:59:03.760ZDEBGoximeter (clickhouse-client): unrolling 401 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
2852026-07-11T17:59:03.761ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
2862026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.760995340Z } timeseries_name = mg_lower:routes_blocked_by_link_state
2872026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.761091742Z } timeseries_name = oximeter_collector:collections
2882026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.761093562Z } timeseries_name = oximeter_collector:samples_collected
2892026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.760993320Z } timeseries_name = static_routing_config:static_nexthops
2902026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.760992150Z } timeseries_name = static_routing_config:static_routes
2912026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.761033931Z } timeseries_name = switch_port_control_data_link:bytes_received
2922026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.761042971Z } timeseries_name = switch_port_control_data_link:bytes_sent
2932026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.761023950Z } timeseries_name = switch_port_control_data_link:errors_received
2942026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.761029151Z } timeseries_name = switch_port_control_data_link:errors_sent
2952026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.761038581Z } timeseries_name = switch_port_control_data_link:packets_received
2962026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.761047681Z } timeseries_name = switch_port_control_data_link:packets_sent
2972026-07-11T17:59:03.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:03.760994330Z } timeseries_name = switch_rib:active_routes
2982026-07-11T17:59:03.775ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
2992026-07-11T17:59:03.779ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 24 table_name = fields_i16
3002026-07-11T17:59:03.782ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_ipaddr
3012026-07-11T17:59:03.786ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 224 table_name = fields_string
3022026-07-11T17:59:03.789ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 27 table_name = fields_u16
3032026-07-11T17:59:03.791ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 24 table_name = fields_u32
3042026-07-11T17:59:03.792ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 12 table_name = fields_u8
3052026-07-11T17:59:03.794ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 139 table_name = fields_uuid
3062026-07-11T17:59:03.797ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 330 table_name = measurements_cumulativeu64
3072026-07-11T17:59:03.799ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 11 table_name = measurements_histogramu64
3082026-07-11T17:59:03.801ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 60 table_name = measurements_u64
3092026-07-11T17:59:03.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3102026-07-11T17:59:03.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-07-11T17:59:03.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-07-11T17:59:03.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3132026-07-11T17:59:04.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3142026-07-11T17:59:04.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3152026-07-11T17:59:04.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3162026-07-11T17:59:04.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3172026-07-11T17:59:04.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3182026-07-11T17:59:04.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3192026-07-11T17:59:04.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3202026-07-11T17:59:04.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3212026-07-11T17:59:04.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3222026-07-11T17:59:05.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3232026-07-11T17:59:05.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3242026-07-11T17:59:05.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3252026-07-11T17:59:05.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3262026-07-11T17:59:05.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3272026-07-11T17:59:05.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3282026-07-11T17:59:05.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3292026-07-11T17:59:05.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3302026-07-11T17:59:05.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3312026-07-11T17:59:06.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3322026-07-11T17:59:06.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3332026-07-11T17:59:06.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3342026-07-11T17:59:06.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3352026-07-11T17:59:06.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3362026-07-11T17:59:06.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3372026-07-11T17:59:06.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3382026-07-11T17:59:06.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3392026-07-11T17:59:06.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3402026-07-11T17:59:07.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3412026-07-11T17:59:07.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3422026-07-11T17:59:07.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3432026-07-11T17:59:07.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3442026-07-11T17:59:07.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3452026-07-11T17:59:07.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3462026-07-11T17:59:07.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3472026-07-11T17:59:07.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3482026-07-11T17:59:07.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3492026-07-11T17:59:08.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3502026-07-11T17:59:08.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3512026-07-11T17:59:08.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3522026-07-11T17:59:08.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3532026-07-11T17:59:08.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3542026-07-11T17:59:08.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3552026-07-11T17:59:08.495ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3562026-07-11T17:59:08.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 222
3572026-07-11T17:59:08.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 222
3582026-07-11T17:59:08.760ZDEBGoximeter (clickhouse-client): unrolling 222 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
3592026-07-11T17:59:08.760ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
3602026-07-11T17:59:08.766ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_ipaddr
3612026-07-11T17:59:08.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 82 table_name = fields_string
3622026-07-11T17:59:08.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_u16
3632026-07-11T17:59:08.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 92 table_name = fields_uuid
3642026-07-11T17:59:08.773ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 162 table_name = measurements_cumulativeu64
3652026-07-11T17:59:08.774ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 60 table_name = measurements_u64
3662026-07-11T17:59:08.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3672026-07-11T17:59:08.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3682026-07-11T17:59:08.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3692026-07-11T17:59:08.861ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3702026-07-11T17:59:09.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3712026-07-11T17:59:09.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3722026-07-11T17:59:09.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3732026-07-11T17:59:09.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3742026-07-11T17:59:09.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3752026-07-11T17:59:09.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3762026-07-11T17:59:09.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3772026-07-11T17:59:09.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3782026-07-11T17:59:09.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3792026-07-11T17:59:10.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3802026-07-11T17:59:10.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3812026-07-11T17:59:10.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3822026-07-11T17:59:10.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3832026-07-11T17:59:10.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3842026-07-11T17:59:10.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3852026-07-11T17:59:10.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3862026-07-11T17:59:10.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3872026-07-11T17:59:10.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3882026-07-11T17:59:11.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3892026-07-11T17:59:11.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3902026-07-11T17:59:11.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3912026-07-11T17:59:11.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3922026-07-11T17:59:11.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3932026-07-11T17:59:11.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3942026-07-11T17:59:11.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3952026-07-11T17:59:11.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3962026-07-11T17:59:11.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3972026-07-11T17:59:12.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3982026-07-11T17:59:12.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3992026-07-11T17:59:12.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4002026-07-11T17:59:12.040ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
4012026-07-11T17:59:12.040ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
4022026-07-11T17:59:12.042ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
4032026-07-11T17:59:12.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4042026-07-11T17:59:12.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4052026-07-11T17:59:12.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4062026-07-11T17:59:12.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4072026-07-11T17:59:12.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4082026-07-11T17:59:12.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4092026-07-11T17:59:13.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4102026-07-11T17:59:13.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4112026-07-11T17:59:13.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4122026-07-11T17:59:13.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4132026-07-11T17:59:13.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4142026-07-11T17:59:13.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4152026-07-11T17:59:13.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 231
4162026-07-11T17:59:13.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 231
4172026-07-11T17:59:13.761ZDEBGoximeter (clickhouse-client): unrolling 231 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
4182026-07-11T17:59:13.761ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
4192026-07-11T17:59:13.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 102 table_name = fields_string
4202026-07-11T17:59:13.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 11 table_name = fields_u16
4212026-07-11T17:59:13.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 99 table_name = fields_uuid
4222026-07-11T17:59:13.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 160 table_name = measurements_cumulativeu64
4232026-07-11T17:59:13.772ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 11 table_name = measurements_histogramu64
4242026-07-11T17:59:13.773ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 60 table_name = measurements_u64
4252026-07-11T17:59:13.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4262026-07-11T17:59:13.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4272026-07-11T17:59:13.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4282026-07-11T17:59:13.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4292026-07-11T17:59:13.916ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
4302026-07-11T17:59:13.916ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending
4312026-07-11T17:59:13.920ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3733d16-017f-4a9f-90d5-d36150f0bb0c", "content-length": "1136", "date": "Sat, 11 Jul 2026 17:59:13 GMT"} })
4322026-07-11T17:59:13.920ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D
4332026-07-11T17:59:13.922ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc47f1c9-8ea1-4d0d-9080-92735304ab64", "content-length": "29", "date": "Sat, 11 Jul 2026 17:59:13 GMT"} })
4342026-07-11T17:59:13.922ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:54377 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003
4352026-07-11T17:59:13.922ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:64283 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 121e3fc9-5ed9-49a8-bda7-7953293ac7c7
4362026-07-11T17:59:13.922ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 7 n_pruned_tasks = 0
4372026-07-11T17:59:14.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4382026-07-11T17:59:14.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4392026-07-11T17:59:14.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4402026-07-11T17:59:14.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4412026-07-11T17:59:14.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4422026-07-11T17:59:14.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4432026-07-11T17:59:14.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4442026-07-11T17:59:14.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4452026-07-11T17:59:14.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4462026-07-11T17:59:14.953ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
4472026-07-11T17:59:14.953ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
4482026-07-11T17:59:14.954ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 20 producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
4492026-07-11T17:59:15.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4502026-07-11T17:59:15.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4512026-07-11T17:59:15.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4522026-07-11T17:59:15.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4532026-07-11T17:59:15.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4542026-07-11T17:59:15.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4552026-07-11T17:59:15.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4562026-07-11T17:59:15.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4572026-07-11T17:59:15.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4582026-07-11T17:59:16.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4592026-07-11T17:59:16.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4602026-07-11T17:59:16.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4612026-07-11T17:59:16.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4622026-07-11T17:59:16.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4632026-07-11T17:59:16.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4642026-07-11T17:59:16.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4652026-07-11T17:59:16.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4662026-07-11T17:59:16.810ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4672026-07-11T17:59:17.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4682026-07-11T17:59:17.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4692026-07-11T17:59:17.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4702026-07-11T17:59:17.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4712026-07-11T17:59:17.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4722026-07-11T17:59:17.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4732026-07-11T17:59:17.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4742026-07-11T17:59:17.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4752026-07-11T17:59:17.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-07-11T17:59:18.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4772026-07-11T17:59:18.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4782026-07-11T17:59:18.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4792026-07-11T17:59:18.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4802026-07-11T17:59:18.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4812026-07-11T17:59:18.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4822026-07-11T17:59:18.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 240
4832026-07-11T17:59:18.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 240
4842026-07-11T17:59:18.761ZDEBGoximeter (clickhouse-client): unrolling 240 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
4852026-07-11T17:59:18.761ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
4862026-07-11T17:59:18.764ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:18.761436942Z } timeseries_name = collection_target:cpus_provisioned
4872026-07-11T17:59:18.764ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:18.761438142Z } timeseries_name = collection_target:ram_provisioned
4882026-07-11T17:59:18.764ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:18.761439882Z } timeseries_name = collection_target:virtual_disk_space_provisioned
4892026-07-11T17:59:18.765ZDEBGoximeter (clickhouse-client): inserting 3 new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
4902026-07-11T17:59:18.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 102 table_name = fields_string
4912026-07-11T17:59:18.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 11 table_name = fields_u16
4922026-07-11T17:59:18.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 108 table_name = fields_uuid
4932026-07-11T17:59:18.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 160 table_name = measurements_cumulativeu64
4942026-07-11T17:59:18.773ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 11 table_name = measurements_histogramu64
4952026-07-11T17:59:18.774ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 9 table_name = measurements_i64
4962026-07-11T17:59:18.776ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 60 table_name = measurements_u64
4972026-07-11T17:59:18.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4982026-07-11T17:59:18.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4992026-07-11T17:59:18.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5002026-07-11T17:59:18.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5012026-07-11T17:59:19.023ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
5022026-07-11T17:59:19.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5032026-07-11T17:59:19.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5042026-07-11T17:59:19.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5052026-07-11T17:59:19.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5062026-07-11T17:59:19.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5072026-07-11T17:59:19.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5082026-07-11T17:59:19.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5092026-07-11T17:59:19.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5102026-07-11T17:59:19.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5112026-07-11T17:59:20.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5122026-07-11T17:59:20.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5132026-07-11T17:59:20.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5142026-07-11T17:59:20.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5152026-07-11T17:59:20.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5162026-07-11T17:59:20.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5172026-07-11T17:59:20.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5182026-07-11T17:59:20.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5192026-07-11T17:59:20.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5202026-07-11T17:59:21.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5212026-07-11T17:59:21.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5222026-07-11T17:59:21.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5232026-07-11T17:59:21.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5242026-07-11T17:59:21.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5252026-07-11T17:59:21.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5262026-07-11T17:59:21.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5272026-07-11T17:59:21.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5282026-07-11T17:59:21.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5292026-07-11T17:59:22.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5302026-07-11T17:59:22.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5312026-07-11T17:59:22.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5322026-07-11T17:59:22.041ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
5332026-07-11T17:59:22.041ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
5342026-07-11T17:59:22.041ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
5352026-07-11T17:59:22.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5362026-07-11T17:59:22.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5372026-07-11T17:59:22.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5382026-07-11T17:59:22.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5392026-07-11T17:59:22.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402026-07-11T17:59:22.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5412026-07-11T17:59:23.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5422026-07-11T17:59:23.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5432026-07-11T17:59:23.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5442026-07-11T17:59:23.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5452026-07-11T17:59:23.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5462026-07-11T17:59:23.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5472026-07-11T17:59:23.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 233
5482026-07-11T17:59:23.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 233
5492026-07-11T17:59:23.761ZDEBGoximeter (clickhouse-client): unrolling 233 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
5502026-07-11T17:59:23.761ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
5512026-07-11T17:59:23.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_ipaddr
5522026-07-11T17:59:23.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 104 table_name = fields_string
5532026-07-11T17:59:23.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 15 table_name = fields_u16
5542026-07-11T17:59:23.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 103 table_name = fields_uuid
5552026-07-11T17:59:23.772ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 162 table_name = measurements_cumulativeu64
5562026-07-11T17:59:23.773ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 11 table_name = measurements_histogramu64
5572026-07-11T17:59:23.775ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 60 table_name = measurements_u64
5582026-07-11T17:59:23.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5592026-07-11T17:59:23.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5602026-07-11T17:59:23.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5612026-07-11T17:59:23.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5622026-07-11T17:59:24.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5632026-07-11T17:59:24.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5642026-07-11T17:59:24.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5652026-07-11T17:59:24.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5662026-07-11T17:59:24.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5672026-07-11T17:59:24.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5682026-07-11T17:59:24.806ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 121e3fc9-5ed9-49a8-bda7-7953293ac7c7 producer_ip = fd00:1122:3344:101::1 producer_port = 64283
5692026-07-11T17:59:24.806ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 121e3fc9-5ed9-49a8-bda7-7953293ac7c7 producer_ip = fd00:1122:3344:101::1 producer_port = 64283
5702026-07-11T17:59:24.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5712026-07-11T17:59:24.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5722026-07-11T17:59:24.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5732026-07-11T17:59:24.950ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 6722 producer_id = 121e3fc9-5ed9-49a8-bda7-7953293ac7c7 producer_ip = fd00:1122:3344:101::1 producer_port = 64283
5742026-07-11T17:59:24.953ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
5752026-07-11T17:59:24.953ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
5762026-07-11T17:59:24.956ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 37 producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
5772026-07-11T17:59:24.988ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 6829
5782026-07-11T17:59:24.988ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 6829
5792026-07-11T17:59:24.988ZDEBGoximeter (clickhouse-client): unrolling 6829 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
5802026-07-11T17:59:24.989ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
5812026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.988407958Z } timeseries_name = sled_cpu:cpu_nsec
5822026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.988376998Z } timeseries_name = sled_data_link:bytes_received
5832026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.988380208Z } timeseries_name = sled_data_link:bytes_sent
5842026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.988373518Z } timeseries_name = sled_data_link:errors_received
5852026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.988374998Z } timeseries_name = sled_data_link:errors_sent
5862026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.988378938Z } timeseries_name = sled_data_link:packets_received
5872026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.988381758Z } timeseries_name = sled_data_link:packets_sent
5882026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.989274957Z } timeseries_name = zfs_dataset:bytes_used
5892026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.989266257Z } timeseries_name = zfs_pool:bytes_allocated
5902026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.989268798Z } timeseries_name = zfs_pool:bytes_total
5912026-07-11T17:59:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:24.988861202Z } timeseries_name = zone:cpu_nsec
5922026-07-11T17:59:25.024ZDEBGoximeter (clickhouse-client): inserting 11 new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
5932026-07-11T17:59:25.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5942026-07-11T17:59:25.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5952026-07-11T17:59:25.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5962026-07-11T17:59:25.029ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 3331 table_name = fields_string
5972026-07-11T17:59:25.030ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 33 table_name = fields_u16
5982026-07-11T17:59:25.032ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 953 table_name = fields_u32
5992026-07-11T17:59:25.034ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 1924 table_name = fields_uuid
6002026-07-11T17:59:25.037ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 6310 table_name = measurements_cumulativeu64
6012026-07-11T17:59:25.039ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 33 table_name = measurements_histogramu64
6022026-07-11T17:59:25.040ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 12 table_name = measurements_i64
6032026-07-11T17:59:25.042ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 474 table_name = measurements_u64
6042026-07-11T17:59:25.089ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6052026-07-11T17:59:25.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6062026-07-11T17:59:25.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6072026-07-11T17:59:25.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6082026-07-11T17:59:25.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6092026-07-11T17:59:25.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6102026-07-11T17:59:25.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6112026-07-11T17:59:26.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6122026-07-11T17:59:26.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6132026-07-11T17:59:26.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6142026-07-11T17:59:26.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6152026-07-11T17:59:26.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6162026-07-11T17:59:26.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6172026-07-11T17:59:26.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6182026-07-11T17:59:26.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6192026-07-11T17:59:26.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6202026-07-11T17:59:27.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6212026-07-11T17:59:27.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6222026-07-11T17:59:27.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6232026-07-11T17:59:27.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6242026-07-11T17:59:27.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6252026-07-11T17:59:27.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6262026-07-11T17:59:27.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6272026-07-11T17:59:27.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6282026-07-11T17:59:27.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6292026-07-11T17:59:28.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6302026-07-11T17:59:28.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6312026-07-11T17:59:28.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6322026-07-11T17:59:28.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6332026-07-11T17:59:28.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6342026-07-11T17:59:28.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6352026-07-11T17:59:28.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 150
6362026-07-11T17:59:28.760ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 150
6372026-07-11T17:59:28.760ZDEBGoximeter (clickhouse-client): unrolling 150 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
6382026-07-11T17:59:28.760ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
6392026-07-11T17:59:28.765ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 80 table_name = fields_string
6402026-07-11T17:59:28.766ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 88 table_name = fields_uuid
6412026-07-11T17:59:28.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 108 table_name = measurements_cumulativeu64
6422026-07-11T17:59:28.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 42 table_name = measurements_u64
6432026-07-11T17:59:28.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6442026-07-11T17:59:28.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6452026-07-11T17:59:28.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6462026-07-11T17:59:28.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6472026-07-11T17:59:28.917ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
6482026-07-11T17:59:28.917ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending
6492026-07-11T17:59:28.922ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "48e273cd-63af-42d4-87b4-cfd6412ff223", "content-length": "1136", "date": "Sat, 11 Jul 2026 17:59:28 GMT"} })
6502026-07-11T17:59:28.922ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D
6512026-07-11T17:59:28.925ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "54123078-b111-468e-939d-a50d450c6ce9", "content-length": "29", "date": "Sat, 11 Jul 2026 17:59:28 GMT"} })
6522026-07-11T17:59:28.925ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 7 n_pruned_tasks = 0
6532026-07-11T17:59:29.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6542026-07-11T17:59:29.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6552026-07-11T17:59:29.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6562026-07-11T17:59:29.170ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6572026-07-11T17:59:29.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6582026-07-11T17:59:29.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6592026-07-11T17:59:29.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6602026-07-11T17:59:29.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6612026-07-11T17:59:29.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6622026-07-11T17:59:29.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6632026-07-11T17:59:30.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6642026-07-11T17:59:30.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6652026-07-11T17:59:30.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6662026-07-11T17:59:30.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6672026-07-11T17:59:30.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6682026-07-11T17:59:30.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6692026-07-11T17:59:30.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6702026-07-11T17:59:30.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6712026-07-11T17:59:30.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6722026-07-11T17:59:31.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6732026-07-11T17:59:31.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6742026-07-11T17:59:31.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6752026-07-11T17:59:31.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6762026-07-11T17:59:31.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6772026-07-11T17:59:31.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6782026-07-11T17:59:31.734ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
6792026-07-11T17:59:31.734ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
6802026-07-11T17:59:31.735ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 36 producer_id = d377a9c8-eb50-4642-9840-78e36ee45c73 producer_ip = fd00:1122:3344:101::2 producer_port = 44387
6812026-07-11T17:59:31.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6822026-07-11T17:59:31.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6832026-07-11T17:59:31.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6842026-07-11T17:59:32.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6852026-07-11T17:59:32.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6862026-07-11T17:59:32.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6872026-07-11T17:59:32.041ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
6882026-07-11T17:59:32.041ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
6892026-07-11T17:59:32.042ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
6902026-07-11T17:59:32.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6912026-07-11T17:59:32.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6922026-07-11T17:59:32.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6932026-07-11T17:59:32.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6942026-07-11T17:59:32.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6952026-07-11T17:59:32.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6962026-07-11T17:59:33.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6972026-07-11T17:59:33.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6982026-07-11T17:59:33.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6992026-07-11T17:59:33.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7002026-07-11T17:59:33.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7012026-07-11T17:59:33.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7022026-07-11T17:59:33.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 273
7032026-07-11T17:59:33.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 273
7042026-07-11T17:59:33.761ZDEBGoximeter (clickhouse-client): unrolling 273 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
7052026-07-11T17:59:33.761ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
7062026-07-11T17:59:33.765ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 121e3fc9-5ed9-49a8-bda7-7953293ac7c7 producer_ip = fd00:1122:3344:101::1 producer_port = 64283
7072026-07-11T17:59:33.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 24 table_name = fields_i16
7082026-07-11T17:59:33.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 8 table_name = fields_ipaddr
7092026-07-11T17:59:33.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 228 table_name = fields_string
7102026-07-11T17:59:33.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 31 table_name = fields_u16
7112026-07-11T17:59:33.773ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 24 table_name = fields_u32
7122026-07-11T17:59:33.774ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 12 table_name = fields_u8
7132026-07-11T17:59:33.775ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 143 table_name = fields_uuid
7142026-07-11T17:59:33.776ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 200 table_name = measurements_cumulativeu64
7152026-07-11T17:59:33.778ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 13 table_name = measurements_histogramu64
7162026-07-11T17:59:33.779ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 60 table_name = measurements_u64
7172026-07-11T17:59:33.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7182026-07-11T17:59:33.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7192026-07-11T17:59:33.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7202026-07-11T17:59:33.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7212026-07-11T17:59:34.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7222026-07-11T17:59:34.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7232026-07-11T17:59:34.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7242026-07-11T17:59:34.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7252026-07-11T17:59:34.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7262026-07-11T17:59:34.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7272026-07-11T17:59:34.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7282026-07-11T17:59:34.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7292026-07-11T17:59:34.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7302026-07-11T17:59:34.953ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
7312026-07-11T17:59:34.953ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
7322026-07-11T17:59:34.955ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 26 producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
7332026-07-11T17:59:35.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7342026-07-11T17:59:35.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7352026-07-11T17:59:35.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7362026-07-11T17:59:35.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7372026-07-11T17:59:35.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7382026-07-11T17:59:35.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7392026-07-11T17:59:35.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7402026-07-11T17:59:35.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7412026-07-11T17:59:35.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7422026-07-11T17:59:36.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7432026-07-11T17:59:36.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7442026-07-11T17:59:36.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7452026-07-11T17:59:36.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7462026-07-11T17:59:36.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7472026-07-11T17:59:36.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7482026-07-11T17:59:36.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7492026-07-11T17:59:36.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7502026-07-11T17:59:36.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7512026-07-11T17:59:37.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7522026-07-11T17:59:37.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7532026-07-11T17:59:37.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7542026-07-11T17:59:37.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7552026-07-11T17:59:37.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7562026-07-11T17:59:37.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7572026-07-11T17:59:37.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7582026-07-11T17:59:37.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7592026-07-11T17:59:37.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7602026-07-11T17:59:38.029ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7612026-07-11T17:59:38.029ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7622026-07-11T17:59:38.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7632026-07-11T17:59:38.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7642026-07-11T17:59:38.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7652026-07-11T17:59:38.222ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7662026-07-11T17:59:38.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 248
7672026-07-11T17:59:38.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 248
7682026-07-11T17:59:38.761ZDEBGoximeter (clickhouse-client): unrolling 248 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
7692026-07-11T17:59:38.761ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
7702026-07-11T17:59:38.764ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-11T17:59:38.761748689Z } timeseries_name = database_transaction:retry_data
7712026-07-11T17:59:38.765ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
7722026-07-11T17:59:38.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_ipaddr
7732026-07-11T17:59:38.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 133 table_name = fields_string
7742026-07-11T17:59:38.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 29 table_name = fields_u16
7752026-07-11T17:59:38.773ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 1 table_name = fields_u32
7762026-07-11T17:59:38.774ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 117 table_name = fields_uuid
7772026-07-11T17:59:38.775ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 162 table_name = measurements_cumulativeu64
7782026-07-11T17:59:38.776ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 1 table_name = measurements_f64
7792026-07-11T17:59:38.778ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 25 table_name = measurements_histogramu64
7802026-07-11T17:59:38.779ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 60 table_name = measurements_u64
7812026-07-11T17:59:38.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7822026-07-11T17:59:38.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7832026-07-11T17:59:38.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7842026-07-11T17:59:38.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7852026-07-11T17:59:39.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7862026-07-11T17:59:39.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7872026-07-11T17:59:39.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7882026-07-11T17:59:39.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7892026-07-11T17:59:39.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7902026-07-11T17:59:39.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7912026-07-11T17:59:39.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7922026-07-11T17:59:39.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7932026-07-11T17:59:39.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7942026-07-11T17:59:40.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7952026-07-11T17:59:40.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7962026-07-11T17:59:40.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7972026-07-11T17:59:40.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7982026-07-11T17:59:40.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7992026-07-11T17:59:40.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8002026-07-11T17:59:40.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8012026-07-11T17:59:40.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8022026-07-11T17:59:40.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8032026-07-11T17:59:41.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8042026-07-11T17:59:41.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8052026-07-11T17:59:41.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8062026-07-11T17:59:41.171ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8072026-07-11T17:59:41.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8082026-07-11T17:59:41.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8092026-07-11T17:59:41.222ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8102026-07-11T17:59:41.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8112026-07-11T17:59:41.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8122026-07-11T17:59:41.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8132026-07-11T17:59:42.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8142026-07-11T17:59:42.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8152026-07-11T17:59:42.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8162026-07-11T17:59:42.041ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
8172026-07-11T17:59:42.041ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
8182026-07-11T17:59:42.042ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
8192026-07-11T17:59:42.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8202026-07-11T17:59:42.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8212026-07-11T17:59:42.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8222026-07-11T17:59:42.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8232026-07-11T17:59:42.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8242026-07-11T17:59:42.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8252026-07-11T17:59:43.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8262026-07-11T17:59:43.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8272026-07-11T17:59:43.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8282026-07-11T17:59:43.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8292026-07-11T17:59:43.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8302026-07-11T17:59:43.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8312026-07-11T17:59:43.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 233
8322026-07-11T17:59:43.761ZDEBGoximeter (clickhouse-client): unrolling 233 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
8332026-07-11T17:59:43.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 233
8342026-07-11T17:59:43.761ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
8352026-07-11T17:59:43.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_ipaddr
8362026-07-11T17:59:43.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 104 table_name = fields_string
8372026-07-11T17:59:43.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 15 table_name = fields_u16
8382026-07-11T17:59:43.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 103 table_name = fields_uuid
8392026-07-11T17:59:43.772ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 162 table_name = measurements_cumulativeu64
8402026-07-11T17:59:43.774ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 11 table_name = measurements_histogramu64
8412026-07-11T17:59:43.775ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 60 table_name = measurements_u64
8422026-07-11T17:59:43.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8432026-07-11T17:59:43.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8442026-07-11T17:59:43.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8452026-07-11T17:59:43.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8462026-07-11T17:59:43.917ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
8472026-07-11T17:59:43.917ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending
8482026-07-11T17:59:43.920ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "40fc831f-1194-4b3d-8267-8dd37962ef08", "content-length": "1412", "date": "Sat, 11 Jul 2026 17:59:43 GMT"} })
8492026-07-11T17:59:43.920ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D
8502026-07-11T17:59:43.923ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "33831601-ba74-40d6-9f3e-4c368020169e", "content-length": "29", "date": "Sat, 11 Jul 2026 17:59:43 GMT"} })
8512026-07-11T17:59:43.923ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:65422 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 25738eb8-f33e-4acd-ad94-b8640d86aaf5
8522026-07-11T17:59:43.923ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:35748 collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c3bdca6b-b847-4cae-8dde-bdf6551e02b7
8532026-07-11T17:59:43.923ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 9 n_pruned_tasks = 0
8542026-07-11T17:59:44.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8552026-07-11T17:59:44.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8562026-07-11T17:59:44.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8572026-07-11T17:59:44.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8582026-07-11T17:59:44.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8592026-07-11T17:59:44.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8602026-07-11T17:59:44.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8612026-07-11T17:59:44.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8622026-07-11T17:59:44.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8632026-07-11T17:59:44.953ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
8642026-07-11T17:59:44.953ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
8652026-07-11T17:59:44.955ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 25 producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
8662026-07-11T17:59:45.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8672026-07-11T17:59:45.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8682026-07-11T17:59:45.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8692026-07-11T17:59:45.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8702026-07-11T17:59:45.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8712026-07-11T17:59:45.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8722026-07-11T17:59:45.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8732026-07-11T17:59:45.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8742026-07-11T17:59:45.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8752026-07-11T17:59:46.027ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8762026-07-11T17:59:46.027ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8772026-07-11T17:59:46.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8782026-07-11T17:59:46.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8792026-07-11T17:59:46.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8802026-07-11T17:59:46.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8812026-07-11T17:59:46.600ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c3bdca6b-b847-4cae-8dde-bdf6551e02b7 producer_ip = fd00:1122:3344:101::c producer_port = 35748
8822026-07-11T17:59:46.600ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c3bdca6b-b847-4cae-8dde-bdf6551e02b7 producer_ip = fd00:1122:3344:101::c producer_port = 35748
8832026-07-11T17:59:46.613ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = c3bdca6b-b847-4cae-8dde-bdf6551e02b7 producer_ip = fd00:1122:3344:101::c producer_port = 35748
8842026-07-11T17:59:46.809ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8852026-07-11T17:59:46.809ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8862026-07-11T17:59:46.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8872026-07-11T17:59:47.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8882026-07-11T17:59:47.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8892026-07-11T17:59:47.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8902026-07-11T17:59:47.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8912026-07-11T17:59:47.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8922026-07-11T17:59:47.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8932026-07-11T17:59:47.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8942026-07-11T17:59:47.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8952026-07-11T17:59:47.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8962026-07-11T17:59:47.815ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 25738eb8-f33e-4acd-ad94-b8640d86aaf5 producer_ip = fd00:1122:3344:101::b producer_port = 65422
8972026-07-11T17:59:48.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8982026-07-11T17:59:48.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8992026-07-11T17:59:48.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9002026-07-11T17:59:48.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9012026-07-11T17:59:48.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9022026-07-11T17:59:48.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9032026-07-11T17:59:48.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 249
9042026-07-11T17:59:48.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 249
9052026-07-11T17:59:48.761ZDEBGoximeter (clickhouse-client): unrolling 249 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
9062026-07-11T17:59:48.761ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
9072026-07-11T17:59:48.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_ipaddr
9082026-07-11T17:59:48.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 136 table_name = fields_string
9092026-07-11T17:59:48.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 31 table_name = fields_u16
9102026-07-11T17:59:48.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 119 table_name = fields_uuid
9112026-07-11T17:59:48.772ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 162 table_name = measurements_cumulativeu64
9122026-07-11T17:59:48.773ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 27 table_name = measurements_histogramu64
9132026-07-11T17:59:48.775ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 60 table_name = measurements_u64
9142026-07-11T17:59:48.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9152026-07-11T17:59:48.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9162026-07-11T17:59:48.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9172026-07-11T17:59:48.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
9182026-07-11T17:59:49.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9192026-07-11T17:59:49.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9202026-07-11T17:59:49.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9212026-07-11T17:59:49.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9222026-07-11T17:59:49.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9232026-07-11T17:59:49.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9242026-07-11T17:59:49.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9252026-07-11T17:59:49.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9262026-07-11T17:59:49.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9272026-07-11T17:59:50.029ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9282026-07-11T17:59:50.029ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9292026-07-11T17:59:50.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9302026-07-11T17:59:50.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9312026-07-11T17:59:50.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9322026-07-11T17:59:50.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9332026-07-11T17:59:50.486ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c3bdca6b-b847-4cae-8dde-bdf6551e02b7 producer_ip = fd00:1122:3344:101::c producer_port = 35748
9342026-07-11T17:59:50.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9352026-07-11T17:59:50.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9362026-07-11T17:59:50.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9372026-07-11T17:59:51.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9382026-07-11T17:59:51.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9392026-07-11T17:59:51.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9402026-07-11T17:59:51.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9412026-07-11T17:59:51.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9422026-07-11T17:59:51.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9432026-07-11T17:59:51.624ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 25738eb8-f33e-4acd-ad94-b8640d86aaf5 producer_ip = fd00:1122:3344:101::b producer_port = 65422
9442026-07-11T17:59:51.624ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 25738eb8-f33e-4acd-ad94-b8640d86aaf5 producer_ip = fd00:1122:3344:101::b producer_port = 65422
9452026-07-11T17:59:51.632ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 8 producer_id = 25738eb8-f33e-4acd-ad94-b8640d86aaf5 producer_ip = fd00:1122:3344:101::b producer_port = 65422
9462026-07-11T17:59:51.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9472026-07-11T17:59:51.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9482026-07-11T17:59:51.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9492026-07-11T17:59:52.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9502026-07-11T17:59:52.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9512026-07-11T17:59:52.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9522026-07-11T17:59:52.041ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
9532026-07-11T17:59:52.041ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
9542026-07-11T17:59:52.042ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = c08a2d6b-2710-4fa1-86e5-778d41cd7deb producer_ip = fd00:1122:3344:101::2 producer_port = 60333
9552026-07-11T17:59:52.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9562026-07-11T17:59:52.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9572026-07-11T17:59:52.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9582026-07-11T17:59:52.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9592026-07-11T17:59:52.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9602026-07-11T17:59:52.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9612026-07-11T17:59:53.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9622026-07-11T17:59:53.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9632026-07-11T17:59:53.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9642026-07-11T17:59:53.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9652026-07-11T17:59:53.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9662026-07-11T17:59:53.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9672026-07-11T17:59:53.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 241
9682026-07-11T17:59:53.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 241
9692026-07-11T17:59:53.761ZDEBGoximeter (clickhouse-client): unrolling 241 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
9702026-07-11T17:59:53.762ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
9712026-07-11T17:59:53.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_ipaddr
9722026-07-11T17:59:53.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 108 table_name = fields_string
9732026-07-11T17:59:53.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 17 table_name = fields_u16
9742026-07-11T17:59:53.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 111 table_name = fields_uuid
9752026-07-11T17:59:53.772ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 162 table_name = measurements_cumulativeu64
9762026-07-11T17:59:53.774ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 13 table_name = measurements_histogramu64
9772026-07-11T17:59:53.775ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 6 table_name = measurements_i64
9782026-07-11T17:59:53.776ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 60 table_name = measurements_u64
9792026-07-11T17:59:53.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9802026-07-11T17:59:53.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9812026-07-11T17:59:53.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9822026-07-11T17:59:53.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
9832026-07-11T17:59:54.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9842026-07-11T17:59:54.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9852026-07-11T17:59:54.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9862026-07-11T17:59:54.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9872026-07-11T17:59:54.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9882026-07-11T17:59:54.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9892026-07-11T17:59:54.808ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 121e3fc9-5ed9-49a8-bda7-7953293ac7c7 producer_ip = fd00:1122:3344:101::1 producer_port = 64283
9902026-07-11T17:59:54.808ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 121e3fc9-5ed9-49a8-bda7-7953293ac7c7 producer_ip = fd00:1122:3344:101::1 producer_port = 64283
9912026-07-11T17:59:54.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9922026-07-11T17:59:54.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9932026-07-11T17:59:54.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9942026-07-11T17:59:54.827ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1692 producer_id = 121e3fc9-5ed9-49a8-bda7-7953293ac7c7 producer_ip = fd00:1122:3344:101::1 producer_port = 64283
9952026-07-11T17:59:54.830ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 1762
9962026-07-11T17:59:54.830ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 1762
9972026-07-11T17:59:54.830ZDEBGoximeter (clickhouse-client): unrolling 1762 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
9982026-07-11T17:59:54.830ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
9992026-07-11T17:59:54.846ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 2423 table_name = fields_string
10002026-07-11T17:59:54.847ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 9 table_name = fields_u16
10012026-07-11T17:59:54.849ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 801 table_name = fields_u32
10022026-07-11T17:59:54.850ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 1312 table_name = fields_uuid
10032026-07-11T17:59:54.852ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 1735 table_name = measurements_cumulativeu64
10042026-07-11T17:59:54.854ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 9 table_name = measurements_histogramu64
10052026-07-11T17:59:54.855ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 18 table_name = measurements_u64
10062026-07-11T17:59:54.931ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
10072026-07-11T17:59:54.953ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
10082026-07-11T17:59:54.953ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
10092026-07-11T17:59:54.956ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 25 producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
10102026-07-11T17:59:55.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10112026-07-11T17:59:55.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10122026-07-11T17:59:55.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10132026-07-11T17:59:55.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10142026-07-11T17:59:55.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10152026-07-11T17:59:55.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10162026-07-11T17:59:55.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10172026-07-11T17:59:55.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10182026-07-11T17:59:55.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10192026-07-11T17:59:56.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10202026-07-11T17:59:56.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10212026-07-11T17:59:56.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10222026-07-11T17:59:56.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10232026-07-11T17:59:56.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10242026-07-11T17:59:56.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10252026-07-11T17:59:56.600ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c3bdca6b-b847-4cae-8dde-bdf6551e02b7 producer_ip = fd00:1122:3344:101::c producer_port = 35748
10262026-07-11T17:59:56.600ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = c3bdca6b-b847-4cae-8dde-bdf6551e02b7 producer_ip = fd00:1122:3344:101::c producer_port = 35748
10272026-07-11T17:59:56.601ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = c3bdca6b-b847-4cae-8dde-bdf6551e02b7 producer_ip = fd00:1122:3344:101::c producer_port = 35748
10282026-07-11T17:59:56.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10292026-07-11T17:59:56.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10302026-07-11T17:59:56.811ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10312026-07-11T17:59:57.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10322026-07-11T17:59:57.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10332026-07-11T17:59:57.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10342026-07-11T17:59:57.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10352026-07-11T17:59:57.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10362026-07-11T17:59:57.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10372026-07-11T17:59:57.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10382026-07-11T17:59:57.811ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10392026-07-11T17:59:57.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10402026-07-11T17:59:58.029ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10412026-07-11T17:59:58.029ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10422026-07-11T17:59:58.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10432026-07-11T17:59:58.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10442026-07-11T17:59:58.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10452026-07-11T17:59:58.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10462026-07-11T17:59:58.696ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 0efa92d1-f843-45ac-a0f1-f2dbbd7a9003 producer_ip = fd00:1122:3344:101::a producer_port = 54377
10472026-07-11T17:59:58.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 179
10482026-07-11T17:59:58.761ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_samples = 179
10492026-07-11T17:59:58.761ZDEBGoximeter (clickhouse-client): unrolling 179 total samples collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
10502026-07-11T17:59:58.762ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6
10512026-07-11T17:59:58.766ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 4 table_name = fields_ipaddr
10522026-07-11T17:59:58.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 136 table_name = fields_string
10532026-07-11T17:59:58.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 31 table_name = fields_u16
10542026-07-11T17:59:58.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 119 table_name = fields_uuid
10552026-07-11T17:59:58.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 110 table_name = measurements_cumulativeu64
10562026-07-11T17:59:58.773ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 27 table_name = measurements_histogramu64
10572026-07-11T17:59:58.774ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d id = 985e94e4-d053-4031-90cb-072f76f425c6 n_rows = 42 table_name = measurements_u64
10582026-07-11T17:59:58.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10592026-07-11T17:59:58.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10602026-07-11T17:59:58.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10612026-07-11T17:59:58.862ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
10622026-07-11T17:59:58.917ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
10632026-07-11T17:59:58.917ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending
10642026-07-11T17:59:58.924ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "be066a96-a103-4bd7-8125-f63ee009f23b", "content-length": "1412", "date": "Sat, 11 Jul 2026 17:59:58 GMT"} })
10652026-07-11T17:59:58.924ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D
10662026-07-11T17:59:58.927ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/90b659f1-88c8-4108-a325-f055c37ec497/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMzc3YTljOC1lYjUwLTQ2NDItOTg0MC03OGUzNmVlNDVjNzMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f8578ac-66bf-4311-86a7-083fa88881ec", "content-length": "29", "date": "Sat, 11 Jul 2026 17:59:58 GMT"} })
10672026-07-11T17:59:58.927ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 9 n_pruned_tasks = 0
10682026-07-11T17:59:59.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10692026-07-11T17:59:59.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10702026-07-11T17:59:59.029ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10712026-07-11T17:59:59.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10722026-07-11T17:59:59.220ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10732026-07-11T17:59:59.221ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10742026-07-11T17:59:59.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10752026-07-11T17:59:59.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10762026-07-11T17:59:59.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10772026-07-11T18:00:00.028ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10782026-07-11T18:00:00.028ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10792026-07-11T18:00:00.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 877212e6-b0b8-4b0a-851a-bc0a8676b59d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10802026-07-11T18:00:00.220ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10812026-07-11T18:00:00.221ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10822026-07-11T18:00:00.222ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = b833cb09-3aee-4e79-ac89-172cd8048250 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10832026-07-11T18:00:00.810ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10842026-07-11T18:00:00.810ZDEBGoximeter (collection-task): collecting from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10852026-07-11T18:00:00.812ZDEBGoximeter (collection-task): collected results from producer collector_id = 90b659f1-88c8-4108-a325-f055c37ec497 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 338e2ec1-2361-40f3-85ec-10dfd58d50e8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001