Max level shown:
1 [ Mar 30 18:58:20 Enabled. ]
2 [ Mar 30 18:58:20 Rereading configuration. ]
3 [ Mar 30 18:58:22 Rereading configuration. ]
4 [ Mar 30 18:58:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 038d1c9a-a224-42ea-818f-d814a0a794b1 &"). ]
5 [ Mar 30 18:58:27 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-03-30T18:58:27.651ZDEBGoximeter: registered DTrace probes
82026-03-30T18:58:27.651ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:265
92026-03-30T18:58:27.654ZDEBGoximeter: creating ClickHouse client
102026-03-30T18:58:27.686ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
112026-03-30T18:58:43.859ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
122026-03-30T18:58:43.859ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
132026-03-30T18:58:43.859ZINFOoximeter (clickhouse-client): reading db version collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
142026-03-30T18:58:43.860ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
152026-03-30T18:58:43.860ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:805 id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 version = 0
162026-03-30T18:58:43.860ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:810 id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
172026-03-30T18:58:43.861ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
182026-03-30T18:58:44.569ZINFOoximeter (clickhouse-client): inserting current version collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:831 id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 version = 14
192026-03-30T18:58:44.600ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 0122a795-3c6a-45f0-9278-5ae09c808fd6
202026-03-30T18:58:44.659ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-03-30T18:58:44.659ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-03-30T18:58:44.661ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-03-30T18:58:44.661ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-03-30T18:58:44.661ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252026-03-30T18:58:44.672ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-03-30T18:58:44.674ZDEBGoximeter: registered USDT probes
272026-03-30T18:58:44.674ZDEBGoximeter: contacting nexus
282026-03-30T18:58:44.743ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-03-30T18:58:44.877ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "89b0650d-a58c-4698-8785-ca9044ebaf99", "date": "Mon, 30 Mar 2026 18:58:44 GMT"} })
302026-03-30T18:58:44.879ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:428 id = 038d1c9a-a224-42ea-818f-d814a0a794b1
312026-03-30T18:58:44.879ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:554
322026-03-30T18:58:44.880ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
332026-03-30T18:58:44.885ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending
342026-03-30T18:58:44.956ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3326e5f-54a1-4f44-9655-02da9a73094d", "content-length": "29", "date": "Mon, 30 Mar 2026 18:58:44 GMT"} })
352026-03-30T18:58:44.956ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
362026-03-30T18:58:59.880ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
372026-03-30T18:58:59.880ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending
382026-03-30T18:58:59.885ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "96a510d9-6404-48cf-8046-50fb5b75bfad", "content-length": "436", "date": "Mon, 30 Mar 2026 18:58:59 GMT"} })
392026-03-30T18:58:59.895ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI3NGY3ZjFmMi1iNDE2LTQ1OWQtYjMxMy1hOTFiYmM4Yjc5ODUifX0%3D
402026-03-30T18:58:59.898ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI3NGY3ZjFmMi1iNDE2LTQ1OWQtYjMxMy1hOTFiYmM4Yjc5ODUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd1881fb-4005-46ff-8e8f-7a9e97b889d6", "content-length": "29", "date": "Mon, 30 Mar 2026 18:58:59 GMT"} })
412026-03-30T18:58:59.898ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:61693 collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa
422026-03-30T18:58:59.898ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985
432026-03-30T18:58:59.898ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
442026-03-30T18:58:59.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
452026-03-30T18:58:59.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
462026-03-30T18:58:59.950ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
472026-03-30T18:58:59.950ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
482026-03-30T18:58:59.950ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
492026-03-30T18:58:59.950ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
502026-03-30T18:58:59.958ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
512026-03-30T18:58:59.959ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
522026-03-30T18:59:00.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
532026-03-30T18:59:00.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
542026-03-30T18:59:00.901ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
552026-03-30T18:59:01.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
562026-03-30T18:59:01.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
572026-03-30T18:59:01.901ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
582026-03-30T18:59:02.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
592026-03-30T18:59:02.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
602026-03-30T18:59:02.901ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
612026-03-30T18:59:03.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
622026-03-30T18:59:03.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
632026-03-30T18:59:03.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
642026-03-30T18:59:04.600ZDEBGoximeter (results-sink-cluster): inserting 78 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
652026-03-30T18:59:04.602ZDEBGoximeter (results-sink): inserting 78 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
662026-03-30T18:59:04.602ZDEBGoximeter (clickhouse-client): unrolling 78 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
672026-03-30T18:59:04.603ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
682026-03-30T18:59:04.614ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.603116159Z } timeseries_name = oximeter_collector:collections
692026-03-30T18:59:04.621ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
702026-03-30T18:59:04.631ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.621045758Z } timeseries_name = http_service:request_latency_histogram
712026-03-30T18:59:04.631ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
722026-03-30T18:59:04.636ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.631438229Z } timeseries_name = collection_target:cpus_provisioned
732026-03-30T18:59:04.636ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
742026-03-30T18:59:04.637ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.636762354Z } timeseries_name = collection_target:ram_provisioned
752026-03-30T18:59:04.637ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
762026-03-30T18:59:04.638ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.637665743Z } timeseries_name = collection_target:virtual_disk_space_provisioned
772026-03-30T18:59:04.638ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
782026-03-30T18:59:04.639ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.638536852Z } timeseries_name = ddm_router:originated_underlay_prefixes
792026-03-30T18:59:04.639ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
802026-03-30T18:59:04.640ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.639409900Z } timeseries_name = ddm_router:originated_tunnel_endpoints
812026-03-30T18:59:04.640ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
822026-03-30T18:59:04.641ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.640280829Z } timeseries_name = ddm_session:solicitations_sent
832026-03-30T18:59:04.641ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
842026-03-30T18:59:04.641ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.641146528Z } timeseries_name = ddm_session:solicitations_received
852026-03-30T18:59:04.642ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
862026-03-30T18:59:04.642ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.642008766Z } timeseries_name = ddm_session:advertisements_sent
872026-03-30T18:59:04.642ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
882026-03-30T18:59:04.643ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.642887555Z } timeseries_name = ddm_session:advertisements_received
892026-03-30T18:59:04.643ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
902026-03-30T18:59:04.644ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.643762494Z } timeseries_name = ddm_session:peer_expirations
912026-03-30T18:59:04.644ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
922026-03-30T18:59:04.645ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.644649963Z } timeseries_name = ddm_session:peer_address_changes
932026-03-30T18:59:04.645ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
942026-03-30T18:59:04.646ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.645518981Z } timeseries_name = ddm_session:peer_sessions_established
952026-03-30T18:59:04.646ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
962026-03-30T18:59:04.647ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.646401760Z } timeseries_name = ddm_session:updates_sent
972026-03-30T18:59:04.647ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
982026-03-30T18:59:04.648ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.647289409Z } timeseries_name = ddm_session:updates_received
992026-03-30T18:59:04.648ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
1002026-03-30T18:59:04.649ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.648286631Z } timeseries_name = ddm_session:update_send_fail
1012026-03-30T18:59:04.649ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
1022026-03-30T18:59:04.650ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.649227202Z } timeseries_name = ddm_session:imported_underlay_prefixes
1032026-03-30T18:59:04.650ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
1042026-03-30T18:59:04.651ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:04.650152623Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1052026-03-30T18:59:04.653ZDEBGoximeter (clickhouse-client): inserting 19 new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
1062026-03-30T18:59:04.662ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 4 table_name = fields_ipaddr
1072026-03-30T18:59:04.666ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 34 table_name = fields_string
1082026-03-30T18:59:04.667ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 7 table_name = fields_u16
1092026-03-30T18:59:04.669ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 38 table_name = fields_uuid
1102026-03-30T18:59:04.675ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 52 table_name = measurements_cumulativeu64
1112026-03-30T18:59:04.680ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 3 table_name = measurements_histogramu64
1122026-03-30T18:59:04.681ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 3 table_name = measurements_i64
1132026-03-30T18:59:04.683ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 20 table_name = measurements_u64
1142026-03-30T18:59:04.704ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1152026-03-30T18:59:04.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1162026-03-30T18:59:04.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1172026-03-30T18:59:04.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1182026-03-30T18:59:05.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1192026-03-30T18:59:05.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1202026-03-30T18:59:05.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1212026-03-30T18:59:06.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1222026-03-30T18:59:06.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1232026-03-30T18:59:06.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1242026-03-30T18:59:07.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1252026-03-30T18:59:07.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1262026-03-30T18:59:07.901ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1272026-03-30T18:59:08.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1282026-03-30T18:59:08.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1292026-03-30T18:59:08.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1302026-03-30T18:59:09.600ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
1312026-03-30T18:59:09.602ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
1322026-03-30T18:59:09.602ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
1332026-03-30T18:59:09.608ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 26 table_name = fields_string
1342026-03-30T18:59:09.609ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 28 table_name = fields_uuid
1352026-03-30T18:59:09.611ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 50 table_name = measurements_cumulativeu64
1362026-03-30T18:59:09.613ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 20 table_name = measurements_u64
1372026-03-30T18:59:09.702ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1382026-03-30T18:59:09.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
1392026-03-30T18:59:09.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1402026-03-30T18:59:09.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
1412026-03-30T18:59:09.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1422026-03-30T18:59:09.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1432026-03-30T18:59:09.903ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
1442026-03-30T18:59:10.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1452026-03-30T18:59:10.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1462026-03-30T18:59:10.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1472026-03-30T18:59:11.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1482026-03-30T18:59:11.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1492026-03-30T18:59:11.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1502026-03-30T18:59:12.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1512026-03-30T18:59:12.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1522026-03-30T18:59:12.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1532026-03-30T18:59:13.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1542026-03-30T18:59:13.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1552026-03-30T18:59:13.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1562026-03-30T18:59:14.600ZDEBGoximeter (results-sink-cluster): inserting 108 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
1572026-03-30T18:59:14.602ZDEBGoximeter (results-sink): inserting 108 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
1582026-03-30T18:59:14.602ZDEBGoximeter (clickhouse-client): unrolling 108 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
1592026-03-30T18:59:14.608ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 72 table_name = fields_string
1602026-03-30T18:59:14.610ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 23 table_name = fields_u16
1612026-03-30T18:59:14.611ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 59 table_name = fields_uuid
1622026-03-30T18:59:14.612ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 50 table_name = measurements_cumulativeu64
1632026-03-30T18:59:14.614ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 23 table_name = measurements_histogramu64
1642026-03-30T18:59:14.616ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 15 table_name = measurements_i64
1652026-03-30T18:59:14.617ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 20 table_name = measurements_u64
1662026-03-30T18:59:14.701ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1672026-03-30T18:59:14.879ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
1682026-03-30T18:59:14.879ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending
1692026-03-30T18:59:14.885ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "84f601c9-91cd-4bb0-9543-b7c4276f98cd", "content-length": "574", "date": "Mon, 30 Mar 2026 18:59:14 GMT"} })
1702026-03-30T18:59:14.885ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOWZiNTZlNC02YjJmLTQxZjItYTk2Ni1hZDQxMzI2ZTJmNGYifX0%3D
1712026-03-30T18:59:14.892ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOWZiNTZlNC02YjJmLTQxZjItYTk2Ni1hZDQxMzI2ZTJmNGYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "d96529cb-d7fc-4a45-9769-f4b36204323a", "content-length": "29", "date": "Mon, 30 Mar 2026 18:59:14 GMT"} })
1722026-03-30T18:59:14.892ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:46861 collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f
1732026-03-30T18:59:14.892ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 3 n_pruned_tasks = 0
1742026-03-30T18:59:14.893ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
1752026-03-30T18:59:14.893ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
1762026-03-30T18:59:14.893ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
1772026-03-30T18:59:14.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1782026-03-30T18:59:14.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1792026-03-30T18:59:14.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1802026-03-30T18:59:14.941ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
1812026-03-30T18:59:15.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1822026-03-30T18:59:15.899ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1832026-03-30T18:59:15.901ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1842026-03-30T18:59:16.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1852026-03-30T18:59:16.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1862026-03-30T18:59:16.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1872026-03-30T18:59:17.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1882026-03-30T18:59:17.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1892026-03-30T18:59:17.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1902026-03-30T18:59:18.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1912026-03-30T18:59:18.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1922026-03-30T18:59:18.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1932026-03-30T18:59:19.600ZDEBGoximeter (results-sink-cluster): inserting 371 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
1942026-03-30T18:59:19.602ZDEBGoximeter (results-sink): inserting 371 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
1952026-03-30T18:59:19.602ZDEBGoximeter (clickhouse-client): unrolling 371 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
1962026-03-30T18:59:19.603ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
1972026-03-30T18:59:19.637ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:19.603431823Z } timeseries_name = switch_port_control_data_link:errors_received
1982026-03-30T18:59:19.639ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
1992026-03-30T18:59:19.641ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:19.639546099Z } timeseries_name = switch_port_control_data_link:errors_sent
2002026-03-30T18:59:19.641ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
2012026-03-30T18:59:19.643ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:19.641544704Z } timeseries_name = switch_port_control_data_link:bytes_received
2022026-03-30T18:59:19.643ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
2032026-03-30T18:59:19.644ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:19.643122276Z } timeseries_name = switch_port_control_data_link:packets_received
2042026-03-30T18:59:19.644ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
2052026-03-30T18:59:19.646ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:19.644896444Z } timeseries_name = switch_port_control_data_link:bytes_sent
2062026-03-30T18:59:19.646ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
2072026-03-30T18:59:19.647ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:19.646444025Z } timeseries_name = switch_port_control_data_link:packets_sent
2082026-03-30T18:59:19.662ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
2092026-03-30T18:59:19.666ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 24 table_name = fields_i16
2102026-03-30T18:59:19.667ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 2 table_name = fields_ipaddr
2112026-03-30T18:59:19.668ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 147 table_name = fields_string
2122026-03-30T18:59:19.670ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 14 table_name = fields_u16
2132026-03-30T18:59:19.671ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 24 table_name = fields_u32
2142026-03-30T18:59:19.673ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 12 table_name = fields_u8
2152026-03-30T18:59:19.674ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 66 table_name = fields_uuid
2162026-03-30T18:59:19.675ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 351 table_name = measurements_cumulativeu64
2172026-03-30T18:59:19.677ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 20 table_name = measurements_u64
2182026-03-30T18:59:19.701ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2192026-03-30T18:59:19.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
2202026-03-30T18:59:19.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
2212026-03-30T18:59:19.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2222026-03-30T18:59:19.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2232026-03-30T18:59:19.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2242026-03-30T18:59:19.901ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
2252026-03-30T18:59:20.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2262026-03-30T18:59:20.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2272026-03-30T18:59:20.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2282026-03-30T18:59:21.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2292026-03-30T18:59:21.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2302026-03-30T18:59:21.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2312026-03-30T18:59:22.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2322026-03-30T18:59:22.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2332026-03-30T18:59:22.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2342026-03-30T18:59:23.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2352026-03-30T18:59:23.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2362026-03-30T18:59:23.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2372026-03-30T18:59:24.600ZDEBGoximeter (results-sink-cluster): inserting 93 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
2382026-03-30T18:59:24.602ZDEBGoximeter (results-sink): inserting 93 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
2392026-03-30T18:59:24.602ZDEBGoximeter (clickhouse-client): unrolling 93 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
2402026-03-30T18:59:24.608ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 72 table_name = fields_string
2412026-03-30T18:59:24.609ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 23 table_name = fields_u16
2422026-03-30T18:59:24.610ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 51 table_name = fields_uuid
2432026-03-30T18:59:24.612ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 50 table_name = measurements_cumulativeu64
2442026-03-30T18:59:24.614ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 23 table_name = measurements_histogramu64
2452026-03-30T18:59:24.615ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 20 table_name = measurements_u64
2462026-03-30T18:59:24.701ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2472026-03-30T18:59:24.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2482026-03-30T18:59:24.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2492026-03-30T18:59:24.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2502026-03-30T18:59:25.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2512026-03-30T18:59:25.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2522026-03-30T18:59:25.901ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2532026-03-30T18:59:26.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2542026-03-30T18:59:26.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2552026-03-30T18:59:26.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2562026-03-30T18:59:27.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2572026-03-30T18:59:27.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2582026-03-30T18:59:27.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2592026-03-30T18:59:28.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2602026-03-30T18:59:28.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2612026-03-30T18:59:28.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2622026-03-30T18:59:29.600ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
2632026-03-30T18:59:29.602ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
2642026-03-30T18:59:29.602ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
2652026-03-30T18:59:29.607ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 26 table_name = fields_string
2662026-03-30T18:59:29.609ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 28 table_name = fields_uuid
2672026-03-30T18:59:29.610ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 50 table_name = measurements_cumulativeu64
2682026-03-30T18:59:29.612ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 20 table_name = measurements_u64
2692026-03-30T18:59:29.701ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2702026-03-30T18:59:29.879ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
2712026-03-30T18:59:29.879ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending
2722026-03-30T18:59:29.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
2732026-03-30T18:59:29.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
2742026-03-30T18:59:29.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2752026-03-30T18:59:29.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2762026-03-30T18:59:29.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2772026-03-30T18:59:29.901ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
2782026-03-30T18:59:29.904ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "950e4649-e1f7-4b4b-b71c-51813abe797e", "content-length": "710", "date": "Mon, 30 Mar 2026 18:59:29 GMT"} })
2792026-03-30T18:59:29.904ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOWZiNTZlNC02YjJmLTQxZjItYTk2Ni1hZDQxMzI2ZTJmNGYifX0%3D
2802026-03-30T18:59:29.911ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOWZiNTZlNC02YjJmLTQxZjItYTk2Ni1hZDQxMzI2ZTJmNGYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "fae8f17e-3974-47e4-96fd-718292412cb8", "content-length": "29", "date": "Mon, 30 Mar 2026 18:59:29 GMT"} })
2812026-03-30T18:59:29.911ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561
2822026-03-30T18:59:29.911ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:59483 collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f
2832026-03-30T18:59:29.911ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
2842026-03-30T18:59:29.911ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 4 n_pruned_tasks = 0
2852026-03-30T18:59:29.912ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:59483 collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
2862026-03-30T18:59:29.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2872026-03-30T18:59:29.913ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2882026-03-30T18:59:29.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
2892026-03-30T18:59:29.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2902026-03-30T18:59:29.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
2912026-03-30T18:59:29.920ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2922026-03-30T18:59:29.934ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
2932026-03-30T18:59:30.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2942026-03-30T18:59:30.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2952026-03-30T18:59:30.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2962026-03-30T18:59:30.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2972026-03-30T18:59:30.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2982026-03-30T18:59:30.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2992026-03-30T18:59:31.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3002026-03-30T18:59:31.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3012026-03-30T18:59:31.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3022026-03-30T18:59:31.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3032026-03-30T18:59:31.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3042026-03-30T18:59:31.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3052026-03-30T18:59:32.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3062026-03-30T18:59:32.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3072026-03-30T18:59:32.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3082026-03-30T18:59:32.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3092026-03-30T18:59:32.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3102026-03-30T18:59:32.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3112026-03-30T18:59:33.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3122026-03-30T18:59:33.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3132026-03-30T18:59:33.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3142026-03-30T18:59:33.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3152026-03-30T18:59:33.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3162026-03-30T18:59:33.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3172026-03-30T18:59:34.600ZDEBGoximeter (results-sink-cluster): inserting 256 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
3182026-03-30T18:59:34.602ZDEBGoximeter (results-sink): inserting 256 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
3192026-03-30T18:59:34.602ZDEBGoximeter (clickhouse-client): unrolling 256 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3202026-03-30T18:59:34.604ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3212026-03-30T18:59:34.609ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.604281562Z } timeseries_name = static_routing_config:static_routes
3222026-03-30T18:59:34.609ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3232026-03-30T18:59:34.611ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.609294616Z } timeseries_name = static_routing_config:static_nexthops
3242026-03-30T18:59:34.611ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3252026-03-30T18:59:34.613ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.611390115Z } timeseries_name = switch_rib:active_routes
3262026-03-30T18:59:34.613ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3272026-03-30T18:59:34.615ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.613380150Z } timeseries_name = mg_lower:routes_blocked_by_link_state
3282026-03-30T18:59:34.615ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3292026-03-30T18:59:34.617ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.615237521Z } timeseries_name = switch_data_link:link_enabled
3302026-03-30T18:59:34.617ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3312026-03-30T18:59:34.618ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.617199356Z } timeseries_name = switch_data_link:link_up
3322026-03-30T18:59:34.619ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3332026-03-30T18:59:34.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.619326336Z } timeseries_name = switch_table:capacity
3342026-03-30T18:59:34.621ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3352026-03-30T18:59:34.622ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.621153336Z } timeseries_name = switch_table:occupancy
3362026-03-30T18:59:34.623ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3372026-03-30T18:59:34.624ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.623010037Z } timeseries_name = switch_table:inserts
3382026-03-30T18:59:34.624ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3392026-03-30T18:59:34.626ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.624954670Z } timeseries_name = switch_table:deletes
3402026-03-30T18:59:34.626ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3412026-03-30T18:59:34.628ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.626877353Z } timeseries_name = switch_table:updates
3422026-03-30T18:59:34.628ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3432026-03-30T18:59:34.630ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.628843938Z } timeseries_name = switch_table:collisions
3442026-03-30T18:59:34.630ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3452026-03-30T18:59:34.632ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.630825103Z } timeseries_name = switch_table:update_misses
3462026-03-30T18:59:34.632ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3472026-03-30T18:59:34.634ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.632788178Z } timeseries_name = switch_table:delete_misses
3482026-03-30T18:59:34.634ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3492026-03-30T18:59:34.636ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.634759572Z } timeseries_name = switch_table:exhaustion
3502026-03-30T18:59:34.643ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3512026-03-30T18:59:34.645ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-30T18:59:34.643572321Z } timeseries_name = dendrite:sample_collection_duration
3522026-03-30T18:59:34.648ZDEBGoximeter (clickhouse-client): inserting 16 new timeseries schema collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3532026-03-30T18:59:34.651ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 284 table_name = fields_i16
3542026-03-30T18:59:34.652ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 2 table_name = fields_ipaddr
3552026-03-30T18:59:34.654ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 818 table_name = fields_string
3562026-03-30T18:59:34.655ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 167 table_name = fields_u16
3572026-03-30T18:59:34.657ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 149 table_name = fields_u32
3582026-03-30T18:59:34.658ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 148 table_name = fields_u8
3592026-03-30T18:59:34.659ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 487 table_name = fields_uuid
3602026-03-30T18:59:34.661ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 6 table_name = measurements_bool
3612026-03-30T18:59:34.662ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 166 table_name = measurements_cumulativeu64
3622026-03-30T18:59:34.663ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 1 table_name = measurements_f64
3632026-03-30T18:59:34.665ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 23 table_name = measurements_histogramu64
3642026-03-30T18:59:34.667ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 60 table_name = measurements_u64
3652026-03-30T18:59:34.701ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3662026-03-30T18:59:34.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3672026-03-30T18:59:34.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3682026-03-30T18:59:34.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3692026-03-30T18:59:34.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3702026-03-30T18:59:34.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3712026-03-30T18:59:34.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3722026-03-30T18:59:35.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3732026-03-30T18:59:35.897ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3742026-03-30T18:59:35.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3752026-03-30T18:59:35.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3762026-03-30T18:59:35.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3772026-03-30T18:59:35.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3782026-03-30T18:59:36.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3792026-03-30T18:59:36.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3802026-03-30T18:59:36.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3812026-03-30T18:59:36.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3822026-03-30T18:59:36.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3832026-03-30T18:59:36.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3842026-03-30T18:59:37.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3852026-03-30T18:59:37.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3862026-03-30T18:59:37.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3872026-03-30T18:59:37.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3882026-03-30T18:59:37.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3892026-03-30T18:59:37.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3902026-03-30T18:59:38.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3912026-03-30T18:59:38.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3922026-03-30T18:59:38.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3932026-03-30T18:59:38.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3942026-03-30T18:59:38.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3952026-03-30T18:59:38.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3962026-03-30T18:59:39.599ZDEBGoximeter (results-sink-cluster): inserting 90 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
3972026-03-30T18:59:39.601ZDEBGoximeter (results-sink): inserting 90 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
3982026-03-30T18:59:39.601ZDEBGoximeter (clickhouse-client): unrolling 90 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
3992026-03-30T18:59:39.607ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 30 table_name = fields_string
4002026-03-30T18:59:39.608ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 36 table_name = fields_uuid
4012026-03-30T18:59:39.609ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 60 table_name = measurements_cumulativeu64
4022026-03-30T18:59:39.611ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 30 table_name = measurements_u64
4032026-03-30T18:59:39.701ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4042026-03-30T18:59:39.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
4052026-03-30T18:59:39.897ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
4062026-03-30T18:59:39.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4072026-03-30T18:59:39.897ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4082026-03-30T18:59:39.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4092026-03-30T18:59:39.901ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
4102026-03-30T18:59:39.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
4112026-03-30T18:59:39.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
4122026-03-30T18:59:39.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4132026-03-30T18:59:39.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4142026-03-30T18:59:39.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4152026-03-30T18:59:39.924ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
4162026-03-30T18:59:40.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4172026-03-30T18:59:40.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4182026-03-30T18:59:40.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4192026-03-30T18:59:40.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4202026-03-30T18:59:40.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4212026-03-30T18:59:40.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4222026-03-30T18:59:41.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4232026-03-30T18:59:41.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4242026-03-30T18:59:41.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4252026-03-30T18:59:41.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4262026-03-30T18:59:41.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4272026-03-30T18:59:41.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4282026-03-30T18:59:42.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4292026-03-30T18:59:42.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4302026-03-30T18:59:42.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4312026-03-30T18:59:42.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4322026-03-30T18:59:42.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4332026-03-30T18:59:42.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4342026-03-30T18:59:43.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4352026-03-30T18:59:43.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4362026-03-30T18:59:43.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4372026-03-30T18:59:43.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4382026-03-30T18:59:43.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4392026-03-30T18:59:43.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4402026-03-30T18:59:44.600ZDEBGoximeter (results-sink-cluster): inserting 255 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
4412026-03-30T18:59:44.602ZDEBGoximeter (results-sink): inserting 255 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
4422026-03-30T18:59:44.602ZDEBGoximeter (clickhouse-client): unrolling 255 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
4432026-03-30T18:59:44.617ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 284 table_name = fields_i16
4442026-03-30T18:59:44.619ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 817 table_name = fields_string
4452026-03-30T18:59:44.620ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 165 table_name = fields_u16
4462026-03-30T18:59:44.622ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 149 table_name = fields_u32
4472026-03-30T18:59:44.623ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 148 table_name = fields_u8
4482026-03-30T18:59:44.625ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 485 table_name = fields_uuid
4492026-03-30T18:59:44.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 6 table_name = measurements_bool
4502026-03-30T18:59:44.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 165 table_name = measurements_cumulativeu64
4512026-03-30T18:59:44.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 1 table_name = measurements_f64
4522026-03-30T18:59:44.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 23 table_name = measurements_histogramu64
4532026-03-30T18:59:44.631ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 60 table_name = measurements_u64
4542026-03-30T18:59:44.701ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4552026-03-30T18:59:44.878ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
4562026-03-30T18:59:44.878ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending
4572026-03-30T18:59:44.882ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "8478dfc7-1b11-4026-ac53-509fbde2117f", "content-length": "846", "date": "Mon, 30 Mar 2026 18:59:44 GMT"} })
4582026-03-30T18:59:44.882ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOWZiNTZlNC02YjJmLTQxZjItYTk2Ni1hZDQxMzI2ZTJmNGYifX0%3D
4592026-03-30T18:59:44.884ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOWZiNTZlNC02YjJmLTQxZjItYTk2Ni1hZDQxMzI2ZTJmNGYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b42f490-4ce9-4af7-852c-6fb159da1a53", "content-length": "29", "date": "Mon, 30 Mar 2026 18:59:44 GMT"} })
4602026-03-30T18:59:44.884ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215
4612026-03-30T18:59:44.884ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
4622026-03-30T18:59:44.885ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4632026-03-30T18:59:44.886ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4642026-03-30T18:59:44.886ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4652026-03-30T18:59:44.892ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4662026-03-30T18:59:44.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4672026-03-30T18:59:44.897ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4682026-03-30T18:59:44.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4692026-03-30T18:59:44.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4702026-03-30T18:59:44.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4712026-03-30T18:59:44.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4722026-03-30T18:59:45.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4732026-03-30T18:59:45.885ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4742026-03-30T18:59:45.888ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4752026-03-30T18:59:45.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4762026-03-30T18:59:45.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4772026-03-30T18:59:45.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4782026-03-30T18:59:45.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4792026-03-30T18:59:45.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4802026-03-30T18:59:45.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4812026-03-30T18:59:46.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4822026-03-30T18:59:46.885ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4832026-03-30T18:59:46.889ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4842026-03-30T18:59:46.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4852026-03-30T18:59:46.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4862026-03-30T18:59:46.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4872026-03-30T18:59:46.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4882026-03-30T18:59:46.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4892026-03-30T18:59:46.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4902026-03-30T18:59:47.886ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4912026-03-30T18:59:47.886ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4922026-03-30T18:59:47.888ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4932026-03-30T18:59:47.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4942026-03-30T18:59:47.897ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4952026-03-30T18:59:47.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4962026-03-30T18:59:47.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4972026-03-30T18:59:47.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4982026-03-30T18:59:47.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4992026-03-30T18:59:48.886ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5002026-03-30T18:59:48.886ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5012026-03-30T18:59:48.888ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5022026-03-30T18:59:48.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5032026-03-30T18:59:48.897ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5042026-03-30T18:59:48.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5052026-03-30T18:59:48.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5062026-03-30T18:59:48.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5072026-03-30T18:59:48.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5082026-03-30T18:59:49.600ZDEBGoximeter (results-sink-cluster): inserting 221 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
5092026-03-30T18:59:49.602ZDEBGoximeter (results-sink): inserting 221 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
5102026-03-30T18:59:49.602ZDEBGoximeter (clickhouse-client): unrolling 221 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
5112026-03-30T18:59:49.612ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 2 table_name = fields_ipaddr
5122026-03-30T18:59:49.614ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 57 table_name = fields_string
5132026-03-30T18:59:49.615ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 2 table_name = fields_u16
5142026-03-30T18:59:49.616ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 66 table_name = fields_uuid
5152026-03-30T18:59:49.618ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 161 table_name = measurements_cumulativeu64
5162026-03-30T18:59:49.619ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 60 table_name = measurements_u64
5172026-03-30T18:59:49.700ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5182026-03-30T18:59:49.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5192026-03-30T18:59:49.885ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5202026-03-30T18:59:49.888ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5212026-03-30T18:59:49.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
5222026-03-30T18:59:49.897ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
5232026-03-30T18:59:49.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5242026-03-30T18:59:49.897ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5252026-03-30T18:59:49.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5262026-03-30T18:59:49.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
5272026-03-30T18:59:49.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
5282026-03-30T18:59:49.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
5292026-03-30T18:59:49.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5302026-03-30T18:59:49.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5312026-03-30T18:59:49.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5322026-03-30T18:59:49.926ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
5332026-03-30T18:59:50.886ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5342026-03-30T18:59:50.886ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5352026-03-30T18:59:50.888ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5362026-03-30T18:59:50.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5372026-03-30T18:59:50.897ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5382026-03-30T18:59:50.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5392026-03-30T18:59:50.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5402026-03-30T18:59:50.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5412026-03-30T18:59:50.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5422026-03-30T18:59:51.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5432026-03-30T18:59:51.885ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5442026-03-30T18:59:51.887ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5452026-03-30T18:59:51.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5462026-03-30T18:59:51.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5472026-03-30T18:59:51.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5482026-03-30T18:59:51.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5492026-03-30T18:59:51.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5502026-03-30T18:59:51.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5512026-03-30T18:59:52.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5522026-03-30T18:59:52.885ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5532026-03-30T18:59:52.887ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5542026-03-30T18:59:52.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5552026-03-30T18:59:52.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5562026-03-30T18:59:52.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5572026-03-30T18:59:52.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5582026-03-30T18:59:52.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5592026-03-30T18:59:52.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5602026-03-30T18:59:53.886ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5612026-03-30T18:59:53.886ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5622026-03-30T18:59:53.889ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5632026-03-30T18:59:53.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5642026-03-30T18:59:53.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5652026-03-30T18:59:53.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5662026-03-30T18:59:53.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5672026-03-30T18:59:53.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5682026-03-30T18:59:53.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5692026-03-30T18:59:54.599ZDEBGoximeter (results-sink-cluster): inserting 385 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
5702026-03-30T18:59:54.601ZDEBGoximeter (results-sink): inserting 385 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
5712026-03-30T18:59:54.601ZDEBGoximeter (clickhouse-client): unrolling 385 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
5722026-03-30T18:59:54.620ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 284 table_name = fields_i16
5732026-03-30T18:59:54.622ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 843 table_name = fields_string
5742026-03-30T18:59:54.623ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 165 table_name = fields_u16
5752026-03-30T18:59:54.625ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 149 table_name = fields_u32
5762026-03-30T18:59:54.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 148 table_name = fields_u8
5772026-03-30T18:59:54.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 513 table_name = fields_uuid
5782026-03-30T18:59:54.629ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 6 table_name = measurements_bool
5792026-03-30T18:59:54.631ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 265 table_name = measurements_cumulativeu64
5802026-03-30T18:59:54.632ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 1 table_name = measurements_f64
5812026-03-30T18:59:54.634ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 23 table_name = measurements_histogramu64
5822026-03-30T18:59:54.635ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 90 table_name = measurements_u64
5832026-03-30T18:59:54.700ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5842026-03-30T18:59:54.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5852026-03-30T18:59:54.886ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5862026-03-30T18:59:54.888ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5872026-03-30T18:59:54.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5882026-03-30T18:59:54.897ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5892026-03-30T18:59:54.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5902026-03-30T18:59:54.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5912026-03-30T18:59:54.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5922026-03-30T18:59:54.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5932026-03-30T18:59:55.886ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5942026-03-30T18:59:55.886ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5952026-03-30T18:59:55.888ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5962026-03-30T18:59:55.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5972026-03-30T18:59:55.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5982026-03-30T18:59:55.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5992026-03-30T18:59:55.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6002026-03-30T18:59:55.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6012026-03-30T18:59:55.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6022026-03-30T18:59:56.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6032026-03-30T18:59:56.885ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6042026-03-30T18:59:56.888ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6052026-03-30T18:59:56.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6062026-03-30T18:59:56.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6072026-03-30T18:59:56.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6082026-03-30T18:59:56.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6092026-03-30T18:59:56.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6102026-03-30T18:59:56.914ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6112026-03-30T18:59:57.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6122026-03-30T18:59:57.885ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6132026-03-30T18:59:57.888ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6142026-03-30T18:59:57.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6152026-03-30T18:59:57.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6162026-03-30T18:59:57.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6172026-03-30T18:59:57.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6182026-03-30T18:59:57.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6192026-03-30T18:59:57.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6202026-03-30T18:59:58.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6212026-03-30T18:59:58.885ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6222026-03-30T18:59:58.887ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6232026-03-30T18:59:58.897ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6242026-03-30T18:59:58.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6252026-03-30T18:59:58.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6262026-03-30T18:59:58.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6272026-03-30T18:59:58.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6282026-03-30T18:59:58.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6292026-03-30T18:59:59.599ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
6302026-03-30T18:59:59.601ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d
6312026-03-30T18:59:59.601ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4
6322026-03-30T18:59:59.612ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 56 table_name = fields_string
6332026-03-30T18:59:59.614ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 64 table_name = fields_uuid
6342026-03-30T18:59:59.615ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 160 table_name = measurements_cumulativeu64
6352026-03-30T18:59:59.617ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d id = 4311f51d-0674-4af3-b2aa-e4844359f0f4 n_rows = 60 table_name = measurements_u64
6362026-03-30T18:59:59.700ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6372026-03-30T18:59:59.878ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
6382026-03-30T18:59:59.878ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending
6392026-03-30T18:59:59.882ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "c441fc6e-1137-4b6d-be66-00c6fa14fe58", "content-length": "1122", "date": "Mon, 30 Mar 2026 18:59:59 GMT"} })
6402026-03-30T18:59:59.882ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZTM4YjllZS0zZDAzLTRkM2EtYmZiMC1mZmNmZmVlZjM5MDAifX0%3D
6412026-03-30T18:59:59.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6422026-03-30T18:59:59.885ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6432026-03-30T18:59:59.885ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/038d1c9a-a224-42ea-818f-d814a0a794b1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZTM4YjllZS0zZDAzLTRkM2EtYmZiMC1mZmNmZmVlZjM5MDAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "918624b2-80bd-4aff-aacf-fcfc4875c383", "content-length": "29", "date": "Mon, 30 Mar 2026 18:59:59 GMT"} })
6442026-03-30T18:59:59.885ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:36421 collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 7b8da61f-8fb9-43ff-8a6c-db3972795c40
6452026-03-30T18:59:59.885ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:56196 collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = fe38b9ee-3d03-4d3a-bfb0-ffcffeef3900
6462026-03-30T18:59:59.885ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 7 n_pruned_tasks = 0
6472026-03-30T18:59:59.886ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 7b8da61f-8fb9-43ff-8a6c-db3972795c40 producer_ip = fd00:1122:3344:101::a producer_port = 36421
6482026-03-30T18:59:59.886ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = fe38b9ee-3d03-4d3a-bfb0-ffcffeef3900 producer_ip = fd00:1122:3344:101::b producer_port = 56196
6492026-03-30T18:59:59.886ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = fe38b9ee-3d03-4d3a-bfb0-ffcffeef3900 producer_ip = fd00:1122:3344:101::b producer_port = 56196
6502026-03-30T18:59:59.886ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = fe38b9ee-3d03-4d3a-bfb0-ffcffeef3900 producer_ip = fd00:1122:3344:101::b producer_port = 56196
6512026-03-30T18:59:59.886ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 7b8da61f-8fb9-43ff-8a6c-db3972795c40 producer_ip = fd00:1122:3344:101::a producer_port = 36421
6522026-03-30T18:59:59.886ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 7b8da61f-8fb9-43ff-8a6c-db3972795c40 producer_ip = fd00:1122:3344:101::a producer_port = 36421
6532026-03-30T18:59:59.887ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6542026-03-30T18:59:59.898ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6552026-03-30T18:59:59.898ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
6562026-03-30T18:59:59.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6572026-03-30T18:59:59.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6582026-03-30T18:59:59.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
6592026-03-30T18:59:59.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
6602026-03-30T18:59:59.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = fe38b9ee-3d03-4d3a-bfb0-ffcffeef3900 producer_ip = fd00:1122:3344:101::b producer_port = 56196
6612026-03-30T18:59:59.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6622026-03-30T18:59:59.900ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 7b8da61f-8fb9-43ff-8a6c-db3972795c40 producer_ip = fd00:1122:3344:101::a producer_port = 36421
6632026-03-30T18:59:59.901ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 035003f9-d094-47a3-b7df-985d79a6efaa producer_ip = fd00:1122:3344:101::c producer_port = 61693
6642026-03-30T18:59:59.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
6652026-03-30T18:59:59.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
6662026-03-30T18:59:59.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6672026-03-30T18:59:59.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6682026-03-30T18:59:59.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6692026-03-30T18:59:59.924ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b9fb56e4-6b2f-41f2-a966-ad41326e2f4f producer_ip = fd00:1122:3344:101::2 producer_port = 46861
6702026-03-30T19:00:00.885ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6712026-03-30T19:00:00.885ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6722026-03-30T19:00:00.887ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6732026-03-30T19:00:00.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6742026-03-30T19:00:00.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6752026-03-30T19:00:00.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6762026-03-30T19:00:00.913ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6772026-03-30T19:00:00.913ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6782026-03-30T19:00:00.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6792026-03-30T19:00:01.886ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6802026-03-30T19:00:01.886ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6812026-03-30T19:00:01.889ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b974dd5f-0a39-4477-a411-6310d6dae215 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6822026-03-30T19:00:01.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6832026-03-30T19:00:01.898ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6842026-03-30T19:00:01.899ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 74f7f1f2-b416-459d-b313-a91bbc8b7985 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6852026-03-30T19:00:01.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6862026-03-30T19:00:01.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6872026-03-30T19:00:01.913ZDEBGoximeter (collection-task): collected results from producer collector_id = 038d1c9a-a224-42ea-818f-d814a0a794b1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b05ed285-017e-4509-a825-b6fe81bde561 producer_ip = fd00:1122:3344:101::2 producer_port = 4677