Max level shown:
1 [ Mar 9 20:28:32 Enabled. ]
2 [ Mar 9 20:28:32 Rereading configuration. ]
3 [ Mar 9 20:28:33 Rereading configuration. ]
4 [ Mar 9 20:28:38 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id d7637dbd-31a8-482c-8424-2db54584b44c &"). ]
5 [ Mar 9 20:28:38 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-03-09T20:28:39.040ZDEBGoximeter: registered DTrace probes
82026-03-09T20:28:39.071ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:264
92026-03-09T20:28:39.078ZDEBGoximeter: creating ClickHouse client
102026-03-09T20:28:39.150ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
112026-03-09T20:28:51.164ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
122026-03-09T20:28:51.165ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
132026-03-09T20:28:51.165ZINFOoximeter (clickhouse-client): reading db version collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
142026-03-09T20:28:51.166ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
152026-03-09T20:28:51.166ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:805 id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 version = 0
162026-03-09T20:28:51.166ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:810 id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
172026-03-09T20:28:51.166ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
182026-03-09T20:28:51.869ZINFOoximeter (clickhouse-client): inserting current version collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:831 id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 version = 14
192026-03-09T20:28:51.910ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 2a7a75f4-cb9c-4897-bcdb-ae2dca7c0f9b
202026-03-09T20:28:51.938ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-03-09T20:28:51.938ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-03-09T20:28:51.938ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-03-09T20:28:51.938ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-03-09T20:28:51.938ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252026-03-09T20:28:51.955ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-03-09T20:28:51.955ZDEBGoximeter: registered USDT probes
272026-03-09T20:28:51.955ZDEBGoximeter: contacting nexus
282026-03-09T20:28:52.045ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
292026-03-09T20:28:52.180ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "963b622b-0f90-4fa9-b341-facbae1b7ab2", "date": "Mon, 09 Mar 2026 20:28:52 GMT"} })
302026-03-09T20:28:52.180ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:427 id = d7637dbd-31a8-482c-8424-2db54584b44c
312026-03-09T20:28:52.180ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:554
322026-03-09T20:28:52.181ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
332026-03-09T20:28:52.183ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?sort_by=id_ascending
342026-03-09T20:28:52.337ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "6923873d-1a29-4d46-96ef-e354214ae7b3", "content-length": "29", "date": "Mon, 09 Mar 2026 20:28:52 GMT"} })
352026-03-09T20:28:52.337ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
362026-03-09T20:29:07.181ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
372026-03-09T20:29:07.181ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?sort_by=id_ascending
382026-03-09T20:29:07.193ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c9e95fb-2781-4988-ab71-c81de7bfbfd5", "content-length": "577", "date": "Mon, 09 Mar 2026 20:29:07 GMT"} })
392026-03-09T20:29:07.195ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMWUwYTQzZC1kMzk1LTRhZGEtOWRhYi00ZjkxODViZTExZDAifX0%3D
402026-03-09T20:29:07.205ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMWUwYTQzZC1kMzk1LTRhZGEtOWRhYi00ZjkxODViZTExZDAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "40f58d91-c8b0-4cbc-b23d-02828548a5a1", "content-length": "29", "date": "Mon, 09 Mar 2026 20:29:07 GMT"} })
412026-03-09T20:29:07.205ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243
422026-03-09T20:29:07.205ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:56138 collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 92a8e96b-b739-480f-ad02-9264e74056d1
432026-03-09T20:29:07.205ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:35485 collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0
442026-03-09T20:29:07.205ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 3 n_pruned_tasks = 0
452026-03-09T20:29:07.206ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
462026-03-09T20:29:07.206ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 92a8e96b-b739-480f-ad02-9264e74056d1 producer_ip = fd00:1122:3344:101::1 producer_port = 56138
472026-03-09T20:29:07.206ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
482026-03-09T20:29:07.244ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
492026-03-09T20:29:07.244ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 92a8e96b-b739-480f-ad02-9264e74056d1 producer_ip = fd00:1122:3344:101::1 producer_port = 56138
502026-03-09T20:29:07.244ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
512026-03-09T20:29:07.244ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
522026-03-09T20:29:07.244ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
532026-03-09T20:29:07.244ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 92a8e96b-b739-480f-ad02-9264e74056d1 producer_ip = fd00:1122:3344:101::1 producer_port = 56138
542026-03-09T20:29:07.249ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
552026-03-09T20:29:07.271ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
562026-03-09T20:29:07.356ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 92a8e96b-b739-480f-ad02-9264e74056d1 producer_ip = fd00:1122:3344:101::1 producer_port = 56138
572026-03-09T20:29:07.366ZDEBGoximeter (results-sink-cluster): inserting 2314 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
582026-03-09T20:29:07.367ZDEBGoximeter (results-sink): inserting 2314 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
592026-03-09T20:29:07.367ZDEBGoximeter (clickhouse-client): unrolling 2314 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
602026-03-09T20:29:07.367ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
612026-03-09T20:29:07.378ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.367183153Z } timeseries_name = oximeter_collector:collections
622026-03-09T20:29:07.383ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
632026-03-09T20:29:07.390ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.383631910Z } timeseries_name = ddm_router:originated_underlay_prefixes
642026-03-09T20:29:07.390ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
652026-03-09T20:29:07.391ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.390964025Z } timeseries_name = ddm_router:originated_tunnel_endpoints
662026-03-09T20:29:07.392ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
672026-03-09T20:29:07.392ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.392013721Z } timeseries_name = ddm_session:solicitations_sent
682026-03-09T20:29:07.392ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
692026-03-09T20:29:07.393ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.392946527Z } timeseries_name = ddm_session:solicitations_received
702026-03-09T20:29:07.393ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
712026-03-09T20:29:07.394ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.393957047Z } timeseries_name = ddm_session:advertisements_sent
722026-03-09T20:29:07.394ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
732026-03-09T20:29:07.395ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.394893429Z } timeseries_name = ddm_session:advertisements_received
742026-03-09T20:29:07.395ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
752026-03-09T20:29:07.396ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.395798839Z } timeseries_name = ddm_session:peer_expirations
762026-03-09T20:29:07.396ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
772026-03-09T20:29:07.397ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.396745972Z } timeseries_name = ddm_session:peer_address_changes
782026-03-09T20:29:07.397ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
792026-03-09T20:29:07.398ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.397705855Z } timeseries_name = ddm_session:peer_sessions_established
802026-03-09T20:29:07.398ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
812026-03-09T20:29:07.399ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.398610843Z } timeseries_name = ddm_session:updates_sent
822026-03-09T20:29:07.399ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
832026-03-09T20:29:07.400ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.399545338Z } timeseries_name = ddm_session:updates_received
842026-03-09T20:29:07.400ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
852026-03-09T20:29:07.401ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.400480500Z } timeseries_name = ddm_session:update_send_fail
862026-03-09T20:29:07.401ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
872026-03-09T20:29:07.402ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.401411302Z } timeseries_name = ddm_session:imported_underlay_prefixes
882026-03-09T20:29:07.402ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
892026-03-09T20:29:07.403ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.402338634Z } timeseries_name = ddm_session:imported_tunnel_endpoints
902026-03-09T20:29:07.403ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
912026-03-09T20:29:07.404ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.403747682Z } timeseries_name = switch_port_control_data_link:errors_received
922026-03-09T20:29:07.404ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
932026-03-09T20:29:07.405ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.404789467Z } timeseries_name = switch_port_control_data_link:errors_sent
942026-03-09T20:29:07.405ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
952026-03-09T20:29:07.406ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.405903774Z } timeseries_name = switch_port_control_data_link:bytes_received
962026-03-09T20:29:07.407ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
972026-03-09T20:29:07.407ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.407005463Z } timeseries_name = switch_port_control_data_link:packets_received
982026-03-09T20:29:07.408ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
992026-03-09T20:29:07.408ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.408041668Z } timeseries_name = switch_port_control_data_link:bytes_sent
1002026-03-09T20:29:07.409ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1012026-03-09T20:29:07.410ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.409066532Z } timeseries_name = switch_port_control_data_link:packets_sent
1022026-03-09T20:29:07.418ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1032026-03-09T20:29:07.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.418550327Z } timeseries_name = sled_data_link:errors_received
1042026-03-09T20:29:07.419ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1052026-03-09T20:29:07.420ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.419754558Z } timeseries_name = sled_data_link:errors_sent
1062026-03-09T20:29:07.420ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1072026-03-09T20:29:07.421ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.420802694Z } timeseries_name = sled_data_link:bytes_received
1082026-03-09T20:29:07.421ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1092026-03-09T20:29:07.422ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.421812485Z } timeseries_name = sled_data_link:packets_received
1102026-03-09T20:29:07.422ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1112026-03-09T20:29:07.423ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.422857064Z } timeseries_name = sled_data_link:bytes_sent
1122026-03-09T20:29:07.423ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1132026-03-09T20:29:07.424ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.423942931Z } timeseries_name = sled_data_link:packets_sent
1142026-03-09T20:29:07.457ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1152026-03-09T20:29:07.458ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.457640042Z } timeseries_name = sled_cpu:cpu_nsec
1162026-03-09T20:29:07.469ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1172026-03-09T20:29:07.512ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1182026-03-09T20:29:07.513ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "target_id", field_type: U64, source: Metric, description: "" }, FieldSchema { name: "target_name", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.512335239Z } timeseries_name = kstat_sampler:samples_dropped
1192026-03-09T20:29:07.514ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1202026-03-09T20:29:07.515ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:07.514387369Z } timeseries_name = http_service:request_latency_histogram
1212026-03-09T20:29:07.515ZDEBGoximeter (clickhouse-client): inserting 30 new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1222026-03-09T20:29:07.522ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 24 table_name = fields_i16
1232026-03-09T20:29:07.524ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 6 table_name = fields_ipaddr
1242026-03-09T20:29:07.527ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 2015 table_name = fields_string
1252026-03-09T20:29:07.529ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 20 table_name = fields_u16
1262026-03-09T20:29:07.531ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 732 table_name = fields_u32
1272026-03-09T20:29:07.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 1 table_name = fields_u64
1282026-03-09T20:29:07.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 12 table_name = fields_u8
1292026-03-09T20:29:07.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 1008 table_name = fields_uuid
1302026-03-09T20:29:07.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 2306 table_name = measurements_cumulativeu64
1312026-03-09T20:29:07.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 2 table_name = measurements_histogramu64
1322026-03-09T20:29:07.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 6 table_name = measurements_u64
1332026-03-09T20:29:08.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1342026-03-09T20:29:08.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1352026-03-09T20:29:08.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1362026-03-09T20:29:09.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1372026-03-09T20:29:09.207ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1382026-03-09T20:29:09.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1392026-03-09T20:29:10.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1402026-03-09T20:29:10.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1412026-03-09T20:29:10.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1422026-03-09T20:29:11.207ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1432026-03-09T20:29:11.207ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1442026-03-09T20:29:11.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1452026-03-09T20:29:11.911ZDEBGoximeter (results-sink): inserting 104 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
1462026-03-09T20:29:11.911ZDEBGoximeter (results-sink-cluster): inserting 104 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
1472026-03-09T20:29:11.911ZDEBGoximeter (clickhouse-client): unrolling 104 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1482026-03-09T20:29:11.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 26 table_name = fields_string
1492026-03-09T20:29:11.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 28 table_name = fields_uuid
1502026-03-09T20:29:11.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 80 table_name = measurements_cumulativeu64
1512026-03-09T20:29:11.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 24 table_name = measurements_u64
1522026-03-09T20:29:12.012ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1532026-03-09T20:29:12.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1542026-03-09T20:29:12.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1552026-03-09T20:29:12.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1562026-03-09T20:29:13.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1572026-03-09T20:29:13.207ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1582026-03-09T20:29:13.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1592026-03-09T20:29:14.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1602026-03-09T20:29:14.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1612026-03-09T20:29:14.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1622026-03-09T20:29:15.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1632026-03-09T20:29:15.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1642026-03-09T20:29:15.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1652026-03-09T20:29:16.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1662026-03-09T20:29:16.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1672026-03-09T20:29:16.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1682026-03-09T20:29:16.911ZDEBGoximeter (results-sink): inserting 130 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
1692026-03-09T20:29:16.911ZDEBGoximeter (results-sink-cluster): inserting 130 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
1702026-03-09T20:29:16.911ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1712026-03-09T20:29:16.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 26 table_name = fields_string
1722026-03-09T20:29:16.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 28 table_name = fields_uuid
1732026-03-09T20:29:16.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 100 table_name = measurements_cumulativeu64
1742026-03-09T20:29:16.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 30 table_name = measurements_u64
1752026-03-09T20:29:17.013ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1762026-03-09T20:29:17.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1772026-03-09T20:29:17.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1782026-03-09T20:29:17.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1792026-03-09T20:29:18.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-03-09T20:29:18.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-03-09T20:29:18.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1822026-03-09T20:29:19.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1832026-03-09T20:29:19.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1842026-03-09T20:29:19.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1852026-03-09T20:29:20.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-03-09T20:29:20.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-03-09T20:29:20.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882026-03-09T20:29:21.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-03-09T20:29:21.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1902026-03-09T20:29:21.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1912026-03-09T20:29:21.911ZDEBGoximeter (results-sink): inserting 130 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
1922026-03-09T20:29:21.911ZDEBGoximeter (results-sink-cluster): inserting 130 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
1932026-03-09T20:29:21.911ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
1942026-03-09T20:29:21.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 26 table_name = fields_string
1952026-03-09T20:29:21.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 28 table_name = fields_uuid
1962026-03-09T20:29:21.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 100 table_name = measurements_cumulativeu64
1972026-03-09T20:29:21.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 30 table_name = measurements_u64
1982026-03-09T20:29:22.012ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1992026-03-09T20:29:22.181ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
2002026-03-09T20:29:22.181ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?sort_by=id_ascending
2012026-03-09T20:29:22.184ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d3ab69c-294c-422e-8647-412604d33064", "content-length": "713", "date": "Mon, 09 Mar 2026 20:29:22 GMT"} })
2022026-03-09T20:29:22.184ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMWUwYTQzZC1kMzk1LTRhZGEtOWRhYi00ZjkxODViZTExZDAifX0%3D
2032026-03-09T20:29:22.187ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMWUwYTQzZC1kMzk1LTRhZGEtOWRhYi00ZjkxODViZTExZDAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c7c2af6-f675-447f-ac5f-d4f8aff7f364", "content-length": "29", "date": "Mon, 09 Mar 2026 20:29:22 GMT"} })
2042026-03-09T20:29:22.187ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05
2052026-03-09T20:29:22.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2062026-03-09T20:29:22.188ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2072026-03-09T20:29:22.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2082026-03-09T20:29:22.190ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:32980 collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0
2092026-03-09T20:29:22.190ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
2102026-03-09T20:29:22.190ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 4 n_pruned_tasks = 0
2112026-03-09T20:29:22.190ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:32980 collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
2122026-03-09T20:29:22.191ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
2132026-03-09T20:29:22.191ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
2142026-03-09T20:29:22.200ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2152026-03-09T20:29:22.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2162026-03-09T20:29:22.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2172026-03-09T20:29:22.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2182026-03-09T20:29:22.216ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
2192026-03-09T20:29:23.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2202026-03-09T20:29:23.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2212026-03-09T20:29:23.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2222026-03-09T20:29:23.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2232026-03-09T20:29:23.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2242026-03-09T20:29:23.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2252026-03-09T20:29:24.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2262026-03-09T20:29:24.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2272026-03-09T20:29:24.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2282026-03-09T20:29:24.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2292026-03-09T20:29:24.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2302026-03-09T20:29:24.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2312026-03-09T20:29:25.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2322026-03-09T20:29:25.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2332026-03-09T20:29:25.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2342026-03-09T20:29:25.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2352026-03-09T20:29:25.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-03-09T20:29:25.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2372026-03-09T20:29:26.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2382026-03-09T20:29:26.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2392026-03-09T20:29:26.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2402026-03-09T20:29:26.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2412026-03-09T20:29:26.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2422026-03-09T20:29:26.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2432026-03-09T20:29:26.910ZDEBGoximeter (results-sink): inserting 343 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
2442026-03-09T20:29:26.910ZDEBGoximeter (results-sink-cluster): inserting 343 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
2452026-03-09T20:29:26.910ZDEBGoximeter (clickhouse-client): unrolling 343 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2462026-03-09T20:29:26.913ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2472026-03-09T20:29:26.943ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.913377530Z } timeseries_name = switch_data_link:link_enabled
2482026-03-09T20:29:26.943ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2492026-03-09T20:29:26.945ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.943233009Z } timeseries_name = switch_data_link:link_up
2502026-03-09T20:29:26.946ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2512026-03-09T20:29:26.949ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.946331265Z } timeseries_name = switch_table:capacity
2522026-03-09T20:29:26.949ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2532026-03-09T20:29:26.952ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.949769523Z } timeseries_name = switch_table:occupancy
2542026-03-09T20:29:26.952ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2552026-03-09T20:29:26.955ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.952674832Z } timeseries_name = switch_table:inserts
2562026-03-09T20:29:26.955ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2572026-03-09T20:29:26.957ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.955634423Z } timeseries_name = switch_table:deletes
2582026-03-09T20:29:26.958ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2592026-03-09T20:29:26.959ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.958097597Z } timeseries_name = switch_table:updates
2602026-03-09T20:29:26.960ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2612026-03-09T20:29:26.961ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.960058494Z } timeseries_name = switch_table:collisions
2622026-03-09T20:29:26.961ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2632026-03-09T20:29:26.963ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.961769573Z } timeseries_name = switch_table:update_misses
2642026-03-09T20:29:26.963ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2652026-03-09T20:29:26.965ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.963635346Z } timeseries_name = switch_table:delete_misses
2662026-03-09T20:29:26.965ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2672026-03-09T20:29:26.967ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.965618634Z } timeseries_name = switch_table:exhaustion
2682026-03-09T20:29:26.976ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2692026-03-09T20:29:26.979ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:26.976808956Z } timeseries_name = dendrite:sample_collection_duration
2702026-03-09T20:29:26.986ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
2712026-03-09T20:29:26.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 284 table_name = fields_i16
2722026-03-09T20:29:26.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 2 table_name = fields_ipaddr
2732026-03-09T20:29:26.997ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 794 table_name = fields_string
2742026-03-09T20:29:27.001ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 144 table_name = fields_u16
2752026-03-09T20:29:27.003ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 149 table_name = fields_u32
2762026-03-09T20:29:27.006ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 148 table_name = fields_u8
2772026-03-09T20:29:27.009ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 484 table_name = fields_uuid
2782026-03-09T20:29:27.011ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2792026-03-09T20:29:27.011ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 6 table_name = measurements_bool
2802026-03-09T20:29:27.014ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 256 table_name = measurements_cumulativeu64
2812026-03-09T20:29:27.015ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 1 table_name = measurements_f64
2822026-03-09T20:29:27.017ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 80 table_name = measurements_u64
2832026-03-09T20:29:27.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2842026-03-09T20:29:27.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2852026-03-09T20:29:27.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2862026-03-09T20:29:27.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2872026-03-09T20:29:27.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2882026-03-09T20:29:27.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2892026-03-09T20:29:28.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2902026-03-09T20:29:28.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2912026-03-09T20:29:28.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2922026-03-09T20:29:28.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2932026-03-09T20:29:28.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2942026-03-09T20:29:28.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2952026-03-09T20:29:29.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2962026-03-09T20:29:29.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2972026-03-09T20:29:29.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2982026-03-09T20:29:29.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2992026-03-09T20:29:29.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3002026-03-09T20:29:29.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3012026-03-09T20:29:30.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3022026-03-09T20:29:30.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3032026-03-09T20:29:30.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3042026-03-09T20:29:30.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3052026-03-09T20:29:30.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3062026-03-09T20:29:30.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3072026-03-09T20:29:31.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3082026-03-09T20:29:31.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3092026-03-09T20:29:31.191ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3102026-03-09T20:29:31.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-03-09T20:29:31.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-03-09T20:29:31.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3132026-03-09T20:29:31.911ZDEBGoximeter (results-sink-cluster): inserting 200 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
3142026-03-09T20:29:31.911ZDEBGoximeter (results-sink): inserting 200 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
3152026-03-09T20:29:31.911ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
3162026-03-09T20:29:31.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 52 table_name = fields_string
3172026-03-09T20:29:31.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 56 table_name = fields_uuid
3182026-03-09T20:29:31.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 150 table_name = measurements_cumulativeu64
3192026-03-09T20:29:31.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 50 table_name = measurements_u64
3202026-03-09T20:29:32.013ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3212026-03-09T20:29:32.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3222026-03-09T20:29:32.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3232026-03-09T20:29:32.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3242026-03-09T20:29:32.190ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
3252026-03-09T20:29:32.190ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
3262026-03-09T20:29:32.203ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
3272026-03-09T20:29:32.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3282026-03-09T20:29:32.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3292026-03-09T20:29:32.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3302026-03-09T20:29:33.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3312026-03-09T20:29:33.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3322026-03-09T20:29:33.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3332026-03-09T20:29:33.205ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3342026-03-09T20:29:33.205ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3352026-03-09T20:29:33.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3362026-03-09T20:29:34.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3372026-03-09T20:29:34.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3382026-03-09T20:29:34.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3392026-03-09T20:29:34.205ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3402026-03-09T20:29:34.205ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3412026-03-09T20:29:34.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3422026-03-09T20:29:35.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3432026-03-09T20:29:35.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3442026-03-09T20:29:35.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3452026-03-09T20:29:35.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3462026-03-09T20:29:35.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3472026-03-09T20:29:35.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3482026-03-09T20:29:36.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3492026-03-09T20:29:36.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3502026-03-09T20:29:36.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3512026-03-09T20:29:36.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3522026-03-09T20:29:36.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3532026-03-09T20:29:36.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3542026-03-09T20:29:36.911ZDEBGoximeter (results-sink): inserting 342 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
3552026-03-09T20:29:36.911ZDEBGoximeter (results-sink-cluster): inserting 342 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
3562026-03-09T20:29:36.911ZDEBGoximeter (clickhouse-client): unrolling 342 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
3572026-03-09T20:29:36.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 284 table_name = fields_i16
3582026-03-09T20:29:36.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 793 table_name = fields_string
3592026-03-09T20:29:36.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 142 table_name = fields_u16
3602026-03-09T20:29:36.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 149 table_name = fields_u32
3612026-03-09T20:29:36.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 148 table_name = fields_u8
3622026-03-09T20:29:36.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 482 table_name = fields_uuid
3632026-03-09T20:29:36.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 6 table_name = measurements_bool
3642026-03-09T20:29:36.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 255 table_name = measurements_cumulativeu64
3652026-03-09T20:29:36.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 1 table_name = measurements_f64
3662026-03-09T20:29:36.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 80 table_name = measurements_u64
3672026-03-09T20:29:37.012ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3682026-03-09T20:29:37.181ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
3692026-03-09T20:29:37.181ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?sort_by=id_ascending
3702026-03-09T20:29:37.184ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "a43345dc-64d6-4407-b571-9945e76a3ea5", "content-length": "998", "date": "Mon, 09 Mar 2026 20:29:37 GMT"} })
3712026-03-09T20:29:37.184ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMWUwYTQzZC1kMzk1LTRhZGEtOWRhYi00ZjkxODViZTExZDAifX0%3D
3722026-03-09T20:29:37.186ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMWUwYTQzZC1kMzk1LTRhZGEtOWRhYi00ZjkxODViZTExZDAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "37ef637d-53d9-43c8-997b-45664e7c1149", "content-length": "29", "date": "Mon, 09 Mar 2026 20:29:37 GMT"} })
3732026-03-09T20:29:37.186ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:60302 collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 9d563439-ed64-4365-b528-b09496f3da81
3742026-03-09T20:29:37.186ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762
3752026-03-09T20:29:37.186ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 6 n_pruned_tasks = 0
3762026-03-09T20:29:37.187ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3772026-03-09T20:29:37.187ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 9d563439-ed64-4365-b528-b09496f3da81 producer_ip = fd00:1122:3344:101::2 producer_port = 60302
3782026-03-09T20:29:37.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 9d563439-ed64-4365-b528-b09496f3da81 producer_ip = fd00:1122:3344:101::2 producer_port = 60302
3792026-03-09T20:29:37.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 9d563439-ed64-4365-b528-b09496f3da81 producer_ip = fd00:1122:3344:101::2 producer_port = 60302
3802026-03-09T20:29:37.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3812026-03-09T20:29:37.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3822026-03-09T20:29:37.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3832026-03-09T20:29:37.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3842026-03-09T20:29:37.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3852026-03-09T20:29:37.199ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 9d563439-ed64-4365-b528-b09496f3da81 producer_ip = fd00:1122:3344:101::2 producer_port = 60302
3862026-03-09T20:29:37.199ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3872026-03-09T20:29:37.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 92a8e96b-b739-480f-ad02-9264e74056d1 producer_ip = fd00:1122:3344:101::1 producer_port = 56138
3882026-03-09T20:29:37.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 92a8e96b-b739-480f-ad02-9264e74056d1 producer_ip = fd00:1122:3344:101::1 producer_port = 56138
3892026-03-09T20:29:37.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3902026-03-09T20:29:37.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3912026-03-09T20:29:37.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3922026-03-09T20:29:37.255ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 92a8e96b-b739-480f-ad02-9264e74056d1 producer_ip = fd00:1122:3344:101::1 producer_port = 56138
3932026-03-09T20:29:37.258ZDEBGoximeter (results-sink): inserting 1243 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
3942026-03-09T20:29:37.258ZDEBGoximeter (clickhouse-client): unrolling 1243 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
3952026-03-09T20:29:37.259ZDEBGoximeter (results-sink-cluster): inserting 1243 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
3962026-03-09T20:29:37.260ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
3972026-03-09T20:29:37.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:37.260248376Z } timeseries_name = static_routing_config:static_routes
3982026-03-09T20:29:37.265ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
3992026-03-09T20:29:37.267ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:37.265508196Z } timeseries_name = static_routing_config:static_nexthops
4002026-03-09T20:29:37.267ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
4012026-03-09T20:29:37.269ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:37.267651039Z } timeseries_name = switch_rib:active_routes
4022026-03-09T20:29:37.270ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
4032026-03-09T20:29:37.272ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:37.270044180Z } timeseries_name = mg_lower:routes_blocked_by_link_state
4042026-03-09T20:29:37.320ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
4052026-03-09T20:29:37.324ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 4 table_name = fields_ipaddr
4062026-03-09T20:29:37.327ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 1944 table_name = fields_string
4072026-03-09T20:29:37.328ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 16 table_name = fields_u16
4082026-03-09T20:29:37.330ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 708 table_name = fields_u32
4092026-03-09T20:29:37.332ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 1 table_name = fields_u64
4102026-03-09T20:29:37.334ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 1016 table_name = fields_uuid
4112026-03-09T20:29:37.337ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 1219 table_name = measurements_cumulativeu64
4122026-03-09T20:29:37.341ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 12 table_name = measurements_histogramu64
4132026-03-09T20:29:37.343ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 12 table_name = measurements_u64
4142026-03-09T20:29:37.360ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4152026-03-09T20:29:38.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4162026-03-09T20:29:38.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4172026-03-09T20:29:38.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4182026-03-09T20:29:38.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4192026-03-09T20:29:38.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4202026-03-09T20:29:38.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4212026-03-09T20:29:38.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4222026-03-09T20:29:38.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4232026-03-09T20:29:38.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4242026-03-09T20:29:39.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4252026-03-09T20:29:39.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4262026-03-09T20:29:39.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4272026-03-09T20:29:39.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4282026-03-09T20:29:39.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4292026-03-09T20:29:39.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4302026-03-09T20:29:39.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4312026-03-09T20:29:39.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4322026-03-09T20:29:39.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4332026-03-09T20:29:40.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4342026-03-09T20:29:40.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4352026-03-09T20:29:40.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4362026-03-09T20:29:40.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4372026-03-09T20:29:40.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4382026-03-09T20:29:40.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4392026-03-09T20:29:40.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4402026-03-09T20:29:40.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4412026-03-09T20:29:40.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4422026-03-09T20:29:41.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4432026-03-09T20:29:41.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4442026-03-09T20:29:41.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4452026-03-09T20:29:41.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4462026-03-09T20:29:41.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4472026-03-09T20:29:41.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4482026-03-09T20:29:41.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4492026-03-09T20:29:41.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4502026-03-09T20:29:41.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4512026-03-09T20:29:41.911ZDEBGoximeter (results-sink): inserting 176 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
4522026-03-09T20:29:41.911ZDEBGoximeter (results-sink-cluster): inserting 176 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
4532026-03-09T20:29:41.911ZDEBGoximeter (clickhouse-client): unrolling 176 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
4542026-03-09T20:29:41.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 56 table_name = fields_string
4552026-03-09T20:29:41.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 64 table_name = fields_uuid
4562026-03-09T20:29:41.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 128 table_name = measurements_cumulativeu64
4572026-03-09T20:29:41.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 48 table_name = measurements_u64
4582026-03-09T20:29:42.012ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4592026-03-09T20:29:42.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4602026-03-09T20:29:42.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4612026-03-09T20:29:42.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4622026-03-09T20:29:42.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4632026-03-09T20:29:42.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4642026-03-09T20:29:42.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4652026-03-09T20:29:42.191ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
4662026-03-09T20:29:42.191ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
4672026-03-09T20:29:42.203ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
4682026-03-09T20:29:42.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4692026-03-09T20:29:42.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4702026-03-09T20:29:42.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4712026-03-09T20:29:43.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4722026-03-09T20:29:43.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4732026-03-09T20:29:43.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4742026-03-09T20:29:43.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4752026-03-09T20:29:43.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4762026-03-09T20:29:43.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4772026-03-09T20:29:43.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4782026-03-09T20:29:43.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4792026-03-09T20:29:43.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4802026-03-09T20:29:44.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4812026-03-09T20:29:44.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4822026-03-09T20:29:44.187ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4832026-03-09T20:29:44.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4842026-03-09T20:29:44.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4852026-03-09T20:29:44.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4862026-03-09T20:29:44.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4872026-03-09T20:29:44.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4882026-03-09T20:29:44.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4892026-03-09T20:29:45.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4902026-03-09T20:29:45.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4912026-03-09T20:29:45.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4922026-03-09T20:29:45.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4932026-03-09T20:29:45.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4942026-03-09T20:29:45.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4952026-03-09T20:29:45.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4962026-03-09T20:29:45.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4972026-03-09T20:29:45.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4982026-03-09T20:29:46.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4992026-03-09T20:29:46.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5002026-03-09T20:29:46.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5012026-03-09T20:29:46.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5022026-03-09T20:29:46.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5032026-03-09T20:29:46.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5042026-03-09T20:29:46.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5052026-03-09T20:29:46.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5062026-03-09T20:29:46.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5072026-03-09T20:29:46.911ZDEBGoximeter (results-sink): inserting 362 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
5082026-03-09T20:29:46.911ZDEBGoximeter (results-sink-cluster): inserting 362 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
5092026-03-09T20:29:46.911ZDEBGoximeter (clickhouse-client): unrolling 362 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
5102026-03-09T20:29:46.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 284 table_name = fields_i16
5112026-03-09T20:29:46.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 797 table_name = fields_string
5122026-03-09T20:29:46.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 142 table_name = fields_u16
5132026-03-09T20:29:46.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 149 table_name = fields_u32
5142026-03-09T20:29:46.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 148 table_name = fields_u8
5152026-03-09T20:29:46.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 490 table_name = fields_uuid
5162026-03-09T20:29:46.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 6 table_name = measurements_bool
5172026-03-09T20:29:46.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 265 table_name = measurements_cumulativeu64
5182026-03-09T20:29:46.950ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 1 table_name = measurements_f64
5192026-03-09T20:29:46.952ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 90 table_name = measurements_u64
5202026-03-09T20:29:47.012ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5212026-03-09T20:29:47.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 9d563439-ed64-4365-b528-b09496f3da81 producer_ip = fd00:1122:3344:101::2 producer_port = 60302
5222026-03-09T20:29:47.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 9d563439-ed64-4365-b528-b09496f3da81 producer_ip = fd00:1122:3344:101::2 producer_port = 60302
5232026-03-09T20:29:47.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5242026-03-09T20:29:47.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5252026-03-09T20:29:47.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5262026-03-09T20:29:47.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5272026-03-09T20:29:47.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5282026-03-09T20:29:47.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 9d563439-ed64-4365-b528-b09496f3da81 producer_ip = fd00:1122:3344:101::2 producer_port = 60302
5292026-03-09T20:29:47.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5302026-03-09T20:29:47.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5312026-03-09T20:29:47.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5322026-03-09T20:29:47.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5332026-03-09T20:29:48.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5342026-03-09T20:29:48.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5352026-03-09T20:29:48.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5362026-03-09T20:29:48.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5372026-03-09T20:29:48.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5382026-03-09T20:29:48.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5392026-03-09T20:29:48.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402026-03-09T20:29:48.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5412026-03-09T20:29:48.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5422026-03-09T20:29:49.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5432026-03-09T20:29:49.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5442026-03-09T20:29:49.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5452026-03-09T20:29:49.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5462026-03-09T20:29:49.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5472026-03-09T20:29:49.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5482026-03-09T20:29:49.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5492026-03-09T20:29:49.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5502026-03-09T20:29:49.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5512026-03-09T20:29:50.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5522026-03-09T20:29:50.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5532026-03-09T20:29:50.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5542026-03-09T20:29:50.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5552026-03-09T20:29:50.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5562026-03-09T20:29:50.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5572026-03-09T20:29:50.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5582026-03-09T20:29:50.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5592026-03-09T20:29:50.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5602026-03-09T20:29:51.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5612026-03-09T20:29:51.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5622026-03-09T20:29:51.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5632026-03-09T20:29:51.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5642026-03-09T20:29:51.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5652026-03-09T20:29:51.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5662026-03-09T20:29:51.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5672026-03-09T20:29:51.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5682026-03-09T20:29:51.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5692026-03-09T20:29:51.911ZDEBGoximeter (results-sink): inserting 230 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
5702026-03-09T20:29:51.911ZDEBGoximeter (results-sink-cluster): inserting 230 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
5712026-03-09T20:29:51.911ZDEBGoximeter (clickhouse-client): unrolling 230 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
5722026-03-09T20:29:51.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 76 table_name = fields_string
5732026-03-09T20:29:51.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 10 table_name = fields_u16
5742026-03-09T20:29:51.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 74 table_name = fields_uuid
5752026-03-09T20:29:51.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 160 table_name = measurements_cumulativeu64
5762026-03-09T20:29:51.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 10 table_name = measurements_histogramu64
5772026-03-09T20:29:51.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 60 table_name = measurements_u64
5782026-03-09T20:29:52.012ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5792026-03-09T20:29:52.181ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
5802026-03-09T20:29:52.181ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?sort_by=id_ascending
5812026-03-09T20:29:52.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5822026-03-09T20:29:52.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5832026-03-09T20:29:52.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5842026-03-09T20:29:52.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5852026-03-09T20:29:52.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5862026-03-09T20:29:52.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5872026-03-09T20:29:52.191ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
5882026-03-09T20:29:52.191ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
5892026-03-09T20:29:52.194ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a9ad154-d69c-4d3f-b7cc-10e050248fc6", "content-length": "1136", "date": "Mon, 09 Mar 2026 20:29:52 GMT"} })
5902026-03-09T20:29:52.194ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMWUwYTQzZC1kMzk1LTRhZGEtOWRhYi00ZjkxODViZTExZDAifX0%3D
5912026-03-09T20:29:52.197ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/d7637dbd-31a8-482c-8424-2db54584b44c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMWUwYTQzZC1kMzk1LTRhZGEtOWRhYi00ZjkxODViZTExZDAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "633ee5c3-3198-4027-ba31-a99299ee4e91", "content-length": "29", "date": "Mon, 09 Mar 2026 20:29:52 GMT"} })
5922026-03-09T20:29:52.197ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:61982 collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 1b8b498f-6e07-4c01-b6c9-b9a09df77d96
5932026-03-09T20:29:52.197ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 7 n_pruned_tasks = 0
5942026-03-09T20:29:52.198ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 1b8b498f-6e07-4c01-b6c9-b9a09df77d96 producer_ip = fd00:1122:3344:101::c producer_port = 61982
5952026-03-09T20:29:52.198ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 1b8b498f-6e07-4c01-b6c9-b9a09df77d96 producer_ip = fd00:1122:3344:101::c producer_port = 61982
5962026-03-09T20:29:52.198ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 1b8b498f-6e07-4c01-b6c9-b9a09df77d96 producer_ip = fd00:1122:3344:101::c producer_port = 61982
5972026-03-09T20:29:52.203ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f1e0a43d-d395-4ada-9dab-4f9185be11d0 producer_ip = fd00:1122:3344:101::2 producer_port = 35485
5982026-03-09T20:29:52.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5992026-03-09T20:29:52.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6002026-03-09T20:29:52.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6012026-03-09T20:29:52.211ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 1b8b498f-6e07-4c01-b6c9-b9a09df77d96 producer_ip = fd00:1122:3344:101::c producer_port = 61982
6022026-03-09T20:29:53.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6032026-03-09T20:29:53.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6042026-03-09T20:29:53.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6052026-03-09T20:29:53.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6062026-03-09T20:29:53.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6072026-03-09T20:29:53.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6082026-03-09T20:29:53.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6092026-03-09T20:29:53.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6102026-03-09T20:29:53.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6112026-03-09T20:29:54.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6122026-03-09T20:29:54.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6132026-03-09T20:29:54.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6142026-03-09T20:29:54.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6152026-03-09T20:29:54.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6162026-03-09T20:29:54.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6172026-03-09T20:29:54.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6182026-03-09T20:29:54.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6192026-03-09T20:29:54.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6202026-03-09T20:29:55.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6212026-03-09T20:29:55.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6222026-03-09T20:29:55.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6232026-03-09T20:29:55.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6242026-03-09T20:29:55.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6252026-03-09T20:29:55.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6262026-03-09T20:29:55.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6272026-03-09T20:29:55.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6282026-03-09T20:29:55.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6292026-03-09T20:29:56.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6302026-03-09T20:29:56.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6312026-03-09T20:29:56.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6322026-03-09T20:29:56.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6332026-03-09T20:29:56.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6342026-03-09T20:29:56.190ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6352026-03-09T20:29:56.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6362026-03-09T20:29:56.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6372026-03-09T20:29:56.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6382026-03-09T20:29:56.911ZDEBGoximeter (results-sink): inserting 368 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
6392026-03-09T20:29:56.912ZDEBGoximeter (results-sink-cluster): inserting 368 samples into database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d
6402026-03-09T20:29:56.912ZDEBGoximeter (clickhouse-client): unrolling 368 total samples collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
6412026-03-09T20:29:56.926ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
6422026-03-09T20:29:56.931ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:56.926778767Z } timeseries_name = collection_target:cpus_provisioned
6432026-03-09T20:29:56.932ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
6442026-03-09T20:29:56.935ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:56.932018156Z } timeseries_name = collection_target:ram_provisioned
6452026-03-09T20:29:56.935ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
6462026-03-09T20:29:56.940ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-09T20:29:56.935692751Z } timeseries_name = collection_target:virtual_disk_space_provisioned
6472026-03-09T20:29:56.949ZDEBGoximeter (clickhouse-client): inserting 3 new timeseries schema collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4
6482026-03-09T20:29:56.959ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 284 table_name = fields_i16
6492026-03-09T20:29:56.962ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 2 table_name = fields_ipaddr
6502026-03-09T20:29:56.965ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 802 table_name = fields_string
6512026-03-09T20:29:56.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 146 table_name = fields_u16
6522026-03-09T20:29:56.970ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 149 table_name = fields_u32
6532026-03-09T20:29:56.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 148 table_name = fields_u8
6542026-03-09T20:29:56.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 497 table_name = fields_uuid
6552026-03-09T20:29:56.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 6 table_name = measurements_bool
6562026-03-09T20:29:56.984ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 266 table_name = measurements_cumulativeu64
6572026-03-09T20:29:56.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 1 table_name = measurements_f64
6582026-03-09T20:29:56.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 2 table_name = measurements_histogramu64
6592026-03-09T20:29:56.998ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 3 table_name = measurements_i64
6602026-03-09T20:29:57.002ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d id = 0d3afd57-55bf-4d31-bc75-8f857e7cbaf4 n_rows = 90 table_name = measurements_u64
6612026-03-09T20:29:57.012ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6622026-03-09T20:29:57.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 9d563439-ed64-4365-b528-b09496f3da81 producer_ip = fd00:1122:3344:101::2 producer_port = 60302
6632026-03-09T20:29:57.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6642026-03-09T20:29:57.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6652026-03-09T20:29:57.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 9d563439-ed64-4365-b528-b09496f3da81 producer_ip = fd00:1122:3344:101::2 producer_port = 60302
6662026-03-09T20:29:57.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6672026-03-09T20:29:57.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6682026-03-09T20:29:57.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6692026-03-09T20:29:57.191ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 9d563439-ed64-4365-b528-b09496f3da81 producer_ip = fd00:1122:3344:101::2 producer_port = 60302
6702026-03-09T20:29:57.191ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6712026-03-09T20:29:57.207ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6722026-03-09T20:29:57.207ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6732026-03-09T20:29:57.211ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6742026-03-09T20:29:58.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6752026-03-09T20:29:58.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6762026-03-09T20:29:58.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6772026-03-09T20:29:58.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6782026-03-09T20:29:58.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6792026-03-09T20:29:58.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6802026-03-09T20:29:58.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6812026-03-09T20:29:58.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6822026-03-09T20:29:58.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6832026-03-09T20:29:59.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6842026-03-09T20:29:59.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6852026-03-09T20:29:59.188ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6862026-03-09T20:29:59.188ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6872026-03-09T20:29:59.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6882026-03-09T20:29:59.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6892026-03-09T20:29:59.205ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6902026-03-09T20:29:59.205ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6912026-03-09T20:29:59.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6922026-03-09T20:30:00.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6932026-03-09T20:30:00.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6942026-03-09T20:30:00.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6952026-03-09T20:30:00.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6962026-03-09T20:30:00.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6972026-03-09T20:30:00.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6982026-03-09T20:30:00.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6992026-03-09T20:30:00.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7002026-03-09T20:30:00.208ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7012026-03-09T20:30:01.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7022026-03-09T20:30:01.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7032026-03-09T20:30:01.187ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7042026-03-09T20:30:01.187ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7052026-03-09T20:30:01.188ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b64fcbe0-dc0a-43a4-9a0c-411e9437e762 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7062026-03-09T20:30:01.189ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 83f12404-bee5-40b3-9038-89778db46b05 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7072026-03-09T20:30:01.206ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7082026-03-09T20:30:01.206ZDEBGoximeter (collection-task): collecting from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7092026-03-09T20:30:01.209ZDEBGoximeter (collection-task): collected results from producer collector_id = d7637dbd-31a8-482c-8424-2db54584b44c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 883ce312-1898-471f-bc82-446a17f45243 producer_ip = fd00:1122:3344:101::1 producer_port = 8001