Max level shown:
1 [ Oct 27 05:27:36 Enabled. ]
2 [ Oct 27 05:27:36 Rereading configuration. ]
3 [ Oct 27 05:27:37 Rereading configuration. ]
4 [ Oct 27 05:27:40 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id a495983a-a4d3-4e95-a00a-6c98497122fa &"). ]
5 [ Oct 27 05:27:40 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-10-27T05:27:40.615ZDEBGoximeter: registered DTrace probes
82026-10-27T05:27:40.616ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:289
92026-10-27T05:27:40.616ZDEBGoximeter: creating ClickHouse client
102026-10-27T05:27:40.623ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = 98c847fa-7302-4a04-8f5f-58cbe08575d4
112026-10-27T05:27:57.602ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = 98c847fa-7302-4a04-8f5f-58cbe08575d4
122026-10-27T05:27:57.602ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
132026-10-27T05:27:57.604ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:341 retry_after = 236.720545ms
142026-10-27T05:27:57.841ZDEBGoximeter: creating ClickHouse client
152026-10-27T05:27:57.841ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = a8d4d9fa-45a2-442b-ab6f-653df70c88c2
162026-10-27T05:27:57.845ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = a8d4d9fa-45a2-442b-ab6f-653df70c88c2
172026-10-27T05:27:57.845ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
182026-10-27T05:27:57.845ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:341 retry_after = 657.55435ms
192026-10-27T05:27:58.504ZDEBGoximeter: creating ClickHouse client
202026-10-27T05:27:58.504ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = 70725b6d-bdae-4161-9900-7cc551bcb495
212026-10-27T05:27:58.508ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = 70725b6d-bdae-4161-9900-7cc551bcb495
222026-10-27T05:27:58.508ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
232026-10-27T05:27:58.508ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:341 retry_after = 594.930324ms
242026-10-27T05:27:59.104ZDEBGoximeter: creating ClickHouse client
252026-10-27T05:27:59.104ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = 6a0a53ee-57c3-4208-9c34-ba4a8d92ff9d
262026-10-27T05:27:59.107ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = 6a0a53ee-57c3-4208-9c34-ba4a8d92ff9d
272026-10-27T05:27:59.108ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
282026-10-27T05:27:59.108ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:341 retry_after = 2.480338401s
292026-10-27T05:28:01.589ZDEBGoximeter: creating ClickHouse client
302026-10-27T05:28:01.589ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = af87a724-d777-4dd1-955c-c8ff8b3251c1
312026-10-27T05:28:01.593ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = af87a724-d777-4dd1-955c-c8ff8b3251c1
322026-10-27T05:28:01.593ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
332026-10-27T05:28:01.593ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:341 retry_after = 4.018470059s
342026-10-27T05:28:05.613ZDEBGoximeter: creating ClickHouse client
352026-10-27T05:28:05.613ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = 5c255542-29fe-4291-98e0-4820baa2158c
362026-10-27T05:28:05.616ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = 5c255542-29fe-4291-98e0-4820baa2158c
372026-10-27T05:28:05.616ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
382026-10-27T05:28:05.616ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:341 retry_after = 6.218715511s
392026-10-27T05:28:11.836ZDEBGoximeter: creating ClickHouse client
402026-10-27T05:28:11.836ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = 3c8ced83-d2b7-43e9-b6af-e5517b583f56
412026-10-27T05:28:11.839ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = 3c8ced83-d2b7-43e9-b6af-e5517b583f56
422026-10-27T05:28:11.839ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
432026-10-27T05:28:11.840ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:341 retry_after = 9.995679916s
442026-10-27T05:28:21.837ZDEBGoximeter: creating ClickHouse client
452026-10-27T05:28:21.837ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = 5d4b0b5a-3f9b-4d93-bc80-1cedc3ecd7be
462026-10-27T05:28:21.840ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = 5d4b0b5a-3f9b-4d93-bc80-1cedc3ecd7be
472026-10-27T05:28:21.840ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
482026-10-27T05:28:21.840ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:341 retry_after = 31.890502648s
492026-10-27T05:28:53.731ZDEBGoximeter: creating ClickHouse client
502026-10-27T05:28:53.731ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
512026-10-27T05:28:53.928ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = 7ead6544-21f4-4e18-aa80-fbb5b675fb60
522026-10-27T05:28:53.938ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
532026-10-27T05:28:53.939ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
542026-10-27T05:28:53.939ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
552026-10-27T05:28:53.939ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
562026-10-27T05:28:53.941ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
572026-10-27T05:28:53.945ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
582026-10-27T05:28:53.946ZDEBGoximeter: registered USDT probes
592026-10-27T05:28:53.946ZDEBGoximeter: contacting nexus
602026-10-27T05:28:53.966ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
612026-10-27T05:28:54.086ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "952a5574-b49c-4f3b-99dd-d918fb3e5908", "date": "Tue, 27 Oct 2026 05:28:54 GMT"} })
622026-10-27T05:28:54.086ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:623
632026-10-27T05:28:54.086ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:420 id = a495983a-a4d3-4e95-a00a-6c98497122fa
642026-10-27T05:28:54.087ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
652026-10-27T05:28:54.087ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?sort_by=id_ascending
662026-10-27T05:28:54.092ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e33d671-d557-45bc-99c2-fbbc31daa24b", "content-length": "29", "date": "Tue, 27 Oct 2026 05:28:54 GMT"} })
672026-10-27T05:28:54.093ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:701 n_current_tasks = 0 n_pruned_tasks = 0
682026-10-27T05:28:58.930ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 4
692026-10-27T05:28:58.930ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 4
702026-10-27T05:28:58.932ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
712026-10-27T05:28:58.932ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
722026-10-27T05:28:58.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:28:58.932318976Z } timeseries_name = oximeter_collector:database_queue_depth
732026-10-27T05:28:58.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:28:58.932316246Z } timeseries_name = oximeter_collector:database_samples_dropped
742026-10-27T05:28:58.934ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
752026-10-27T05:28:58.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 4 table_name = fields_ipaddr
762026-10-27T05:28:58.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 4 table_name = fields_string
772026-10-27T05:28:58.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 4 table_name = fields_u16
782026-10-27T05:28:58.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 4 table_name = fields_uuid
792026-10-27T05:28:58.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 2 table_name = measurements_cumulativeu64
802026-10-27T05:28:58.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 2 table_name = measurements_histogramu64
812026-10-27T05:28:59.033ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
822026-10-27T05:29:03.929ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d
832026-10-27T05:29:03.929ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d
842026-10-27T05:29:08.929ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d
852026-10-27T05:29:08.929ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d
862026-10-27T05:29:09.087ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
872026-10-27T05:29:09.087ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?sort_by=id_ascending
882026-10-27T05:29:09.091ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "75bed3bb-e0ff-4fd8-8045-ece80456ff12", "content-length": "989", "date": "Tue, 27 Oct 2026 05:29:09 GMT"} })
892026-10-27T05:29:09.091ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMjBhNWM3OS0zMmNiLTRmNDQtODIwNi1mMDcwODYzZDk2NTMifX0%3D
902026-10-27T05:29:09.094ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMjBhNWM3OS0zMmNiLTRmNDQtODIwNi1mMDcwODYzZDk2NTMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcb34a62-4aba-4f22-994a-4f4295f201d6", "content-length": "29", "date": "Tue, 27 Oct 2026 05:29:09 GMT"} })
912026-10-27T05:29:09.094ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:46632 collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c
922026-10-27T05:29:09.094ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb
932026-10-27T05:29:09.094ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23
942026-10-27T05:29:09.094ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:33438 collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 842ea4d7-f783-480a-9d3f-9298e024f004
952026-10-27T05:29:09.094ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:33500 collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2
962026-10-27T05:29:09.094ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:46739 collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653
972026-10-27T05:29:09.094ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:701 n_current_tasks = 6 n_pruned_tasks = 0
982026-10-27T05:29:09.727ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
992026-10-27T05:29:09.727ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1002026-10-27T05:29:09.736ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1012026-10-27T05:29:09.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1022026-10-27T05:29:09.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1032026-10-27T05:29:09.779ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1042026-10-27T05:29:09.823ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
1052026-10-27T05:29:09.823ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
1062026-10-27T05:29:09.832ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 45 producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
1072026-10-27T05:29:10.068ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
1082026-10-27T05:29:10.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1092026-10-27T05:29:10.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1102026-10-27T05:29:10.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1112026-10-27T05:29:10.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1122026-10-27T05:29:10.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1132026-10-27T05:29:10.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1142026-10-27T05:29:11.727ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1152026-10-27T05:29:11.727ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1162026-10-27T05:29:11.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1172026-10-27T05:29:11.770ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1182026-10-27T05:29:11.770ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1192026-10-27T05:29:11.771ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1202026-10-27T05:29:11.845ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
1212026-10-27T05:29:11.845ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
1222026-10-27T05:29:11.851ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 11 producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
1232026-10-27T05:29:12.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1242026-10-27T05:29:12.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1252026-10-27T05:29:12.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1262026-10-27T05:29:12.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1272026-10-27T05:29:12.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1282026-10-27T05:29:12.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1292026-10-27T05:29:13.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1302026-10-27T05:29:13.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1312026-10-27T05:29:13.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1322026-10-27T05:29:13.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1332026-10-27T05:29:13.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1342026-10-27T05:29:13.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1352026-10-27T05:29:13.930ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 258
1362026-10-27T05:29:13.930ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 258
1372026-10-27T05:29:13.930ZDEBGoximeter (clickhouse-client): unrolling 258 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
1382026-10-27T05:29:13.930ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
1392026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930171737Z } timeseries_name = collection_target:cpus_provisioned
1402026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930172877Z } timeseries_name = collection_target:ram_provisioned
1412026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930174127Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1422026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930131956Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1432026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930129136Z } timeseries_name = ddm_router:originated_underlay_prefixes
1442026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930140486Z } timeseries_name = ddm_session:advertisements_received
1452026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930138376Z } timeseries_name = ddm_session:advertisements_sent
1462026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930155476Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1472026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930153636Z } timeseries_name = ddm_session:imported_underlay_prefixes
1482026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930143896Z } timeseries_name = ddm_session:peer_address_changes
1492026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930142206Z } timeseries_name = ddm_session:peer_expirations
1502026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930145946Z } timeseries_name = ddm_session:peer_sessions_established
1512026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930136706Z } timeseries_name = ddm_session:solicitations_received
1522026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930134516Z } timeseries_name = ddm_session:solicitations_sent
1532026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930150696Z } timeseries_name = ddm_session:update_send_fail
1542026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930149236Z } timeseries_name = ddm_session:updates_received
1552026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930147966Z } timeseries_name = ddm_session:updates_sent
1562026-10-27T05:29:13.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930165547Z } timeseries_name = http_service:request_latency_histogram
1572026-10-27T05:29:13.934ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930184067Z } timeseries_name = oximeter_collector:collections
1582026-10-27T05:29:13.934ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:13.930186507Z } timeseries_name = oximeter_collector:samples_collected
1592026-10-27T05:29:13.935ZDEBGoximeter (clickhouse-client): inserting 20 new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
1602026-10-27T05:29:13.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 4 table_name = fields_ipaddr
1612026-10-27T05:29:13.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 136 table_name = fields_string
1622026-10-27T05:29:13.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 33 table_name = fields_u16
1632026-10-27T05:29:13.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 131 table_name = fields_uuid
1642026-10-27T05:29:13.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 152 table_name = measurements_cumulativeu64
1652026-10-27T05:29:13.950ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 29 table_name = measurements_histogramu64
1662026-10-27T05:29:13.952ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 27 table_name = measurements_i64
1672026-10-27T05:29:13.953ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 50 table_name = measurements_u64
1682026-10-27T05:29:14.031ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1692026-10-27T05:29:14.389ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
1702026-10-27T05:29:14.389ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
1712026-10-27T05:29:14.394ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
1722026-10-27T05:29:14.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1732026-10-27T05:29:14.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1742026-10-27T05:29:14.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1752026-10-27T05:29:14.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1762026-10-27T05:29:14.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1772026-10-27T05:29:14.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1782026-10-27T05:29:15.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1792026-10-27T05:29:15.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-10-27T05:29:15.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-10-27T05:29:15.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1822026-10-27T05:29:15.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1832026-10-27T05:29:15.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1842026-10-27T05:29:16.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1852026-10-27T05:29:16.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-10-27T05:29:16.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-10-27T05:29:16.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1882026-10-27T05:29:16.770ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1892026-10-27T05:29:16.771ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1902026-10-27T05:29:17.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1912026-10-27T05:29:17.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1922026-10-27T05:29:17.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1932026-10-27T05:29:17.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1942026-10-27T05:29:17.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1952026-10-27T05:29:17.771ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1962026-10-27T05:29:18.401ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 842ea4d7-f783-480a-9d3f-9298e024f004 producer_ip = fd00:1122:3344:101::1 producer_port = 33438
1972026-10-27T05:29:18.401ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 842ea4d7-f783-480a-9d3f-9298e024f004 producer_ip = fd00:1122:3344:101::1 producer_port = 33438
1982026-10-27T05:29:18.596ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 8783 producer_id = 842ea4d7-f783-480a-9d3f-9298e024f004 producer_ip = fd00:1122:3344:101::1 producer_port = 33438
1992026-10-27T05:29:18.643ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 8945
2002026-10-27T05:29:18.643ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 8945
2012026-10-27T05:29:18.643ZDEBGoximeter (clickhouse-client): unrolling 8945 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
2022026-10-27T05:29:18.645ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
2032026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_evictions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643828667Z } timeseries_name = opte_port:in_uft_evictions
2042026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_flows"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643826847Z } timeseries_name = opte_port:in_uft_flows
2052026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_hits"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643822207Z } timeseries_name = opte_port:in_uft_hits
2062026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643824447Z } timeseries_name = opte_port:in_uft_misses
2072026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_evictions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643837137Z } timeseries_name = opte_port:out_uft_evictions
2082026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_flows"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643834887Z } timeseries_name = opte_port:out_uft_flows
2092026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_hits"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643830857Z } timeseries_name = opte_port:out_uft_hits
2102026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643832737Z } timeseries_name = opte_port:out_uft_misses
2112026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:route_cache_hits"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643842187Z } timeseries_name = opte_port:route_cache_hits
2122026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:route_cache_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643844258Z } timeseries_name = opte_port:route_cache_misses
2132026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:route_cache_occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643839767Z } timeseries_name = opte_port:route_cache_occupancy
2142026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:route_cache_table_full"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643846167Z } timeseries_name = opte_port:route_cache_table_full
2152026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.644260617Z } timeseries_name = sled_cpu:cpu_nsec
2162026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643801147Z } timeseries_name = sled_data_link:bytes_received
2172026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643804827Z } timeseries_name = sled_data_link:bytes_sent
2182026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643796497Z } timeseries_name = sled_data_link:errors_received
2192026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643798977Z } timeseries_name = sled_data_link:errors_sent
2202026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643803037Z } timeseries_name = sled_data_link:packets_received
2212026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643809047Z } timeseries_name = sled_data_link:packets_sent
2222026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.645219988Z } timeseries_name = zfs_dataset:bytes_used
2232026-10-27T05:29:18.657ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.645209587Z } timeseries_name = zfs_pool:bytes_allocated
2242026-10-27T05:29:18.658ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.645212187Z } timeseries_name = zfs_pool:bytes_total
2252026-10-27T05:29:18.658ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:18.643999661Z } timeseries_name = zone:cpu_nsec
2262026-10-27T05:29:18.697ZDEBGoximeter (clickhouse-client): inserting 23 new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
2272026-10-27T05:29:18.702ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 3641 table_name = fields_string
2282026-10-27T05:29:18.703ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 10 table_name = fields_u16
2292026-10-27T05:29:18.705ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 1025 table_name = fields_u32
2302026-10-27T05:29:18.707ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 2175 table_name = fields_uuid
2312026-10-27T05:29:18.711ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 8253 table_name = measurements_cumulativeu64
2322026-10-27T05:29:18.714ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 10 table_name = measurements_histogramu64
2332026-10-27T05:29:18.715ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 682 table_name = measurements_u64
2342026-10-27T05:29:18.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2352026-10-27T05:29:18.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-10-27T05:29:18.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2372026-10-27T05:29:18.744ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2382026-10-27T05:29:18.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2392026-10-27T05:29:18.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2402026-10-27T05:29:18.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2412026-10-27T05:29:18.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 40
2422026-10-27T05:29:18.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 40
2432026-10-27T05:29:18.929ZDEBGoximeter (clickhouse-client): unrolling 40 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
2442026-10-27T05:29:18.929ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
2452026-10-27T05:29:18.933ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 76 table_name = fields_string
2462026-10-27T05:29:18.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 80 table_name = fields_uuid
2472026-10-27T05:29:18.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 30 table_name = measurements_cumulativeu64
2482026-10-27T05:29:18.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 10 table_name = measurements_u64
2492026-10-27T05:29:19.030ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2502026-10-27T05:29:19.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2512026-10-27T05:29:19.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2522026-10-27T05:29:19.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2532026-10-27T05:29:19.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2542026-10-27T05:29:19.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2552026-10-27T05:29:19.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2562026-10-27T05:29:19.823ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
2572026-10-27T05:29:19.823ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
2582026-10-27T05:29:19.825ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
2592026-10-27T05:29:20.216ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 842ea4d7-f783-480a-9d3f-9298e024f004 producer_ip = fd00:1122:3344:101::1 producer_port = 33438
2602026-10-27T05:29:20.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2612026-10-27T05:29:20.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2622026-10-27T05:29:20.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2632026-10-27T05:29:20.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2642026-10-27T05:29:20.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2652026-10-27T05:29:20.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2662026-10-27T05:29:21.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2672026-10-27T05:29:21.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2682026-10-27T05:29:21.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2692026-10-27T05:29:21.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2702026-10-27T05:29:21.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2712026-10-27T05:29:21.771ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2722026-10-27T05:29:21.845ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
2732026-10-27T05:29:21.845ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
2742026-10-27T05:29:21.845ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
2752026-10-27T05:29:22.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2762026-10-27T05:29:22.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2772026-10-27T05:29:22.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2782026-10-27T05:29:22.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2792026-10-27T05:29:22.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2802026-10-27T05:29:22.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2812026-10-27T05:29:23.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2822026-10-27T05:29:23.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2832026-10-27T05:29:23.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-10-27T05:29:23.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2852026-10-27T05:29:23.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2862026-10-27T05:29:23.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2872026-10-27T05:29:23.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 231
2882026-10-27T05:29:23.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 231
2892026-10-27T05:29:23.929ZDEBGoximeter (clickhouse-client): unrolling 231 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
2902026-10-27T05:29:23.929ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
2912026-10-27T05:29:23.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 4 table_name = fields_ipaddr
2922026-10-27T05:29:23.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 136 table_name = fields_string
2932026-10-27T05:29:23.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 33 table_name = fields_u16
2942026-10-27T05:29:23.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 113 table_name = fields_uuid
2952026-10-27T05:29:23.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 152 table_name = measurements_cumulativeu64
2962026-10-27T05:29:23.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 29 table_name = measurements_histogramu64
2972026-10-27T05:29:23.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 50 table_name = measurements_u64
2982026-10-27T05:29:23.953ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2992026-10-27T05:29:24.030ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3002026-10-27T05:29:24.087ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
3012026-10-27T05:29:24.087ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?sort_by=id_ascending
3022026-10-27T05:29:24.091ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa151ba5-3d17-4174-8e03-db0ef1e7b7a8", "content-length": "989", "date": "Tue, 27 Oct 2026 05:29:24 GMT"} })
3032026-10-27T05:29:24.091ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMjBhNWM3OS0zMmNiLTRmNDQtODIwNi1mMDcwODYzZDk2NTMifX0%3D
3042026-10-27T05:29:24.094ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMjBhNWM3OS0zMmNiLTRmNDQtODIwNi1mMDcwODYzZDk2NTMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "10bc9d85-0879-4ef4-8cc5-6cf7bdf4d881", "content-length": "29", "date": "Tue, 27 Oct 2026 05:29:24 GMT"} })
3052026-10-27T05:29:24.094ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:701 n_current_tasks = 6 n_pruned_tasks = 0
3062026-10-27T05:29:24.389ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
3072026-10-27T05:29:24.389ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
3082026-10-27T05:29:24.390ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
3092026-10-27T05:29:24.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3102026-10-27T05:29:24.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-10-27T05:29:24.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-10-27T05:29:24.768ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3132026-10-27T05:29:24.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3142026-10-27T05:29:24.769ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3152026-10-27T05:29:25.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3162026-10-27T05:29:25.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-10-27T05:29:25.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-10-27T05:29:25.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3192026-10-27T05:29:25.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3202026-10-27T05:29:25.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3212026-10-27T05:29:26.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3222026-10-27T05:29:26.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3232026-10-27T05:29:26.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3242026-10-27T05:29:26.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3252026-10-27T05:29:26.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3262026-10-27T05:29:26.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3272026-10-27T05:29:27.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3282026-10-27T05:29:27.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3292026-10-27T05:29:27.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3302026-10-27T05:29:27.768ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3312026-10-27T05:29:27.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3322026-10-27T05:29:27.769ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3332026-10-27T05:29:28.406ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
3342026-10-27T05:29:28.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3352026-10-27T05:29:28.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3362026-10-27T05:29:28.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3372026-10-27T05:29:28.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3382026-10-27T05:29:28.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3392026-10-27T05:29:28.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3402026-10-27T05:29:28.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 206
3412026-10-27T05:29:28.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 206
3422026-10-27T05:29:28.929ZDEBGoximeter (clickhouse-client): unrolling 206 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
3432026-10-27T05:29:28.929ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
3442026-10-27T05:29:28.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 8 table_name = fields_ipaddr
3452026-10-27T05:29:28.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 84 table_name = fields_string
3462026-10-27T05:29:28.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 10 table_name = fields_u16
3472026-10-27T05:29:28.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 90 table_name = fields_uuid
3482026-10-27T05:29:28.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 154 table_name = measurements_cumulativeu64
3492026-10-27T05:29:28.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 2 table_name = measurements_histogramu64
3502026-10-27T05:29:28.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 50 table_name = measurements_u64
3512026-10-27T05:29:29.030ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3522026-10-27T05:29:29.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3532026-10-27T05:29:29.725ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3542026-10-27T05:29:29.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3552026-10-27T05:29:29.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3562026-10-27T05:29:29.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3572026-10-27T05:29:29.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3582026-10-27T05:29:29.823ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
3592026-10-27T05:29:29.823ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
3602026-10-27T05:29:29.825ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
3612026-10-27T05:29:30.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3622026-10-27T05:29:30.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3632026-10-27T05:29:30.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3642026-10-27T05:29:30.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3652026-10-27T05:29:30.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3662026-10-27T05:29:30.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3672026-10-27T05:29:31.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3682026-10-27T05:29:31.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3692026-10-27T05:29:31.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3702026-10-27T05:29:31.768ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3712026-10-27T05:29:31.768ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3722026-10-27T05:29:31.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3732026-10-27T05:29:31.845ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
3742026-10-27T05:29:31.845ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
3752026-10-27T05:29:31.846ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
3762026-10-27T05:29:32.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3772026-10-27T05:29:32.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3782026-10-27T05:29:32.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3792026-10-27T05:29:32.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3802026-10-27T05:29:32.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3812026-10-27T05:29:32.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3822026-10-27T05:29:33.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3832026-10-27T05:29:33.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3842026-10-27T05:29:33.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3852026-10-27T05:29:33.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3862026-10-27T05:29:33.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3872026-10-27T05:29:33.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3882026-10-27T05:29:33.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 229
3892026-10-27T05:29:33.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 229
3902026-10-27T05:29:33.929ZDEBGoximeter (clickhouse-client): unrolling 229 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
3912026-10-27T05:29:33.929ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
3922026-10-27T05:29:33.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 134 table_name = fields_string
3932026-10-27T05:29:33.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 29 table_name = fields_u16
3942026-10-27T05:29:33.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 109 table_name = fields_uuid
3952026-10-27T05:29:33.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 150 table_name = measurements_cumulativeu64
3962026-10-27T05:29:33.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 29 table_name = measurements_histogramu64
3972026-10-27T05:29:33.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 50 table_name = measurements_u64
3982026-10-27T05:29:34.031ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3992026-10-27T05:29:34.389ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
4002026-10-27T05:29:34.389ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
4012026-10-27T05:29:34.390ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
4022026-10-27T05:29:34.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4032026-10-27T05:29:34.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4042026-10-27T05:29:34.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4052026-10-27T05:29:34.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4062026-10-27T05:29:34.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4072026-10-27T05:29:34.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4082026-10-27T05:29:35.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4092026-10-27T05:29:35.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4102026-10-27T05:29:35.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4112026-10-27T05:29:35.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4122026-10-27T05:29:35.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4132026-10-27T05:29:35.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4142026-10-27T05:29:36.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4152026-10-27T05:29:36.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4162026-10-27T05:29:36.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4172026-10-27T05:29:36.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4182026-10-27T05:29:36.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4192026-10-27T05:29:36.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4202026-10-27T05:29:37.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4212026-10-27T05:29:37.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4222026-10-27T05:29:37.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4232026-10-27T05:29:37.768ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4242026-10-27T05:29:37.768ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4252026-10-27T05:29:37.769ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4262026-10-27T05:29:38.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4272026-10-27T05:29:38.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4282026-10-27T05:29:38.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4292026-10-27T05:29:38.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4302026-10-27T05:29:38.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4312026-10-27T05:29:38.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4322026-10-27T05:29:38.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 202
4332026-10-27T05:29:38.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 202
4342026-10-27T05:29:38.929ZDEBGoximeter (clickhouse-client): unrolling 202 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
4352026-10-27T05:29:38.929ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
4362026-10-27T05:29:38.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 80 table_name = fields_string
4372026-10-27T05:29:38.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 2 table_name = fields_u16
4382026-10-27T05:29:38.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 82 table_name = fields_uuid
4392026-10-27T05:29:38.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 150 table_name = measurements_cumulativeu64
4402026-10-27T05:29:38.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 2 table_name = measurements_histogramu64
4412026-10-27T05:29:38.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 50 table_name = measurements_u64
4422026-10-27T05:29:39.029ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4432026-10-27T05:29:39.087ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
4442026-10-27T05:29:39.087ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?sort_by=id_ascending
4452026-10-27T05:29:39.091ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4c83cce-31f8-4c2f-9f17-9a163e47ecab", "content-length": "989", "date": "Tue, 27 Oct 2026 05:29:39 GMT"} })
4462026-10-27T05:29:39.091ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMjBhNWM3OS0zMmNiLTRmNDQtODIwNi1mMDcwODYzZDk2NTMifX0%3D
4472026-10-27T05:29:39.094ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMjBhNWM3OS0zMmNiLTRmNDQtODIwNi1mMDcwODYzZDk2NTMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "9526abea-8313-4e94-beb9-e9724247ec1a", "content-length": "29", "date": "Tue, 27 Oct 2026 05:29:39 GMT"} })
4482026-10-27T05:29:39.094ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:701 n_current_tasks = 6 n_pruned_tasks = 0
4492026-10-27T05:29:39.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4502026-10-27T05:29:39.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4512026-10-27T05:29:39.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4522026-10-27T05:29:39.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4532026-10-27T05:29:39.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4542026-10-27T05:29:39.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4552026-10-27T05:29:39.823ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
4562026-10-27T05:29:39.823ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
4572026-10-27T05:29:39.825ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
4582026-10-27T05:29:40.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4592026-10-27T05:29:40.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4602026-10-27T05:29:40.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4612026-10-27T05:29:40.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4622026-10-27T05:29:40.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4632026-10-27T05:29:40.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4642026-10-27T05:29:41.727ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4652026-10-27T05:29:41.727ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4662026-10-27T05:29:41.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4672026-10-27T05:29:41.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4682026-10-27T05:29:41.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4692026-10-27T05:29:41.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4702026-10-27T05:29:41.845ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
4712026-10-27T05:29:41.845ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
4722026-10-27T05:29:41.846ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
4732026-10-27T05:29:42.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4742026-10-27T05:29:42.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4752026-10-27T05:29:42.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-10-27T05:29:42.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4772026-10-27T05:29:42.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4782026-10-27T05:29:42.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4792026-10-27T05:29:43.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4802026-10-27T05:29:43.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4812026-10-27T05:29:43.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4822026-10-27T05:29:43.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4832026-10-27T05:29:43.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4842026-10-27T05:29:43.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4852026-10-27T05:29:43.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 229
4862026-10-27T05:29:43.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 229
4872026-10-27T05:29:43.929ZDEBGoximeter (clickhouse-client): unrolling 229 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
4882026-10-27T05:29:43.929ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
4892026-10-27T05:29:43.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 134 table_name = fields_string
4902026-10-27T05:29:43.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 29 table_name = fields_u16
4912026-10-27T05:29:43.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 109 table_name = fields_uuid
4922026-10-27T05:29:43.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 150 table_name = measurements_cumulativeu64
4932026-10-27T05:29:43.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 29 table_name = measurements_histogramu64
4942026-10-27T05:29:43.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 50 table_name = measurements_u64
4952026-10-27T05:29:44.030ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4962026-10-27T05:29:44.389ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
4972026-10-27T05:29:44.389ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
4982026-10-27T05:29:44.390ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
4992026-10-27T05:29:44.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5002026-10-27T05:29:44.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5012026-10-27T05:29:44.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5022026-10-27T05:29:44.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5032026-10-27T05:29:44.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5042026-10-27T05:29:44.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5052026-10-27T05:29:45.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5062026-10-27T05:29:45.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5072026-10-27T05:29:45.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5082026-10-27T05:29:45.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5092026-10-27T05:29:45.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5102026-10-27T05:29:45.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5112026-10-27T05:29:46.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5122026-10-27T05:29:46.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5132026-10-27T05:29:46.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5142026-10-27T05:29:46.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5152026-10-27T05:29:46.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5162026-10-27T05:29:46.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5172026-10-27T05:29:47.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5182026-10-27T05:29:47.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5192026-10-27T05:29:47.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5202026-10-27T05:29:47.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5212026-10-27T05:29:47.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5222026-10-27T05:29:47.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5232026-10-27T05:29:48.330ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
5242026-10-27T05:29:48.401ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 842ea4d7-f783-480a-9d3f-9298e024f004 producer_ip = fd00:1122:3344:101::1 producer_port = 33438
5252026-10-27T05:29:48.401ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 842ea4d7-f783-480a-9d3f-9298e024f004 producer_ip = fd00:1122:3344:101::1 producer_port = 33438
5262026-10-27T05:29:48.421ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 2059 producer_id = 842ea4d7-f783-480a-9d3f-9298e024f004 producer_ip = fd00:1122:3344:101::1 producer_port = 33438
5272026-10-27T05:29:48.426ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 2223
5282026-10-27T05:29:48.426ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 2223
5292026-10-27T05:29:48.426ZDEBGoximeter (clickhouse-client): unrolling 2223 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
5302026-10-27T05:29:48.427ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
5312026-10-27T05:29:48.445ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 4 table_name = fields_ipaddr
5322026-10-27T05:29:48.448ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 3643 table_name = fields_string
5332026-10-27T05:29:48.449ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 14 table_name = fields_u16
5342026-10-27T05:29:48.451ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 1025 table_name = fields_u32
5352026-10-27T05:29:48.453ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 2179 table_name = fields_uuid
5362026-10-27T05:29:48.455ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 1967 table_name = measurements_cumulativeu64
5372026-10-27T05:29:48.457ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 10 table_name = measurements_histogramu64
5382026-10-27T05:29:48.458ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 246 table_name = measurements_u64
5392026-10-27T05:29:48.527ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5402026-10-27T05:29:48.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5412026-10-27T05:29:48.725ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5422026-10-27T05:29:48.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5432026-10-27T05:29:48.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5442026-10-27T05:29:48.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5452026-10-27T05:29:48.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5462026-10-27T05:29:48.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 40
5472026-10-27T05:29:48.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 40
5482026-10-27T05:29:48.929ZDEBGoximeter (clickhouse-client): unrolling 40 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
5492026-10-27T05:29:48.929ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
5502026-10-27T05:29:48.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 76 table_name = fields_string
5512026-10-27T05:29:48.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 80 table_name = fields_uuid
5522026-10-27T05:29:48.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 30 table_name = measurements_cumulativeu64
5532026-10-27T05:29:48.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 10 table_name = measurements_u64
5542026-10-27T05:29:49.030ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5552026-10-27T05:29:49.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5562026-10-27T05:29:49.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5572026-10-27T05:29:49.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5582026-10-27T05:29:49.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5592026-10-27T05:29:49.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5602026-10-27T05:29:49.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5612026-10-27T05:29:49.823ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
5622026-10-27T05:29:49.823ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
5632026-10-27T05:29:49.825ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
5642026-10-27T05:29:50.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5652026-10-27T05:29:50.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5662026-10-27T05:29:50.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5672026-10-27T05:29:50.768ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5682026-10-27T05:29:50.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5692026-10-27T05:29:50.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5702026-10-27T05:29:51.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5712026-10-27T05:29:51.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5722026-10-27T05:29:51.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5732026-10-27T05:29:51.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5742026-10-27T05:29:51.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5752026-10-27T05:29:51.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5762026-10-27T05:29:51.845ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
5772026-10-27T05:29:51.845ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
5782026-10-27T05:29:51.846ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = c20a5c79-32cb-4f44-8206-f070863d9653 producer_ip = fd00:1122:3344:101::b producer_port = 46739
5792026-10-27T05:29:52.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5802026-10-27T05:29:52.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5812026-10-27T05:29:52.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5822026-10-27T05:29:52.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5832026-10-27T05:29:52.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5842026-10-27T05:29:52.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5852026-10-27T05:29:53.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5862026-10-27T05:29:53.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5872026-10-27T05:29:53.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5882026-10-27T05:29:53.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5892026-10-27T05:29:53.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5902026-10-27T05:29:53.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5912026-10-27T05:29:53.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 229
5922026-10-27T05:29:53.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 229
5932026-10-27T05:29:53.929ZDEBGoximeter (clickhouse-client): unrolling 229 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
5942026-10-27T05:29:53.929ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
5952026-10-27T05:29:53.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 134 table_name = fields_string
5962026-10-27T05:29:53.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 29 table_name = fields_u16
5972026-10-27T05:29:53.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 109 table_name = fields_uuid
5982026-10-27T05:29:53.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 150 table_name = measurements_cumulativeu64
5992026-10-27T05:29:53.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 29 table_name = measurements_histogramu64
6002026-10-27T05:29:53.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 50 table_name = measurements_u64
6012026-10-27T05:29:54.030ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6022026-10-27T05:29:54.087ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
6032026-10-27T05:29:54.087ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?sort_by=id_ascending
6042026-10-27T05:29:54.111ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "cea77758-2c85-4ca5-9baa-5899fc6637b0", "content-length": "1412", "date": "Tue, 27 Oct 2026 05:29:54 GMT"} })
6052026-10-27T05:29:54.112ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTA1N2JlZS1hMzQ0LTQ2MzEtOTJiMi1hNTgxZDdmZjZiYTIifX0%3D
6062026-10-27T05:29:54.122ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a495983a-a4d3-4e95-a00a-6c98497122fa/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZTA1N2JlZS1hMzQ0LTQ2MzEtOTJiMi1hNTgxZDdmZjZiYTIifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2587039-3684-4c6d-a459-d42ec5db5e36", "content-length": "29", "date": "Tue, 27 Oct 2026 05:29:54 GMT"} })
6072026-10-27T05:29:54.122ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:44231 collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 1136b4d2-2bd4-489e-9fab-1b9fe18d8f2a
6082026-10-27T05:29:54.122ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991
6092026-10-27T05:29:54.123ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:62487 collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = de057bee-a344-4631-92b2-a581d7ff6ba2
6102026-10-27T05:29:54.123ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:701 n_current_tasks = 9 n_pruned_tasks = 0
6112026-10-27T05:29:54.389ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
6122026-10-27T05:29:54.389ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
6132026-10-27T05:29:54.390ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8790fd52-de05-48b0-9d59-ab53c81a53e2 producer_ip = fd00:1122:3344:101::a producer_port = 33500
6142026-10-27T05:29:54.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6152026-10-27T05:29:54.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6162026-10-27T05:29:54.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6172026-10-27T05:29:54.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6182026-10-27T05:29:54.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6192026-10-27T05:29:54.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6202026-10-27T05:29:54.861ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6212026-10-27T05:29:54.861ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6222026-10-27T05:29:54.869ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6232026-10-27T05:29:55.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6242026-10-27T05:29:55.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6252026-10-27T05:29:55.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6262026-10-27T05:29:55.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6272026-10-27T05:29:55.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6282026-10-27T05:29:55.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6292026-10-27T05:29:55.861ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6302026-10-27T05:29:55.861ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6312026-10-27T05:29:55.862ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6322026-10-27T05:29:56.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6332026-10-27T05:29:56.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6342026-10-27T05:29:56.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6352026-10-27T05:29:56.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6362026-10-27T05:29:56.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6372026-10-27T05:29:56.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6382026-10-27T05:29:56.861ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6392026-10-27T05:29:56.861ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6402026-10-27T05:29:56.861ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6412026-10-27T05:29:57.677ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6422026-10-27T05:29:57.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6432026-10-27T05:29:57.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6442026-10-27T05:29:57.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6452026-10-27T05:29:57.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6462026-10-27T05:29:57.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6472026-10-27T05:29:57.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6482026-10-27T05:29:57.861ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6492026-10-27T05:29:57.861ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6502026-10-27T05:29:57.862ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6512026-10-27T05:29:58.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6522026-10-27T05:29:58.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6532026-10-27T05:29:58.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6542026-10-27T05:29:58.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6552026-10-27T05:29:58.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6562026-10-27T05:29:58.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6572026-10-27T05:29:58.861ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6582026-10-27T05:29:58.861ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6592026-10-27T05:29:58.862ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6602026-10-27T05:29:58.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 229
6612026-10-27T05:29:58.929ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 229
6622026-10-27T05:29:58.929ZDEBGoximeter (clickhouse-client): unrolling 229 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
6632026-10-27T05:29:58.929ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
6642026-10-27T05:29:58.932ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:58.929490233Z } timeseries_name = mg_lower:routes_blocked_by_link_state
6652026-10-27T05:29:58.932ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:58.929486343Z } timeseries_name = static_routing_config:static_nexthops
6662026-10-27T05:29:58.932ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:58.929484333Z } timeseries_name = static_routing_config:static_routes
6672026-10-27T05:29:58.932ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:58.929487653Z } timeseries_name = switch_rib:active_routes
6682026-10-27T05:29:58.933ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
6692026-10-27T05:29:58.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 8 table_name = fields_ipaddr
6702026-10-27T05:29:58.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 92 table_name = fields_string
6712026-10-27T05:29:58.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 11 table_name = fields_u16
6722026-10-27T05:29:58.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 99 table_name = fields_uuid
6732026-10-27T05:29:58.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 164 table_name = measurements_cumulativeu64
6742026-10-27T05:29:58.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 5 table_name = measurements_histogramu64
6752026-10-27T05:29:58.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 60 table_name = measurements_u64
6762026-10-27T05:29:59.030ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6772026-10-27T05:29:59.318ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 1136b4d2-2bd4-489e-9fab-1b9fe18d8f2a producer_ip = fd00:1122:3344:101::2 producer_port = 44231
6782026-10-27T05:29:59.318ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 1136b4d2-2bd4-489e-9fab-1b9fe18d8f2a producer_ip = fd00:1122:3344:101::2 producer_port = 44231
6792026-10-27T05:29:59.541ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = de057bee-a344-4631-92b2-a581d7ff6ba2 producer_ip = fd00:1122:3344:101::2 producer_port = 62487
6802026-10-27T05:29:59.542ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = de057bee-a344-4631-92b2-a581d7ff6ba2 producer_ip = fd00:1122:3344:101::2 producer_port = 62487
6812026-10-27T05:29:59.561ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = de057bee-a344-4631-92b2-a581d7ff6ba2 producer_ip = fd00:1122:3344:101::2 producer_port = 62487
6822026-10-27T05:29:59.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6832026-10-27T05:29:59.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6842026-10-27T05:29:59.728ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6852026-10-27T05:29:59.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6862026-10-27T05:29:59.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6872026-10-27T05:29:59.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6882026-10-27T05:29:59.823ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
6892026-10-27T05:29:59.823ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
6902026-10-27T05:29:59.825ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 2e6d4947-2419-4229-9c7c-941308f8fe1c producer_ip = fd00:1122:3344:101::c producer_port = 46632
6912026-10-27T05:29:59.861ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6922026-10-27T05:29:59.861ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6932026-10-27T05:29:59.862ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6942026-10-27T05:29:59.876ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 16859 producer_id = 1136b4d2-2bd4-489e-9fab-1b9fe18d8f2a producer_ip = fd00:1122:3344:101::2 producer_port = 44231
6952026-10-27T05:29:59.990ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 17070
6962026-10-27T05:29:59.990ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_samples = 17070
6972026-10-27T05:29:59.990ZDEBGoximeter (clickhouse-client): unrolling 17070 total samples collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
6982026-10-27T05:29:59.994ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
6992026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990945674Z } timeseries_name = dendrite:sample_collection_duration
7002026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:current"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990994135Z } timeseries_name = hardware_component:current
7012026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:fan_speed"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.991011976Z } timeseries_name = hardware_component:fan_speed
7022026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:input_current"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.991000405Z } timeseries_name = hardware_component:input_current
7032026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:input_voltage"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.991007816Z } timeseries_name = hardware_component:input_voltage
7042026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:temperature"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990991275Z } timeseries_name = hardware_component:temperature
7052026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:voltage"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990997055Z } timeseries_name = hardware_component:voltage
7062026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990883173Z } timeseries_name = switch_data_link:link_enabled
7072026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990888733Z } timeseries_name = switch_data_link:link_up
7082026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990893633Z } timeseries_name = switch_table:capacity
7092026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990907343Z } timeseries_name = switch_table:collisions
7102026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990912303Z } timeseries_name = switch_table:delete_misses
7112026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990901963Z } timeseries_name = switch_table:deletes
7122026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990914794Z } timeseries_name = switch_table:exhaustion
7132026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990899363Z } timeseries_name = switch_table:inserts
7142026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990896653Z } timeseries_name = switch_table:occupancy
7152026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990909754Z } timeseries_name = switch_table:update_misses
7162026-10-27T05:29:59.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-27T05:29:59.990904363Z } timeseries_name = switch_table:updates
7172026-10-27T05:30:00.075ZDEBGoximeter (clickhouse-client): inserting 18 new timeseries schema collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7
7182026-10-27T05:30:00.079ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 280 table_name = fields_i16
7192026-10-27T05:30:00.081ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 1357 table_name = fields_string
7202026-10-27T05:30:00.083ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 178 table_name = fields_u16
7212026-10-27T05:30:00.084ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 265 table_name = fields_u32
7222026-10-27T05:30:00.085ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 144 table_name = fields_u8
7232026-10-27T05:30:00.087ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 666 table_name = fields_uuid
7242026-10-27T05:30:00.088ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 4 table_name = measurements_bool
7252026-10-27T05:30:00.089ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 137 table_name = measurements_cumulativeu64
7262026-10-27T05:30:00.091ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7272026-10-27T05:30:00.101ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 16848 table_name = measurements_f32
7282026-10-27T05:30:00.102ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 1 table_name = measurements_f64
7292026-10-27T05:30:00.104ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 38 table_name = measurements_histogramu64
7302026-10-27T05:30:00.105ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d id = c40d5fc8-d06b-40c9-98bf-41c6e0c20cc7 n_rows = 42 table_name = measurements_u64
7312026-10-27T05:30:00.726ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7322026-10-27T05:30:00.726ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7332026-10-27T05:30:00.727ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 776b425f-d919-47fd-af35-6c2a3a687f23 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7342026-10-27T05:30:00.769ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7352026-10-27T05:30:00.769ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7362026-10-27T05:30:00.770ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 610855fa-b0cc-45b3-93f0-43df869cc6bb producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7372026-10-27T05:30:00.861ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7382026-10-27T05:30:00.861ZDEBGoximeter (collection-task): collecting from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7392026-10-27T05:30:00.862ZDEBGoximeter (collection-task): collected results from producer collector_id = a495983a-a4d3-4e95-a00a-6c98497122fa collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = d8fc593d-c9d6-4899-9580-a62adf75b991 producer_ip = fd00:1122:3344:101::2 producer_port = 4677