Max level shown:
1 [ May 1 20:13:22 Enabled. ]
2 [ May 1 20:13:22 Rereading configuration. ]
3 [ May 1 20:13:24 Rereading configuration. ]
4 [ May 1 20:13:30 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id a45da2a2-5dab-42d7-8b58-037885b6fc50 &"). ]
5 [ May 1 20:13:30 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-05-01T20:13:30.667ZDEBGoximeter: registered DTrace probes
82026-05-01T20:13:30.668ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:301
92026-05-01T20:13:30.671ZDEBGoximeter: creating ClickHouse client
102026-05-01T20:13:30.694ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
112026-05-01T20:13:40.830ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:882 id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
122026-05-01T20:13:40.831ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d
132026-05-01T20:13:40.831ZINFOoximeter (clickhouse-client): reading db version collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:782 id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
142026-05-01T20:13:40.833ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:882 id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
152026-05-01T20:13:40.833ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:787 id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa version = 0
162026-05-01T20:13:40.833ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:792 id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
172026-05-01T20:13:40.833ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
182026-05-01T20:13:41.281ZINFOoximeter (clickhouse-client): inserting current version collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:813 id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa version = 14
192026-05-01T20:13:41.333ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 6b443fd9-6fe5-4b93-b999-a202d05f72d1
202026-05-01T20:13:41.369ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-05-01T20:13:41.369ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-05-01T20:13:41.369ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-05-01T20:13:41.369ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-05-01T20:13:41.369ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.0/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-05-01T20:13:41.387ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-05-01T20:13:41.387ZDEBGoximeter: registered USDT probes
272026-05-01T20:13:41.387ZDEBGoximeter: contacting nexus
282026-05-01T20:13:41.454ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-05-01T20:13:41.482ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "78aa7708-c1a5-49f2-b676-4a6be48b2144", "date": "Fri, 01 May 2026 20:13:41 GMT"} })
302026-05-01T20:13:41.482ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:464 id = a45da2a2-5dab-42d7-8b58-037885b6fc50
312026-05-01T20:13:41.484ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
322026-05-01T20:13:41.485ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
332026-05-01T20:13:41.488ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending
342026-05-01T20:13:41.515ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3f3eb69-aaa7-40b0-8754-9ca80d8e4835", "content-length": "29", "date": "Fri, 01 May 2026 20:13:41 GMT"} })
352026-05-01T20:13:41.516ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 0 n_pruned_tasks = 0
362026-05-01T20:13:46.338ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d
372026-05-01T20:13:46.338ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d
382026-05-01T20:13:51.338ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d
392026-05-01T20:13:51.338ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d
402026-05-01T20:13:56.338ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d
412026-05-01T20:13:56.338ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d
422026-05-01T20:13:56.486ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
432026-05-01T20:13:56.486ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending
442026-05-01T20:13:56.492ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ef026f2-2030-453f-946c-e601fed6e7a7", "content-length": "300", "date": "Fri, 01 May 2026 20:13:56 GMT"} })
452026-05-01T20:13:56.492ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4YWRhYzAyYi1iOWVjLTRlMGItODg2MC00YmUzMGQ2MTllMjIifX0%3D
462026-05-01T20:13:56.494ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4YWRhYzAyYi1iOWVjLTRlMGItODg2MC00YmUzMGQ2MTllMjIifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "160826df-25c9-4ac4-b318-60436689356e", "content-length": "29", "date": "Fri, 01 May 2026 20:13:56 GMT"} })
472026-05-01T20:13:56.496ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:50296 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22
482026-05-01T20:13:56.499ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 1 n_pruned_tasks = 0
492026-05-01T20:13:56.500ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
502026-05-01T20:13:56.525ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
512026-05-01T20:13:56.525ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
522026-05-01T20:13:56.548ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 42 producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
532026-05-01T20:14:01.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 43
542026-05-01T20:14:01.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 43
552026-05-01T20:14:01.338ZDEBGoximeter (clickhouse-client): unrolling 43 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
562026-05-01T20:14:01.347ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
572026-05-01T20:14:01.368ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:01.342203081Z } timeseries_name = collection_target:cpus_provisioned
582026-05-01T20:14:01.368ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:01.342263973Z } timeseries_name = collection_target:ram_provisioned
592026-05-01T20:14:01.368ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:01.342325324Z } timeseries_name = collection_target:virtual_disk_space_provisioned
602026-05-01T20:14:01.368ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:01.339194275Z } timeseries_name = http_service:request_latency_histogram
612026-05-01T20:14:01.369ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:01.339095893Z } timeseries_name = oximeter_collector:collections
622026-05-01T20:14:01.376ZDEBGoximeter (clickhouse-client): inserting 5 new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
632026-05-01T20:14:01.391ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 2 table_name = fields_ipaddr
642026-05-01T20:14:01.395ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 43 table_name = fields_string
652026-05-01T20:14:01.397ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 23 table_name = fields_u16
662026-05-01T20:14:01.399ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 38 table_name = fields_uuid
672026-05-01T20:14:01.403ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 1 table_name = measurements_cumulativeu64
682026-05-01T20:14:01.410ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 21 table_name = measurements_histogramu64
692026-05-01T20:14:01.412ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 21 table_name = measurements_i64
702026-05-01T20:14:01.438ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
712026-05-01T20:14:06.338ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d
722026-05-01T20:14:06.338ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d
732026-05-01T20:14:06.526ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
742026-05-01T20:14:06.526ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
752026-05-01T20:14:06.530ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 33 producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
762026-05-01T20:14:11.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 33
772026-05-01T20:14:11.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 33
782026-05-01T20:14:11.338ZDEBGoximeter (clickhouse-client): unrolling 33 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
792026-05-01T20:14:11.340ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
802026-05-01T20:14:11.394ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 54 table_name = fields_string
812026-05-01T20:14:11.396ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 27 table_name = fields_u16
822026-05-01T20:14:11.398ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 32 table_name = fields_uuid
832026-05-01T20:14:11.401ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 27 table_name = measurements_histogramu64
842026-05-01T20:14:11.403ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 6 table_name = measurements_i64
852026-05-01T20:14:11.439ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
862026-05-01T20:14:11.486ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
872026-05-01T20:14:11.486ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending
882026-05-01T20:14:11.493ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c2e9d34-a0f5-40a9-a9d9-0d6f61946e2d", "content-length": "710", "date": "Fri, 01 May 2026 20:14:11 GMT"} })
892026-05-01T20:14:11.493ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhY2RiZTgxYi05ZTQxLTQ5NjMtYTc1Yy01Yzk3NjBjZWU4OGYifX0%3D
902026-05-01T20:14:11.497ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhY2RiZTgxYi05ZTQxLTQ5NjMtYTc1Yy01Yzk3NjBjZWU4OGYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "27517316-a8e9-4c12-8d1b-db14cea196eb", "content-length": "29", "date": "Fri, 01 May 2026 20:14:11 GMT"} })
912026-05-01T20:14:11.497ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f
922026-05-01T20:14:11.497ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c
932026-05-01T20:14:11.497ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:54002 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f
942026-05-01T20:14:11.497ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 4 n_pruned_tasks = 0
952026-05-01T20:14:11.498ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
962026-05-01T20:14:11.498ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
972026-05-01T20:14:11.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
982026-05-01T20:14:11.498ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
992026-05-01T20:14:11.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
1002026-05-01T20:14:11.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1012026-05-01T20:14:11.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
1022026-05-01T20:14:11.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1032026-05-01T20:14:11.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1042026-05-01T20:14:11.512ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1052026-05-01T20:14:11.514ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1062026-05-01T20:14:11.535ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
1072026-05-01T20:14:12.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1082026-05-01T20:14:12.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1092026-05-01T20:14:12.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1102026-05-01T20:14:12.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1112026-05-01T20:14:12.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1122026-05-01T20:14:12.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1132026-05-01T20:14:13.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1142026-05-01T20:14:13.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1152026-05-01T20:14:13.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1162026-05-01T20:14:13.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1172026-05-01T20:14:13.499ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1182026-05-01T20:14:13.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1192026-05-01T20:14:14.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1202026-05-01T20:14:14.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1212026-05-01T20:14:14.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1222026-05-01T20:14:14.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1232026-05-01T20:14:14.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1242026-05-01T20:14:14.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1252026-05-01T20:14:15.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1262026-05-01T20:14:15.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1272026-05-01T20:14:15.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1282026-05-01T20:14:15.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1292026-05-01T20:14:15.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1302026-05-01T20:14:15.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1312026-05-01T20:14:16.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 345
1322026-05-01T20:14:16.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 345
1332026-05-01T20:14:16.338ZDEBGoximeter (clickhouse-client): unrolling 345 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
1342026-05-01T20:14:16.349ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
1352026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339043563Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1362026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.338984322Z } timeseries_name = ddm_router:originated_underlay_prefixes
1372026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339278247Z } timeseries_name = ddm_session:advertisements_received
1382026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339220316Z } timeseries_name = ddm_session:advertisements_sent
1392026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339750006Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1402026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339693135Z } timeseries_name = ddm_session:imported_underlay_prefixes
1412026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339394510Z } timeseries_name = ddm_session:peer_address_changes
1422026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339336638Z } timeseries_name = ddm_session:peer_expirations
1432026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339452251Z } timeseries_name = ddm_session:peer_sessions_established
1442026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339161585Z } timeseries_name = ddm_session:solicitations_received
1452026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339102854Z } timeseries_name = ddm_session:solicitations_sent
1462026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339634704Z } timeseries_name = ddm_session:update_send_fail
1472026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339575723Z } timeseries_name = ddm_session:updates_received
1482026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.339516072Z } timeseries_name = ddm_session:updates_sent
1492026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.344770171Z } timeseries_name = dendrite:sample_collection_duration
1502026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.340533731Z } timeseries_name = switch_data_link:link_enabled
1512026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.340594962Z } timeseries_name = switch_data_link:link_up
1522026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.340766925Z } timeseries_name = switch_table:capacity
1532026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.341057191Z } timeseries_name = switch_table:collisions
1542026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.341176093Z } timeseries_name = switch_table:delete_misses
1552026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.340941039Z } timeseries_name = switch_table:deletes
1562026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.341234774Z } timeseries_name = switch_table:exhaustion
1572026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.340882698Z } timeseries_name = switch_table:inserts
1582026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.340824927Z } timeseries_name = switch_table:occupancy
1592026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.341116662Z } timeseries_name = switch_table:update_misses
1602026-05-01T20:14:16.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:16.340999090Z } timeseries_name = switch_table:updates
1612026-05-01T20:14:16.356ZDEBGoximeter (clickhouse-client): inserting 26 new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
1622026-05-01T20:14:16.360ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 284 table_name = fields_i16
1632026-05-01T20:14:16.361ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 6 table_name = fields_ipaddr
1642026-05-01T20:14:16.363ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 796 table_name = fields_string
1652026-05-01T20:14:16.364ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 148 table_name = fields_u16
1662026-05-01T20:14:16.366ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 149 table_name = fields_u32
1672026-05-01T20:14:16.369ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 148 table_name = fields_u8
1682026-05-01T20:14:16.371ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 488 table_name = fields_uuid
1692026-05-01T20:14:16.372ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 6 table_name = measurements_bool
1702026-05-01T20:14:16.374ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 258 table_name = measurements_cumulativeu64
1712026-05-01T20:14:16.375ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 1 table_name = measurements_f64
1722026-05-01T20:14:16.377ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 80 table_name = measurements_u64
1732026-05-01T20:14:16.439ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
1742026-05-01T20:14:16.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1752026-05-01T20:14:16.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1762026-05-01T20:14:16.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1772026-05-01T20:14:16.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1782026-05-01T20:14:16.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1792026-05-01T20:14:16.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-05-01T20:14:16.526ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
1812026-05-01T20:14:16.526ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
1822026-05-01T20:14:16.530ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
1832026-05-01T20:14:17.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1842026-05-01T20:14:17.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1852026-05-01T20:14:17.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-05-01T20:14:17.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-05-01T20:14:17.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1882026-05-01T20:14:17.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-05-01T20:14:18.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1902026-05-01T20:14:18.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1912026-05-01T20:14:18.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1922026-05-01T20:14:18.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1932026-05-01T20:14:18.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1942026-05-01T20:14:18.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1952026-05-01T20:14:19.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1962026-05-01T20:14:19.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1972026-05-01T20:14:19.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1982026-05-01T20:14:19.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1992026-05-01T20:14:19.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2002026-05-01T20:14:19.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2012026-05-01T20:14:20.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2022026-05-01T20:14:20.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2032026-05-01T20:14:20.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2042026-05-01T20:14:20.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2052026-05-01T20:14:20.499ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2062026-05-01T20:14:20.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2072026-05-01T20:14:21.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 227
2082026-05-01T20:14:21.338ZDEBGoximeter (clickhouse-client): unrolling 227 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
2092026-05-01T20:14:21.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 227
2102026-05-01T20:14:21.345ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
2112026-05-01T20:14:21.354ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 106 table_name = fields_string
2122026-05-01T20:14:21.356ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 27 table_name = fields_u16
2132026-05-01T20:14:21.357ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 83 table_name = fields_uuid
2142026-05-01T20:14:21.358ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 150 table_name = measurements_cumulativeu64
2152026-05-01T20:14:21.360ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 27 table_name = measurements_histogramu64
2162026-05-01T20:14:21.362ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 50 table_name = measurements_u64
2172026-05-01T20:14:21.439ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
2182026-05-01T20:14:21.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2192026-05-01T20:14:21.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
2202026-05-01T20:14:21.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2212026-05-01T20:14:21.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2222026-05-01T20:14:21.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
2232026-05-01T20:14:21.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2242026-05-01T20:14:21.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2252026-05-01T20:14:21.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2262026-05-01T20:14:21.511ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
2272026-05-01T20:14:22.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2282026-05-01T20:14:22.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2292026-05-01T20:14:22.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2302026-05-01T20:14:22.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2312026-05-01T20:14:22.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2322026-05-01T20:14:22.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2332026-05-01T20:14:23.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2342026-05-01T20:14:23.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2352026-05-01T20:14:23.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-05-01T20:14:23.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2372026-05-01T20:14:23.499ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2382026-05-01T20:14:23.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2392026-05-01T20:14:24.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2402026-05-01T20:14:24.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2412026-05-01T20:14:24.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2422026-05-01T20:14:24.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2432026-05-01T20:14:24.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2442026-05-01T20:14:24.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2452026-05-01T20:14:25.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2462026-05-01T20:14:25.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2472026-05-01T20:14:25.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2482026-05-01T20:14:25.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2492026-05-01T20:14:25.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2502026-05-01T20:14:25.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2512026-05-01T20:14:26.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 342
2522026-05-01T20:14:26.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 342
2532026-05-01T20:14:26.338ZDEBGoximeter (clickhouse-client): unrolling 342 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
2542026-05-01T20:14:26.349ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
2552026-05-01T20:14:26.358ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 284 table_name = fields_i16
2562026-05-01T20:14:26.360ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 793 table_name = fields_string
2572026-05-01T20:14:26.362ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 142 table_name = fields_u16
2582026-05-01T20:14:26.363ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 149 table_name = fields_u32
2592026-05-01T20:14:26.365ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 148 table_name = fields_u8
2602026-05-01T20:14:26.366ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 482 table_name = fields_uuid
2612026-05-01T20:14:26.367ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 6 table_name = measurements_bool
2622026-05-01T20:14:26.369ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 255 table_name = measurements_cumulativeu64
2632026-05-01T20:14:26.370ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 1 table_name = measurements_f64
2642026-05-01T20:14:26.372ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 80 table_name = measurements_u64
2652026-05-01T20:14:26.439ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
2662026-05-01T20:14:26.486ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
2672026-05-01T20:14:26.486ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending
2682026-05-01T20:14:26.490ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a95a911-5a44-454c-a615-05c88105d384", "content-length": "846", "date": "Fri, 01 May 2026 20:14:26 GMT"} })
2692026-05-01T20:14:26.490ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiNDg0ZjllZi1lMTk5LTRjZTktOWIyNi0yNjBlNjQ1MTUwZGUifX0%3D
2702026-05-01T20:14:26.492ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiNDg0ZjllZi1lMTk5LTRjZTktOWIyNi0yNjBlNjQ1MTUwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0a8ef7f-ed76-4a66-be26-d391ed0c3c3d", "content-length": "29", "date": "Fri, 01 May 2026 20:14:26 GMT"} })
2712026-05-01T20:14:26.492ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de
2722026-05-01T20:14:26.492ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 5 n_pruned_tasks = 0
2732026-05-01T20:14:26.493ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2742026-05-01T20:14:26.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2752026-05-01T20:14:26.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2762026-05-01T20:14:26.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2772026-05-01T20:14:26.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2782026-05-01T20:14:26.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2792026-05-01T20:14:26.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2802026-05-01T20:14:26.499ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2812026-05-01T20:14:26.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2822026-05-01T20:14:26.503ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2832026-05-01T20:14:26.526ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
2842026-05-01T20:14:26.526ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
2852026-05-01T20:14:26.530ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
2862026-05-01T20:14:27.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2872026-05-01T20:14:27.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2882026-05-01T20:14:27.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2892026-05-01T20:14:27.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2902026-05-01T20:14:27.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2912026-05-01T20:14:27.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2922026-05-01T20:14:27.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2932026-05-01T20:14:27.499ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2942026-05-01T20:14:27.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2952026-05-01T20:14:28.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2962026-05-01T20:14:28.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2972026-05-01T20:14:28.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2982026-05-01T20:14:28.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2992026-05-01T20:14:28.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3002026-05-01T20:14:28.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3012026-05-01T20:14:28.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3022026-05-01T20:14:28.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3032026-05-01T20:14:28.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3042026-05-01T20:14:29.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3052026-05-01T20:14:29.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3062026-05-01T20:14:29.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3072026-05-01T20:14:29.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3082026-05-01T20:14:29.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3092026-05-01T20:14:29.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3102026-05-01T20:14:29.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-05-01T20:14:29.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3122026-05-01T20:14:29.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3132026-05-01T20:14:30.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3142026-05-01T20:14:30.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3152026-05-01T20:14:30.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3162026-05-01T20:14:30.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-05-01T20:14:30.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-05-01T20:14:30.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3192026-05-01T20:14:30.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3202026-05-01T20:14:30.499ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3212026-05-01T20:14:30.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3222026-05-01T20:14:31.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 248
3232026-05-01T20:14:31.338ZDEBGoximeter (clickhouse-client): unrolling 248 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
3242026-05-01T20:14:31.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 248
3252026-05-01T20:14:31.346ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
3262026-05-01T20:14:31.349ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:31.340514454Z } timeseries_name = mg_lower:routes_blocked_by_link_state
3272026-05-01T20:14:31.349ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:31.340402811Z } timeseries_name = static_routing_config:static_nexthops
3282026-05-01T20:14:31.349ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:31.340347041Z } timeseries_name = static_routing_config:static_routes
3292026-05-01T20:14:31.349ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:31.340458783Z } timeseries_name = switch_rib:active_routes
3302026-05-01T20:14:31.350ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
3312026-05-01T20:14:31.354ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 2 table_name = fields_ipaddr
3322026-05-01T20:14:31.355ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 111 table_name = fields_string
3332026-05-01T20:14:31.356ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 29 table_name = fields_u16
3342026-05-01T20:14:31.358ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 93 table_name = fields_uuid
3352026-05-01T20:14:31.360ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 161 table_name = measurements_cumulativeu64
3362026-05-01T20:14:31.362ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 27 table_name = measurements_histogramu64
3372026-05-01T20:14:31.363ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 60 table_name = measurements_u64
3382026-05-01T20:14:31.439ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
3392026-05-01T20:14:31.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3402026-05-01T20:14:31.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3412026-05-01T20:14:31.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3422026-05-01T20:14:31.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3432026-05-01T20:14:31.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3442026-05-01T20:14:31.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
3452026-05-01T20:14:31.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
3462026-05-01T20:14:31.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3472026-05-01T20:14:31.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3482026-05-01T20:14:31.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3492026-05-01T20:14:31.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3502026-05-01T20:14:31.510ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
3512026-05-01T20:14:32.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3522026-05-01T20:14:32.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3532026-05-01T20:14:32.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3542026-05-01T20:14:32.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3552026-05-01T20:14:32.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3562026-05-01T20:14:32.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3572026-05-01T20:14:32.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3582026-05-01T20:14:32.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3592026-05-01T20:14:32.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3602026-05-01T20:14:33.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3612026-05-01T20:14:33.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3622026-05-01T20:14:33.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3632026-05-01T20:14:33.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3642026-05-01T20:14:33.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3652026-05-01T20:14:33.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3662026-05-01T20:14:33.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3672026-05-01T20:14:33.499ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3682026-05-01T20:14:33.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3692026-05-01T20:14:34.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3702026-05-01T20:14:34.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3712026-05-01T20:14:34.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3722026-05-01T20:14:34.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3732026-05-01T20:14:34.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3742026-05-01T20:14:34.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3752026-05-01T20:14:34.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3762026-05-01T20:14:34.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3772026-05-01T20:14:34.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3782026-05-01T20:14:35.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3792026-05-01T20:14:35.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3802026-05-01T20:14:35.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3812026-05-01T20:14:35.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3822026-05-01T20:14:35.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3832026-05-01T20:14:35.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3842026-05-01T20:14:35.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3852026-05-01T20:14:35.499ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3862026-05-01T20:14:35.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3872026-05-01T20:14:36.339ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 362
3882026-05-01T20:14:36.339ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 362
3892026-05-01T20:14:36.339ZDEBGoximeter (clickhouse-client): unrolling 362 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
3902026-05-01T20:14:36.351ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
3912026-05-01T20:14:36.363ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 284 table_name = fields_i16
3922026-05-01T20:14:36.365ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 797 table_name = fields_string
3932026-05-01T20:14:36.366ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 142 table_name = fields_u16
3942026-05-01T20:14:36.367ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 149 table_name = fields_u32
3952026-05-01T20:14:36.369ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 148 table_name = fields_u8
3962026-05-01T20:14:36.370ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 490 table_name = fields_uuid
3972026-05-01T20:14:36.372ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 6 table_name = measurements_bool
3982026-05-01T20:14:36.373ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 265 table_name = measurements_cumulativeu64
3992026-05-01T20:14:36.375ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 1 table_name = measurements_f64
4002026-05-01T20:14:36.376ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 90 table_name = measurements_u64
4012026-05-01T20:14:36.439ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
4022026-05-01T20:14:36.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4032026-05-01T20:14:36.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4042026-05-01T20:14:36.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4052026-05-01T20:14:36.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4062026-05-01T20:14:36.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4072026-05-01T20:14:36.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4082026-05-01T20:14:36.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4092026-05-01T20:14:36.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4102026-05-01T20:14:36.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4112026-05-01T20:14:36.527ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
4122026-05-01T20:14:36.527ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
4132026-05-01T20:14:36.531ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
4142026-05-01T20:14:37.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4152026-05-01T20:14:37.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4162026-05-01T20:14:37.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4172026-05-01T20:14:37.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4182026-05-01T20:14:37.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4192026-05-01T20:14:37.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4202026-05-01T20:14:37.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4212026-05-01T20:14:37.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4222026-05-01T20:14:37.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4232026-05-01T20:14:38.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4242026-05-01T20:14:38.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4252026-05-01T20:14:38.495ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4262026-05-01T20:14:38.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4272026-05-01T20:14:38.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4282026-05-01T20:14:38.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4292026-05-01T20:14:38.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4302026-05-01T20:14:38.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4312026-05-01T20:14:38.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4322026-05-01T20:14:39.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4332026-05-01T20:14:39.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4342026-05-01T20:14:39.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4352026-05-01T20:14:39.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4362026-05-01T20:14:39.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4372026-05-01T20:14:39.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4382026-05-01T20:14:39.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4392026-05-01T20:14:39.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4402026-05-01T20:14:39.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4412026-05-01T20:14:40.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4422026-05-01T20:14:40.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4432026-05-01T20:14:40.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4442026-05-01T20:14:40.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4452026-05-01T20:14:40.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4462026-05-01T20:14:40.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4472026-05-01T20:14:40.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4482026-05-01T20:14:40.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4492026-05-01T20:14:40.502ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4502026-05-01T20:14:41.339ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 247
4512026-05-01T20:14:41.339ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 247
4522026-05-01T20:14:41.339ZDEBGoximeter (clickhouse-client): unrolling 247 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
4532026-05-01T20:14:41.348ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
4542026-05-01T20:14:41.356ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 110 table_name = fields_string
4552026-05-01T20:14:41.358ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 27 table_name = fields_u16
4562026-05-01T20:14:41.359ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 91 table_name = fields_uuid
4572026-05-01T20:14:41.361ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 160 table_name = measurements_cumulativeu64
4582026-05-01T20:14:41.364ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 27 table_name = measurements_histogramu64
4592026-05-01T20:14:41.366ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 60 table_name = measurements_u64
4602026-05-01T20:14:41.439ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
4612026-05-01T20:14:41.486ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
4622026-05-01T20:14:41.486ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending
4632026-05-01T20:14:41.490ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8fc6d02-d622-4b0e-b4ae-c3ebf1ce0bd9", "content-length": "1263", "date": "Fri, 01 May 2026 20:14:41 GMT"} })
4642026-05-01T20:14:41.490ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYTJjYzBiYy0wYmU2LTRkYTktODQ4NC1hZDljODk2Mjk4NTUifX0%3D
4652026-05-01T20:14:41.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4662026-05-01T20:14:41.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4672026-05-01T20:14:41.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4682026-05-01T20:14:41.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4692026-05-01T20:14:41.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4702026-05-01T20:14:41.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
4712026-05-01T20:14:41.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4722026-05-01T20:14:41.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
4732026-05-01T20:14:41.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4742026-05-01T20:14:41.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4752026-05-01T20:14:41.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-05-01T20:14:41.511ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
4772026-05-01T20:14:41.602ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYTJjYzBiYy0wYmU2LTRkYTktODQ4NC1hZDljODk2Mjk4NTUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "69abaf1f-ae3a-4392-a348-0f1388171577", "content-length": "29", "date": "Fri, 01 May 2026 20:14:41 GMT"} })
4782026-05-01T20:14:41.602ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:35586 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 89528c20-d591-4f0f-ab60-37e7f9d63df7
4792026-05-01T20:14:41.602ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:41345 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f
4802026-05-01T20:14:41.602ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
4812026-05-01T20:14:41.602ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:35741 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c
4822026-05-01T20:14:41.602ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:41867 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855
4832026-05-01T20:14:41.602ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 8 n_pruned_tasks = 0
4842026-05-01T20:14:41.602ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:41345 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
4852026-05-01T20:14:41.603ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
4862026-05-01T20:14:41.603ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
4872026-05-01T20:14:41.603ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c producer_ip = fd00:1122:3344:101::c producer_port = 35741
4882026-05-01T20:14:41.603ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 89528c20-d591-4f0f-ab60-37e7f9d63df7 producer_ip = fd00:1122:3344:101::1 producer_port = 35586
4892026-05-01T20:14:41.603ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855 producer_ip = fd00:1122:3344:101::b producer_port = 41867
4902026-05-01T20:14:41.603ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855 producer_ip = fd00:1122:3344:101::b producer_port = 41867
4912026-05-01T20:14:41.603ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855 producer_ip = fd00:1122:3344:101::b producer_port = 41867
4922026-05-01T20:14:41.603ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c producer_ip = fd00:1122:3344:101::c producer_port = 35741
4932026-05-01T20:14:41.603ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c producer_ip = fd00:1122:3344:101::c producer_port = 35741
4942026-05-01T20:14:41.603ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 89528c20-d591-4f0f-ab60-37e7f9d63df7 producer_ip = fd00:1122:3344:101::1 producer_port = 35586
4952026-05-01T20:14:41.603ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 89528c20-d591-4f0f-ab60-37e7f9d63df7 producer_ip = fd00:1122:3344:101::1 producer_port = 35586
4962026-05-01T20:14:41.621ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 1 producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855 producer_ip = fd00:1122:3344:101::b producer_port = 41867
4972026-05-01T20:14:41.630ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c producer_ip = fd00:1122:3344:101::c producer_port = 35741
4982026-05-01T20:14:41.656ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 324 producer_id = acdbe81b-9e41-4963-a75c-5c9760cee88f producer_ip = fd00:1122:3344:101::2 producer_port = 54002
4992026-05-01T20:14:41.784ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 3264 producer_id = 89528c20-d591-4f0f-ab60-37e7f9d63df7 producer_ip = fd00:1122:3344:101::1 producer_port = 35586
5002026-05-01T20:14:41.801ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 3780
5012026-05-01T20:14:41.802ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 3780
5022026-05-01T20:14:41.802ZDEBGoximeter (clickhouse-client): unrolling 3780 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
5032026-05-01T20:14:41.903ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
5042026-05-01T20:14:41.937ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
5052026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:expired_targets"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.936588272Z } timeseries_name = kstat_sampler:expired_targets
5062026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "target_id", field_type: U64, source: Metric, description: "" }, FieldSchema { name: "target_name", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.936839467Z } timeseries_name = kstat_sampler:samples_dropped
5072026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.851083546Z } timeseries_name = sled_cpu:cpu_nsec
5082026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.819774594Z } timeseries_name = sled_data_link:bytes_received
5092026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.819892166Z } timeseries_name = sled_data_link:bytes_sent
5102026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.819655781Z } timeseries_name = sled_data_link:errors_received
5112026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.819715493Z } timeseries_name = sled_data_link:errors_sent
5122026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.819833705Z } timeseries_name = sled_data_link:packets_received
5132026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.819951237Z } timeseries_name = sled_data_link:packets_sent
5142026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.810243003Z } timeseries_name = switch_port_control_data_link:bytes_received
5152026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.810377676Z } timeseries_name = switch_port_control_data_link:bytes_sent
5162026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.810116041Z } timeseries_name = switch_port_control_data_link:errors_received
5172026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.810179752Z } timeseries_name = switch_port_control_data_link:errors_sent
5182026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.810314495Z } timeseries_name = switch_port_control_data_link:packets_received
5192026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.810441737Z } timeseries_name = switch_port_control_data_link:packets_sent
5202026-05-01T20:14:41.942ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-01T20:14:41.911561919Z } timeseries_name = zone:cpu_nsec
5212026-05-01T20:14:41.965ZDEBGoximeter (clickhouse-client): inserting 16 new timeseries schema collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
5222026-05-01T20:14:41.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 308 table_name = fields_i16
5232026-05-01T20:14:41.970ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 6 table_name = fields_ipaddr
5242026-05-01T20:14:41.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 3278 table_name = fields_string
5252026-05-01T20:14:41.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 174 table_name = fields_u16
5262026-05-01T20:14:41.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 974 table_name = fields_u32
5272026-05-01T20:14:41.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 2 table_name = fields_u64
5282026-05-01T20:14:41.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 160 table_name = fields_u8
5292026-05-01T20:14:41.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 1761 table_name = fields_uuid
5302026-05-01T20:14:41.984ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 6 table_name = measurements_bool
5312026-05-01T20:14:41.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 3717 table_name = measurements_cumulativeu64
5322026-05-01T20:14:41.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 1 table_name = measurements_f64
5332026-05-01T20:14:41.990ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 14 table_name = measurements_histogramu64
5342026-05-01T20:14:41.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 42 table_name = measurements_u64
5352026-05-01T20:14:42.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5362026-05-01T20:14:42.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5372026-05-01T20:14:42.495ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5382026-05-01T20:14:42.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5392026-05-01T20:14:42.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402026-05-01T20:14:42.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5412026-05-01T20:14:42.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5422026-05-01T20:14:42.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5432026-05-01T20:14:42.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5442026-05-01T20:14:43.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5452026-05-01T20:14:43.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5462026-05-01T20:14:43.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5472026-05-01T20:14:43.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5482026-05-01T20:14:43.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5492026-05-01T20:14:43.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5502026-05-01T20:14:43.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5512026-05-01T20:14:43.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5522026-05-01T20:14:43.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5532026-05-01T20:14:44.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5542026-05-01T20:14:44.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5552026-05-01T20:14:44.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5562026-05-01T20:14:44.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5572026-05-01T20:14:44.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5582026-05-01T20:14:44.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5592026-05-01T20:14:44.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5602026-05-01T20:14:44.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5612026-05-01T20:14:44.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5622026-05-01T20:14:45.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5632026-05-01T20:14:45.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5642026-05-01T20:14:45.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5652026-05-01T20:14:45.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5662026-05-01T20:14:45.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5672026-05-01T20:14:45.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5682026-05-01T20:14:45.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5692026-05-01T20:14:45.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5702026-05-01T20:14:45.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5712026-05-01T20:14:46.339ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 176
5722026-05-01T20:14:46.339ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 176
5732026-05-01T20:14:46.339ZDEBGoximeter (clickhouse-client): unrolling 176 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
5742026-05-01T20:14:46.345ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
5752026-05-01T20:14:46.351ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 56 table_name = fields_string
5762026-05-01T20:14:46.352ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 64 table_name = fields_uuid
5772026-05-01T20:14:46.353ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 128 table_name = measurements_cumulativeu64
5782026-05-01T20:14:46.355ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 48 table_name = measurements_u64
5792026-05-01T20:14:46.441ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
5802026-05-01T20:14:46.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5812026-05-01T20:14:46.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5822026-05-01T20:14:46.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5832026-05-01T20:14:46.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5842026-05-01T20:14:46.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5852026-05-01T20:14:46.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5862026-05-01T20:14:46.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5872026-05-01T20:14:46.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5882026-05-01T20:14:46.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5892026-05-01T20:14:46.526ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
5902026-05-01T20:14:46.526ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
5912026-05-01T20:14:46.530ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
5922026-05-01T20:14:47.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5932026-05-01T20:14:47.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5942026-05-01T20:14:47.495ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5952026-05-01T20:14:47.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5962026-05-01T20:14:47.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5972026-05-01T20:14:47.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5982026-05-01T20:14:47.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5992026-05-01T20:14:47.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6002026-05-01T20:14:47.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6012026-05-01T20:14:48.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6022026-05-01T20:14:48.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6032026-05-01T20:14:48.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6042026-05-01T20:14:48.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6052026-05-01T20:14:48.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6062026-05-01T20:14:48.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6072026-05-01T20:14:48.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6082026-05-01T20:14:48.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6092026-05-01T20:14:48.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6102026-05-01T20:14:49.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6112026-05-01T20:14:49.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6122026-05-01T20:14:49.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6132026-05-01T20:14:49.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6142026-05-01T20:14:49.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6152026-05-01T20:14:49.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6162026-05-01T20:14:49.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6172026-05-01T20:14:49.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6182026-05-01T20:14:49.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6192026-05-01T20:14:50.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6202026-05-01T20:14:50.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6212026-05-01T20:14:50.495ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6222026-05-01T20:14:50.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6232026-05-01T20:14:50.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6242026-05-01T20:14:50.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6252026-05-01T20:14:50.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6262026-05-01T20:14:50.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6272026-05-01T20:14:50.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6282026-05-01T20:14:51.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 247
6292026-05-01T20:14:51.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 247
6302026-05-01T20:14:51.338ZDEBGoximeter (clickhouse-client): unrolling 247 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
6312026-05-01T20:14:51.346ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
6322026-05-01T20:14:51.353ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 110 table_name = fields_string
6332026-05-01T20:14:51.355ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 27 table_name = fields_u16
6342026-05-01T20:14:51.356ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 91 table_name = fields_uuid
6352026-05-01T20:14:51.358ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 160 table_name = measurements_cumulativeu64
6362026-05-01T20:14:51.360ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 27 table_name = measurements_histogramu64
6372026-05-01T20:14:51.361ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 60 table_name = measurements_u64
6382026-05-01T20:14:51.439ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
6392026-05-01T20:14:51.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6402026-05-01T20:14:51.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6412026-05-01T20:14:51.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6422026-05-01T20:14:51.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6432026-05-01T20:14:51.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6442026-05-01T20:14:51.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6452026-05-01T20:14:51.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6462026-05-01T20:14:51.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6472026-05-01T20:14:51.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6482026-05-01T20:14:51.603ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855 producer_ip = fd00:1122:3344:101::b producer_port = 41867
6492026-05-01T20:14:51.603ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855 producer_ip = fd00:1122:3344:101::b producer_port = 41867
6502026-05-01T20:14:51.603ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c producer_ip = fd00:1122:3344:101::c producer_port = 35741
6512026-05-01T20:14:51.603ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c producer_ip = fd00:1122:3344:101::c producer_port = 35741
6522026-05-01T20:14:51.604ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 1 producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855 producer_ip = fd00:1122:3344:101::b producer_port = 41867
6532026-05-01T20:14:51.604ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c producer_ip = fd00:1122:3344:101::c producer_port = 35741
6542026-05-01T20:14:52.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6552026-05-01T20:14:52.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6562026-05-01T20:14:52.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6572026-05-01T20:14:52.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6582026-05-01T20:14:52.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6592026-05-01T20:14:52.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6602026-05-01T20:14:52.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6612026-05-01T20:14:52.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6622026-05-01T20:14:52.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6632026-05-01T20:14:53.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6642026-05-01T20:14:53.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6652026-05-01T20:14:53.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6662026-05-01T20:14:53.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6672026-05-01T20:14:53.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6682026-05-01T20:14:53.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6692026-05-01T20:14:53.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6702026-05-01T20:14:53.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6712026-05-01T20:14:53.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6722026-05-01T20:14:54.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6732026-05-01T20:14:54.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6742026-05-01T20:14:54.495ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6752026-05-01T20:14:54.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6762026-05-01T20:14:54.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6772026-05-01T20:14:54.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6782026-05-01T20:14:54.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6792026-05-01T20:14:54.499ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6802026-05-01T20:14:54.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6812026-05-01T20:14:55.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6822026-05-01T20:14:55.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6832026-05-01T20:14:55.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6842026-05-01T20:14:55.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6852026-05-01T20:14:55.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6862026-05-01T20:14:55.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6872026-05-01T20:14:55.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6882026-05-01T20:14:55.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6892026-05-01T20:14:55.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6902026-05-01T20:14:56.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 223
6912026-05-01T20:14:56.338ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 223
6922026-05-01T20:14:56.338ZDEBGoximeter (clickhouse-client): unrolling 223 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
6932026-05-01T20:14:56.345ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
6942026-05-01T20:14:56.352ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 62 table_name = fields_string
6952026-05-01T20:14:56.354ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 3 table_name = fields_u16
6962026-05-01T20:14:56.355ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 67 table_name = fields_uuid
6972026-05-01T20:14:56.357ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 160 table_name = measurements_cumulativeu64
6982026-05-01T20:14:56.359ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 3 table_name = measurements_histogramu64
6992026-05-01T20:14:56.360ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 60 table_name = measurements_u64
7002026-05-01T20:14:56.439ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
7012026-05-01T20:14:56.486ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
7022026-05-01T20:14:56.487ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending
7032026-05-01T20:14:56.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7042026-05-01T20:14:56.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7052026-05-01T20:14:56.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7062026-05-01T20:14:56.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7072026-05-01T20:14:56.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7082026-05-01T20:14:56.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7092026-05-01T20:14:56.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7102026-05-01T20:14:56.500ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
7112026-05-01T20:14:56.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7122026-05-01T20:14:56.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7132026-05-01T20:14:56.516ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e6bcee0-4b91-4210-9da9-ed2022f9425c", "content-length": "1412", "date": "Fri, 01 May 2026 20:14:56 GMT"} })
7142026-05-01T20:14:56.516ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYTJjYzBiYy0wYmU2LTRkYTktODQ4NC1hZDljODk2Mjk4NTUifX0%3D
7152026-05-01T20:14:56.518ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a45da2a2-5dab-42d7-8b58-037885b6fc50/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYTJjYzBiYy0wYmU2LTRkYTktODQ4NC1hZDljODk2Mjk4NTUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "00712c39-ec9c-43ae-be86-ca759684aa6d", "content-length": "29", "date": "Fri, 01 May 2026 20:14:56 GMT"} })
7162026-05-01T20:14:56.518ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:65486 collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 6d1cbcc1-1d2f-478f-9aa2-7845b47b94f6
7172026-05-01T20:14:56.518ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
7182026-05-01T20:14:56.519ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 6d1cbcc1-1d2f-478f-9aa2-7845b47b94f6 producer_ip = fd00:1122:3344:101::2 producer_port = 65486
7192026-05-01T20:14:56.519ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 6d1cbcc1-1d2f-478f-9aa2-7845b47b94f6 producer_ip = fd00:1122:3344:101::2 producer_port = 65486
7202026-05-01T20:14:56.519ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 6d1cbcc1-1d2f-478f-9aa2-7845b47b94f6 producer_ip = fd00:1122:3344:101::2 producer_port = 65486
7212026-05-01T20:14:56.527ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
7222026-05-01T20:14:56.527ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
7232026-05-01T20:14:56.531ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 6d1cbcc1-1d2f-478f-9aa2-7845b47b94f6 producer_ip = fd00:1122:3344:101::2 producer_port = 65486
7242026-05-01T20:14:56.531ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 8adac02b-b9ec-4e0b-8860-4be30d619e22 producer_ip = fd00:1122:3344:101::a producer_port = 50296
7252026-05-01T20:14:57.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7262026-05-01T20:14:57.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7272026-05-01T20:14:57.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7282026-05-01T20:14:57.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7292026-05-01T20:14:57.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7302026-05-01T20:14:57.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7312026-05-01T20:14:57.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7322026-05-01T20:14:57.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7332026-05-01T20:14:57.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7342026-05-01T20:14:58.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7352026-05-01T20:14:58.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7362026-05-01T20:14:58.495ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7372026-05-01T20:14:58.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7382026-05-01T20:14:58.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7392026-05-01T20:14:58.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7402026-05-01T20:14:58.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7412026-05-01T20:14:58.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7422026-05-01T20:14:58.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7432026-05-01T20:14:59.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7442026-05-01T20:14:59.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7452026-05-01T20:14:59.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7462026-05-01T20:14:59.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7472026-05-01T20:14:59.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7482026-05-01T20:14:59.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7492026-05-01T20:14:59.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7502026-05-01T20:14:59.499ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7512026-05-01T20:14:59.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7522026-05-01T20:15:00.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7532026-05-01T20:15:00.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7542026-05-01T20:15:00.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7552026-05-01T20:15:00.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7562026-05-01T20:15:00.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7572026-05-01T20:15:00.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7582026-05-01T20:15:00.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7592026-05-01T20:15:00.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7602026-05-01T20:15:00.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7612026-05-01T20:15:01.339ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 260
7622026-05-01T20:15:01.339ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_samples = 260
7632026-05-01T20:15:01.339ZDEBGoximeter (clickhouse-client): unrolling 260 total samples collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
7642026-05-01T20:15:01.347ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa
7652026-05-01T20:15:01.355ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 4 table_name = fields_ipaddr
7662026-05-01T20:15:01.356ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 134 table_name = fields_string
7672026-05-01T20:15:01.358ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 42 table_name = fields_u16
7682026-05-01T20:15:01.360ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 106 table_name = fields_uuid
7692026-05-01T20:15:01.361ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 162 table_name = measurements_cumulativeu64
7702026-05-01T20:15:01.363ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 38 table_name = measurements_histogramu64
7712026-05-01T20:15:01.365ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d id = 9311cd7a-0de6-465a-a7c6-6299b4f028fa n_rows = 60 table_name = measurements_u64
7722026-05-01T20:15:01.439ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
7732026-05-01T20:15:01.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7742026-05-01T20:15:01.493ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7752026-05-01T20:15:01.494ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7762026-05-01T20:15:01.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7772026-05-01T20:15:01.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7782026-05-01T20:15:01.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7792026-05-01T20:15:01.498ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7802026-05-01T20:15:01.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7812026-05-01T20:15:01.500ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7822026-05-01T20:15:01.604ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c producer_ip = fd00:1122:3344:101::c producer_port = 35741
7832026-05-01T20:15:01.604ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c producer_ip = fd00:1122:3344:101::c producer_port = 35741
7842026-05-01T20:15:01.604ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855 producer_ip = fd00:1122:3344:101::b producer_port = 41867
7852026-05-01T20:15:01.604ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855 producer_ip = fd00:1122:3344:101::b producer_port = 41867
7862026-05-01T20:15:01.604ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = ca2d3deb-b892-49e8-9f1d-e6865fcebe4c producer_ip = fd00:1122:3344:101::c producer_port = 35741
7872026-05-01T20:15:01.605ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = da2cc0bc-0be6-4da9-8484-ad9c89629855 producer_ip = fd00:1122:3344:101::b producer_port = 41867
7882026-05-01T20:15:02.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7892026-05-01T20:15:02.494ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7902026-05-01T20:15:02.495ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = b484f9ef-e199-4ce9-9b26-260e645150de producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7912026-05-01T20:15:02.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7922026-05-01T20:15:02.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7932026-05-01T20:15:02.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7942026-05-01T20:15:02.499ZDEBGoximeter (collection-task): collecting from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7952026-05-01T20:15:02.501ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 60d62086-b213-4a90-ab1d-156361d2636c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7962026-05-01T20:15:02.502ZDEBGoximeter (collection-task): collected results from producer collector_id = a45da2a2-5dab-42d7-8b58-037885b6fc50 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 49c14fdf-a26f-4686-b863-f53adb90cb5f producer_ip = fd00:1122:3344:101::1 producer_port = 8001