Max level shown:
1 [ Jul 29 16:42:36 Enabled. ]
2 [ Jul 29 16:42:36 Rereading configuration. ]
3 [ Jul 29 16:42:37 Rereading configuration. ]
4 [ Jul 29 16:42:41 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 &"). ]
5 [ Jul 29 16:42:41 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-07-29T16:42:41.331ZDEBGoximeter: registered DTrace probes
82026-07-29T16:42:41.331ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:299
92026-07-29T16:42:41.332ZDEBGoximeter: creating ClickHouse client
102026-07-29T16:42:41.347ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
112026-07-29T16:42:58.360ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 881f8560-f0f9-47e9-af09-45357d627220
122026-07-29T16:42:58.360ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d
132026-07-29T16:42:58.360ZINFOoximeter (clickhouse-client): reading db version collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:788 id = 881f8560-f0f9-47e9-af09-45357d627220
142026-07-29T16:42:58.361ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 881f8560-f0f9-47e9-af09-45357d627220
152026-07-29T16:42:58.362ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:793 id = 881f8560-f0f9-47e9-af09-45357d627220 version = 0
162026-07-29T16:42:58.362ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:798 id = 881f8560-f0f9-47e9-af09-45357d627220
172026-07-29T16:42:58.364ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
182026-07-29T16:42:58.489ZINFOoximeter (clickhouse-client): inserting current version collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:819 id = 881f8560-f0f9-47e9-af09-45357d627220 version = 14
192026-07-29T16:42:58.526ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = ab12b4a1-683e-439f-aea3-0712620e2640
202026-07-29T16:42:58.564ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-07-29T16:42:58.564ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-07-29T16:42:58.565ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-07-29T16:42:58.565ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-07-29T16:42:58.567ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-07-29T16:42:58.571ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-07-29T16:42:58.572ZDEBGoximeter: registered USDT probes
272026-07-29T16:42:58.572ZDEBGoximeter: contacting nexus
282026-07-29T16:42:58.630ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
292026-07-29T16:42:58.659ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "63486f92-ae0d-40f7-9f66-0664efdb1380", "date": "Wed, 29 Jul 2026 16:42:58 GMT"} })
302026-07-29T16:42:58.659ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:431 id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62
312026-07-29T16:42:58.659ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
322026-07-29T16:42:58.660ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
332026-07-29T16:42:58.662ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending
342026-07-29T16:42:58.681ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3c95920-db9c-410f-bc98-758e0861aed1", "content-length": "29", "date": "Wed, 29 Jul 2026 16:42:58 GMT"} })
352026-07-29T16:42:58.683ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 0 n_pruned_tasks = 0
362026-07-29T16:43:03.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 4
372026-07-29T16:43:03.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 4
382026-07-29T16:43:03.527ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
392026-07-29T16:43:03.528ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
402026-07-29T16:43:03.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:03.528378709Z } timeseries_name = oximeter_collector:database_queue_depth
412026-07-29T16:43:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:03.528372979Z } timeseries_name = oximeter_collector:database_samples_dropped
422026-07-29T16:43:03.530ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
432026-07-29T16:43:03.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
442026-07-29T16:43:03.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_string
452026-07-29T16:43:03.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_u16
462026-07-29T16:43:03.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_uuid
472026-07-29T16:43:03.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 2 table_name = measurements_cumulativeu64
482026-07-29T16:43:03.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 2 table_name = measurements_histogramu64
492026-07-29T16:43:03.629ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
502026-07-29T16:43:08.527ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d
512026-07-29T16:43:08.527ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d
522026-07-29T16:43:13.527ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d
532026-07-29T16:43:13.527ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d
542026-07-29T16:43:13.660ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
552026-07-29T16:43:13.660ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending
562026-07-29T16:43:13.683ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3105ff4-1101-408d-a513-9c22082644d3", "content-length": "300", "date": "Wed, 29 Jul 2026 16:43:13 GMT"} })
572026-07-29T16:43:13.690ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIxNmM1ZWMxYS1kMjcwLTQ0ZWQtYjY4YS0yN2Q1YjU1MzFlOGUifX0%3D
582026-07-29T16:43:13.698ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIxNmM1ZWMxYS1kMjcwLTQ0ZWQtYjY4YS0yN2Q1YjU1MzFlOGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "118325d5-a114-4ea3-aaa1-e0f6a50ddf17", "content-length": "29", "date": "Wed, 29 Jul 2026 16:43:13 GMT"} })
592026-07-29T16:43:13.698ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:38650 collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e
602026-07-29T16:43:13.698ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 1 n_pruned_tasks = 0
612026-07-29T16:43:14.119ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
622026-07-29T16:43:14.119ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
632026-07-29T16:43:14.153ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 18 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
642026-07-29T16:43:18.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 18
652026-07-29T16:43:18.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 18
662026-07-29T16:43:18.527ZDEBGoximeter (clickhouse-client): unrolling 18 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
672026-07-29T16:43:18.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
682026-07-29T16:43:18.533ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:18.527510796Z } timeseries_name = collection_target:cpus_provisioned
692026-07-29T16:43:18.533ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:18.527511916Z } timeseries_name = collection_target:ram_provisioned
702026-07-29T16:43:18.533ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:18.527514186Z } timeseries_name = collection_target:virtual_disk_space_provisioned
712026-07-29T16:43:18.533ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:18.527505456Z } timeseries_name = http_service:request_latency_histogram
722026-07-29T16:43:18.533ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
732026-07-29T16:43:18.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 24 table_name = fields_string
742026-07-29T16:43:18.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 12 table_name = fields_u16
752026-07-29T16:43:18.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 18 table_name = fields_uuid
762026-07-29T16:43:18.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 12 table_name = measurements_histogramu64
772026-07-29T16:43:18.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 6 table_name = measurements_i64
782026-07-29T16:43:18.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
792026-07-29T16:43:23.527ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d
802026-07-29T16:43:23.527ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d
812026-07-29T16:43:24.119ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
822026-07-29T16:43:24.119ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
832026-07-29T16:43:24.121ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 42 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
842026-07-29T16:43:28.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 42
852026-07-29T16:43:28.526ZDEBGoximeter (clickhouse-client): unrolling 42 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
862026-07-29T16:43:28.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 42
872026-07-29T16:43:28.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
882026-07-29T16:43:28.573ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 54 table_name = fields_string
892026-07-29T16:43:28.574ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 27 table_name = fields_u16
902026-07-29T16:43:28.576ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 35 table_name = fields_uuid
912026-07-29T16:43:28.578ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 27 table_name = measurements_histogramu64
922026-07-29T16:43:28.581ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 15 table_name = measurements_i64
932026-07-29T16:43:28.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
942026-07-29T16:43:28.660ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
952026-07-29T16:43:28.660ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending
962026-07-29T16:43:28.668ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b55aed86-e0f7-4944-8c0f-487afe42deec", "content-length": "585", "date": "Wed, 29 Jul 2026 16:43:28 GMT"} })
972026-07-29T16:43:28.668ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIxNmM1ZWMxYS1kMjcwLTQ0ZWQtYjY4YS0yN2Q1YjU1MzFlOGUifX0%3D
982026-07-29T16:43:28.684ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIxNmM1ZWMxYS1kMjcwLTQ0ZWQtYjY4YS0yN2Q1YjU1MzFlOGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cdebff5-23d8-46f0-9ed8-7d9d8befbb49", "content-length": "29", "date": "Wed, 29 Jul 2026 16:43:28 GMT"} })
992026-07-29T16:43:28.684ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:58633 collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3
1002026-07-29T16:43:28.684ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560
1012026-07-29T16:43:28.684ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 3 n_pruned_tasks = 0
1022026-07-29T16:43:29.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1032026-07-29T16:43:29.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1042026-07-29T16:43:29.075ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1052026-07-29T16:43:30.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1062026-07-29T16:43:30.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1072026-07-29T16:43:30.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1082026-07-29T16:43:31.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1092026-07-29T16:43:31.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1102026-07-29T16:43:31.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1112026-07-29T16:43:32.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1122026-07-29T16:43:32.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1132026-07-29T16:43:32.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1142026-07-29T16:43:32.525ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
1152026-07-29T16:43:33.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1162026-07-29T16:43:33.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1172026-07-29T16:43:33.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1182026-07-29T16:43:33.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 132
1192026-07-29T16:43:33.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 132
1202026-07-29T16:43:33.526ZDEBGoximeter (clickhouse-client): unrolling 132 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
1212026-07-29T16:43:33.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
1222026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526907998Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1232026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526904568Z } timeseries_name = ddm_router:originated_underlay_prefixes
1242026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526916728Z } timeseries_name = ddm_session:advertisements_received
1252026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526914468Z } timeseries_name = ddm_session:advertisements_sent
1262026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526953149Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1272026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526951709Z } timeseries_name = ddm_session:imported_underlay_prefixes
1282026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526941759Z } timeseries_name = ddm_session:peer_address_changes
1292026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526918938Z } timeseries_name = ddm_session:peer_expirations
1302026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526943828Z } timeseries_name = ddm_session:peer_sessions_established
1312026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526912788Z } timeseries_name = ddm_session:solicitations_received
1322026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526910358Z } timeseries_name = ddm_session:solicitations_sent
1332026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526948779Z } timeseries_name = ddm_session:update_send_fail
1342026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526947428Z } timeseries_name = ddm_session:updates_received
1352026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526945659Z } timeseries_name = ddm_session:updates_sent
1362026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526988640Z } timeseries_name = oximeter_collector:collections
1372026-07-29T16:43:33.529ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:43:33.526990770Z } timeseries_name = oximeter_collector:samples_collected
1382026-07-29T16:43:33.530ZDEBGoximeter (clickhouse-client): inserting 16 new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
1392026-07-29T16:43:33.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
1402026-07-29T16:43:33.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 52 table_name = fields_string
1412026-07-29T16:43:33.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_u16
1422026-07-29T16:43:33.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 56 table_name = fields_uuid
1432026-07-29T16:43:33.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 102 table_name = measurements_cumulativeu64
1442026-07-29T16:43:33.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 30 table_name = measurements_u64
1452026-07-29T16:43:33.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1462026-07-29T16:43:34.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1472026-07-29T16:43:34.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1482026-07-29T16:43:34.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1492026-07-29T16:43:34.119ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
1502026-07-29T16:43:34.119ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
1512026-07-29T16:43:34.121ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
1522026-07-29T16:43:35.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1532026-07-29T16:43:35.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1542026-07-29T16:43:35.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1552026-07-29T16:43:36.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1562026-07-29T16:43:36.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1572026-07-29T16:43:36.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1582026-07-29T16:43:37.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1592026-07-29T16:43:37.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1602026-07-29T16:43:37.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1612026-07-29T16:43:37.972ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
1622026-07-29T16:43:37.972ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
1632026-07-29T16:43:37.981ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
1642026-07-29T16:43:38.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1652026-07-29T16:43:38.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1662026-07-29T16:43:38.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1672026-07-29T16:43:38.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 168
1682026-07-29T16:43:38.527ZDEBGoximeter (clickhouse-client): unrolling 168 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
1692026-07-29T16:43:38.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 168
1702026-07-29T16:43:38.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
1712026-07-29T16:43:38.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 126 table_name = fields_string
1722026-07-29T16:43:38.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 38 table_name = fields_u16
1732026-07-29T16:43:38.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 90 table_name = fields_uuid
1742026-07-29T16:43:38.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 100 table_name = measurements_cumulativeu64
1752026-07-29T16:43:38.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 38 table_name = measurements_histogramu64
1762026-07-29T16:43:38.551ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 30 table_name = measurements_u64
1772026-07-29T16:43:38.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1782026-07-29T16:43:39.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1792026-07-29T16:43:39.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-07-29T16:43:39.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-07-29T16:43:40.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1822026-07-29T16:43:40.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1832026-07-29T16:43:40.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1842026-07-29T16:43:41.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1852026-07-29T16:43:41.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-07-29T16:43:41.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-07-29T16:43:41.722ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
1882026-07-29T16:43:42.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-07-29T16:43:42.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1902026-07-29T16:43:42.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1912026-07-29T16:43:43.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1922026-07-29T16:43:43.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1932026-07-29T16:43:43.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1942026-07-29T16:43:43.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 132
1952026-07-29T16:43:43.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 132
1962026-07-29T16:43:43.527ZDEBGoximeter (clickhouse-client): unrolling 132 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
1972026-07-29T16:43:43.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
1982026-07-29T16:43:43.532ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
1992026-07-29T16:43:43.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 52 table_name = fields_string
2002026-07-29T16:43:43.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_u16
2012026-07-29T16:43:43.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 56 table_name = fields_uuid
2022026-07-29T16:43:43.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 102 table_name = measurements_cumulativeu64
2032026-07-29T16:43:43.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 30 table_name = measurements_u64
2042026-07-29T16:43:43.627ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2052026-07-29T16:43:43.659ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
2062026-07-29T16:43:43.659ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending
2072026-07-29T16:43:43.664ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f0d3f4f-924e-40a9-a503-a5f1f9514612", "content-length": "726", "date": "Wed, 29 Jul 2026 16:43:43 GMT"} })
2082026-07-29T16:43:43.665ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4OTQyZDAwNC1lOWNmLTQwODMtYTFlZC1lYmFhOTQ5NjBkODcifX0%3D
2092026-07-29T16:43:43.668ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4OTQyZDAwNC1lOWNmLTQwODMtYTFlZC1lYmFhOTQ5NjBkODcifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "319a4070-ed8c-4cdf-9d47-8cf009d276fb", "content-length": "29", "date": "Wed, 29 Jul 2026 16:43:43 GMT"} })
2102026-07-29T16:43:43.668ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:50470 collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 8942d004-e9cf-4083-a1ed-ebaa94960d87
2112026-07-29T16:43:43.668ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 4 n_pruned_tasks = 0
2122026-07-29T16:43:44.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2132026-07-29T16:43:44.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2142026-07-29T16:43:44.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2152026-07-29T16:43:44.119ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
2162026-07-29T16:43:44.119ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
2172026-07-29T16:43:44.121ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
2182026-07-29T16:43:44.764ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2192026-07-29T16:43:45.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2202026-07-29T16:43:45.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2212026-07-29T16:43:45.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2222026-07-29T16:43:46.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2232026-07-29T16:43:46.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2242026-07-29T16:43:46.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2252026-07-29T16:43:47.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2262026-07-29T16:43:47.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2272026-07-29T16:43:47.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2282026-07-29T16:43:47.972ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
2292026-07-29T16:43:47.972ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
2302026-07-29T16:43:47.973ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
2312026-07-29T16:43:48.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2322026-07-29T16:43:48.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2332026-07-29T16:43:48.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2342026-07-29T16:43:48.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 170
2352026-07-29T16:43:48.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 170
2362026-07-29T16:43:48.527ZDEBGoximeter (clickhouse-client): unrolling 170 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
2372026-07-29T16:43:48.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
2382026-07-29T16:43:48.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
2392026-07-29T16:43:48.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 128 table_name = fields_string
2402026-07-29T16:43:48.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 42 table_name = fields_u16
2412026-07-29T16:43:48.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 94 table_name = fields_uuid
2422026-07-29T16:43:48.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 102 table_name = measurements_cumulativeu64
2432026-07-29T16:43:48.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 38 table_name = measurements_histogramu64
2442026-07-29T16:43:48.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 30 table_name = measurements_u64
2452026-07-29T16:43:48.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2462026-07-29T16:43:49.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2472026-07-29T16:43:49.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2482026-07-29T16:43:49.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2492026-07-29T16:43:50.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2502026-07-29T16:43:50.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2512026-07-29T16:43:50.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2522026-07-29T16:43:51.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2532026-07-29T16:43:51.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2542026-07-29T16:43:51.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2552026-07-29T16:43:52.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2562026-07-29T16:43:52.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2572026-07-29T16:43:52.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2582026-07-29T16:43:53.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2592026-07-29T16:43:53.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2602026-07-29T16:43:53.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2612026-07-29T16:43:53.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 130
2622026-07-29T16:43:53.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 130
2632026-07-29T16:43:53.527ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
2642026-07-29T16:43:53.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
2652026-07-29T16:43:53.531ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 50 table_name = fields_string
2662026-07-29T16:43:53.532ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 52 table_name = fields_uuid
2672026-07-29T16:43:53.534ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 100 table_name = measurements_cumulativeu64
2682026-07-29T16:43:53.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 30 table_name = measurements_u64
2692026-07-29T16:43:53.627ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2702026-07-29T16:43:54.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2712026-07-29T16:43:54.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2722026-07-29T16:43:54.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2732026-07-29T16:43:54.119ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
2742026-07-29T16:43:54.119ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
2752026-07-29T16:43:54.122ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
2762026-07-29T16:43:55.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2772026-07-29T16:43:55.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2782026-07-29T16:43:55.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2792026-07-29T16:43:56.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2802026-07-29T16:43:56.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2812026-07-29T16:43:56.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2822026-07-29T16:43:57.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2832026-07-29T16:43:57.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-07-29T16:43:57.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2852026-07-29T16:43:57.971ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
2862026-07-29T16:43:57.971ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
2872026-07-29T16:43:57.973ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
2882026-07-29T16:43:58.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2892026-07-29T16:43:58.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2902026-07-29T16:43:58.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2912026-07-29T16:43:58.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 168
2922026-07-29T16:43:58.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 168
2932026-07-29T16:43:58.526ZDEBGoximeter (clickhouse-client): unrolling 168 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
2942026-07-29T16:43:58.526ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
2952026-07-29T16:43:58.532ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 126 table_name = fields_string
2962026-07-29T16:43:58.534ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 38 table_name = fields_u16
2972026-07-29T16:43:58.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 90 table_name = fields_uuid
2982026-07-29T16:43:58.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 100 table_name = measurements_cumulativeu64
2992026-07-29T16:43:58.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 38 table_name = measurements_histogramu64
3002026-07-29T16:43:58.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 30 table_name = measurements_u64
3012026-07-29T16:43:58.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3022026-07-29T16:43:58.659ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
3032026-07-29T16:43:58.659ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending
3042026-07-29T16:43:58.664ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "ced39e5c-2712-41e0-8775-b716bddc494a", "content-length": "1276", "date": "Wed, 29 Jul 2026 16:43:58 GMT"} })
3052026-07-29T16:43:58.664ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzVhNjQ5Ny1iZGI5LTQ5NWItOGQyMi01ZTU4YTE4MzE5MzkifX0%3D
3062026-07-29T16:43:58.667ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzVhNjQ5Ny1iZGI5LTQ5NWItOGQyMi01ZTU4YTE4MzE5MzkifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea3a3554-c4b2-438e-8870-7b37324bd4f0", "content-length": "29", "date": "Wed, 29 Jul 2026 16:43:58 GMT"} })
3072026-07-29T16:43:58.667ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8
3082026-07-29T16:43:58.667ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:59729 collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5
3092026-07-29T16:43:58.667ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:45133 collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40
3102026-07-29T16:43:58.667ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:60790 collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939
3112026-07-29T16:43:58.667ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 8 n_pruned_tasks = 0
3122026-07-29T16:43:58.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3132026-07-29T16:43:58.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3142026-07-29T16:43:58.983ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3152026-07-29T16:43:59.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3162026-07-29T16:43:59.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-07-29T16:43:59.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-07-29T16:43:59.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3192026-07-29T16:43:59.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3202026-07-29T16:43:59.978ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3212026-07-29T16:44:00.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3222026-07-29T16:44:00.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3232026-07-29T16:44:00.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3242026-07-29T16:44:00.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3252026-07-29T16:44:00.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3262026-07-29T16:44:00.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3272026-07-29T16:44:01.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3282026-07-29T16:44:01.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3292026-07-29T16:44:01.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3302026-07-29T16:44:01.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3312026-07-29T16:44:01.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3322026-07-29T16:44:01.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3332026-07-29T16:44:02.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3342026-07-29T16:44:02.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3352026-07-29T16:44:02.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3362026-07-29T16:44:02.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3372026-07-29T16:44:02.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3382026-07-29T16:44:02.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3392026-07-29T16:44:03.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3402026-07-29T16:44:03.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3412026-07-29T16:44:03.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3422026-07-29T16:44:03.304ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
3432026-07-29T16:44:03.304ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
3442026-07-29T16:44:03.325ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
3452026-07-29T16:44:03.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 294
3462026-07-29T16:44:03.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 294
3472026-07-29T16:44:03.527ZDEBGoximeter (clickhouse-client): unrolling 294 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
3482026-07-29T16:44:03.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
3492026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527358431Z } timeseries_name = dendrite:sample_collection_duration
3502026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527196447Z } timeseries_name = mg_lower:routes_blocked_by_link_state
3512026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527192277Z } timeseries_name = static_routing_config:static_nexthops
3522026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527190297Z } timeseries_name = static_routing_config:static_routes
3532026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527274279Z } timeseries_name = switch_data_link:link_enabled
3542026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527279839Z } timeseries_name = switch_data_link:link_up
3552026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527194227Z } timeseries_name = switch_rib:active_routes
3562026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527285409Z } timeseries_name = switch_table:capacity
3572026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527302620Z } timeseries_name = switch_table:collisions
3582026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527310370Z } timeseries_name = switch_table:delete_misses
3592026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527296219Z } timeseries_name = switch_table:deletes
3602026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527315090Z } timeseries_name = switch_table:exhaustion
3612026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527292799Z } timeseries_name = switch_table:inserts
3622026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527289389Z } timeseries_name = switch_table:occupancy
3632026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527306809Z } timeseries_name = switch_table:update_misses
3642026-07-29T16:44:03.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:03.527299679Z } timeseries_name = switch_table:updates
3652026-07-29T16:44:03.534ZDEBGoximeter (clickhouse-client): inserting 16 new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
3662026-07-29T16:44:03.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 280 table_name = fields_i16
3672026-07-29T16:44:03.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
3682026-07-29T16:44:03.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 779 table_name = fields_string
3692026-07-29T16:44:03.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 144 table_name = fields_u16
3702026-07-29T16:44:03.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 145 table_name = fields_u32
3712026-07-29T16:44:03.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 144 table_name = fields_u8
3722026-07-29T16:44:03.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 484 table_name = fields_uuid
3732026-07-29T16:44:03.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = measurements_bool
3742026-07-29T16:44:03.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 217 table_name = measurements_cumulativeu64
3752026-07-29T16:44:03.550ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 1 table_name = measurements_f64
3762026-07-29T16:44:03.552ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 2 table_name = measurements_histogramu64
3772026-07-29T16:44:03.553ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 70 table_name = measurements_u64
3782026-07-29T16:44:03.627ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3792026-07-29T16:44:03.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3802026-07-29T16:44:03.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3812026-07-29T16:44:03.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3822026-07-29T16:44:04.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3832026-07-29T16:44:04.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3842026-07-29T16:44:04.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3852026-07-29T16:44:04.118ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
3862026-07-29T16:44:04.118ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
3872026-07-29T16:44:04.120ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
3882026-07-29T16:44:04.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3892026-07-29T16:44:04.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3902026-07-29T16:44:04.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3912026-07-29T16:44:05.031ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 8942d004-e9cf-4083-a1ed-ebaa94960d87 producer_ip = fd00:1122:3344:101::1 producer_port = 50470
3922026-07-29T16:44:05.031ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 8942d004-e9cf-4083-a1ed-ebaa94960d87 producer_ip = fd00:1122:3344:101::1 producer_port = 50470
3932026-07-29T16:44:05.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3942026-07-29T16:44:05.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3952026-07-29T16:44:05.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3962026-07-29T16:44:05.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 7158 producer_id = 8942d004-e9cf-4083-a1ed-ebaa94960d87 producer_ip = fd00:1122:3344:101::1 producer_port = 50470
3972026-07-29T16:44:05.261ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 7245
3982026-07-29T16:44:05.261ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 7245
3992026-07-29T16:44:05.261ZDEBGoximeter (clickhouse-client): unrolling 7245 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
4002026-07-29T16:44:05.262ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
4012026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:expired_targets"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.262690674Z } timeseries_name = kstat_sampler:expired_targets
4022026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.261734792Z } timeseries_name = sled_cpu:cpu_nsec
4032026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.261682401Z } timeseries_name = sled_data_link:bytes_received
4042026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.261686151Z } timeseries_name = sled_data_link:bytes_sent
4052026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.261678361Z } timeseries_name = sled_data_link:errors_received
4062026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.261680471Z } timeseries_name = sled_data_link:errors_sent
4072026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.261684391Z } timeseries_name = sled_data_link:packets_received
4082026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.261690101Z } timeseries_name = sled_data_link:packets_sent
4092026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.262710885Z } timeseries_name = zfs_dataset:bytes_used
4102026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.262698074Z } timeseries_name = zfs_pool:bytes_allocated
4112026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.262700304Z } timeseries_name = zfs_pool:bytes_total
4122026-07-29T16:44:05.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:05.262213633Z } timeseries_name = zone:cpu_nsec
4132026-07-29T16:44:05.298ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
4142026-07-29T16:44:05.303ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 3316 table_name = fields_string
4152026-07-29T16:44:05.304ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 38 table_name = fields_u16
4162026-07-29T16:44:05.306ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 953 table_name = fields_u32
4172026-07-29T16:44:05.308ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 1895 table_name = fields_uuid
4182026-07-29T16:44:05.312ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 6735 table_name = measurements_cumulativeu64
4192026-07-29T16:44:05.314ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 38 table_name = measurements_histogramu64
4202026-07-29T16:44:05.315ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 472 table_name = measurements_u64
4212026-07-29T16:44:05.361ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4222026-07-29T16:44:05.559ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
4232026-07-29T16:44:05.559ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
4242026-07-29T16:44:05.565ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 4 producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
4252026-07-29T16:44:05.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4262026-07-29T16:44:05.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4272026-07-29T16:44:05.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4282026-07-29T16:44:06.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4292026-07-29T16:44:06.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4302026-07-29T16:44:06.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4312026-07-29T16:44:06.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4322026-07-29T16:44:06.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4332026-07-29T16:44:06.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4342026-07-29T16:44:07.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4352026-07-29T16:44:07.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4362026-07-29T16:44:07.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4372026-07-29T16:44:07.464ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
4382026-07-29T16:44:07.464ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
4392026-07-29T16:44:07.477ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
4402026-07-29T16:44:07.972ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
4412026-07-29T16:44:07.972ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
4422026-07-29T16:44:07.973ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
4432026-07-29T16:44:07.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4442026-07-29T16:44:07.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4452026-07-29T16:44:07.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4462026-07-29T16:44:08.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4472026-07-29T16:44:08.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4482026-07-29T16:44:08.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4492026-07-29T16:44:08.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 110
4502026-07-29T16:44:08.526ZDEBGoximeter (clickhouse-client): unrolling 110 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
4512026-07-29T16:44:08.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 110
4522026-07-29T16:44:08.526ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
4532026-07-29T16:44:08.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 82 table_name = fields_string
4542026-07-29T16:44:08.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 14 table_name = fields_u16
4552026-07-29T16:44:08.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 80 table_name = fields_uuid
4562026-07-29T16:44:08.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 66 table_name = measurements_cumulativeu64
4572026-07-29T16:44:08.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 14 table_name = measurements_histogramu64
4582026-07-29T16:44:08.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 6 table_name = measurements_i64
4592026-07-29T16:44:08.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 24 table_name = measurements_u64
4602026-07-29T16:44:08.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4612026-07-29T16:44:08.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4622026-07-29T16:44:08.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4632026-07-29T16:44:08.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4642026-07-29T16:44:09.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4652026-07-29T16:44:09.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4662026-07-29T16:44:09.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4672026-07-29T16:44:09.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4682026-07-29T16:44:09.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4692026-07-29T16:44:09.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4702026-07-29T16:44:10.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4712026-07-29T16:44:10.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4722026-07-29T16:44:10.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4732026-07-29T16:44:10.779ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
4742026-07-29T16:44:10.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4752026-07-29T16:44:10.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4762026-07-29T16:44:10.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4772026-07-29T16:44:11.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4782026-07-29T16:44:11.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4792026-07-29T16:44:11.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4802026-07-29T16:44:11.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4812026-07-29T16:44:11.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4822026-07-29T16:44:11.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4832026-07-29T16:44:12.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4842026-07-29T16:44:12.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4852026-07-29T16:44:12.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4862026-07-29T16:44:12.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4872026-07-29T16:44:12.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4882026-07-29T16:44:12.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4892026-07-29T16:44:13.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4902026-07-29T16:44:13.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4912026-07-29T16:44:13.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4922026-07-29T16:44:13.304ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
4932026-07-29T16:44:13.304ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
4942026-07-29T16:44:13.312ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
4952026-07-29T16:44:13.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 292
4962026-07-29T16:44:13.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 292
4972026-07-29T16:44:13.527ZDEBGoximeter (clickhouse-client): unrolling 292 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
4982026-07-29T16:44:13.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
4992026-07-29T16:44:13.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 280 table_name = fields_i16
5002026-07-29T16:44:13.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
5012026-07-29T16:44:13.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 777 table_name = fields_string
5022026-07-29T16:44:13.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 144 table_name = fields_u16
5032026-07-29T16:44:13.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 145 table_name = fields_u32
5042026-07-29T16:44:13.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 144 table_name = fields_u8
5052026-07-29T16:44:13.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 484 table_name = fields_uuid
5062026-07-29T16:44:13.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = measurements_bool
5072026-07-29T16:44:13.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 217 table_name = measurements_cumulativeu64
5082026-07-29T16:44:13.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 1 table_name = measurements_f64
5092026-07-29T16:44:13.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 70 table_name = measurements_u64
5102026-07-29T16:44:13.629ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5112026-07-29T16:44:13.660ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
5122026-07-29T16:44:13.660ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending
5132026-07-29T16:44:13.664ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9f1b089-b4b1-4f69-96b2-7b52294aa3f9", "content-length": "1276", "date": "Wed, 29 Jul 2026 16:44:13 GMT"} })
5142026-07-29T16:44:13.664ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzVhNjQ5Ny1iZGI5LTQ5NWItOGQyMi01ZTU4YTE4MzE5MzkifX0%3D
5152026-07-29T16:44:13.667ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzVhNjQ5Ny1iZGI5LTQ5NWItOGQyMi01ZTU4YTE4MzE5MzkifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1172ffc-9db5-4b32-adba-c4ac2748e566", "content-length": "29", "date": "Wed, 29 Jul 2026 16:44:13 GMT"} })
5162026-07-29T16:44:13.667ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:41748 collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5
5172026-07-29T16:44:13.667ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
5182026-07-29T16:44:13.667ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 8 n_pruned_tasks = 0
5192026-07-29T16:44:13.667ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:41748 collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
5202026-07-29T16:44:13.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5212026-07-29T16:44:13.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5222026-07-29T16:44:13.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5232026-07-29T16:44:14.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5242026-07-29T16:44:14.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5252026-07-29T16:44:14.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5262026-07-29T16:44:14.118ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
5272026-07-29T16:44:14.118ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
5282026-07-29T16:44:14.121ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
5292026-07-29T16:44:14.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5302026-07-29T16:44:14.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5312026-07-29T16:44:14.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5322026-07-29T16:44:15.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5332026-07-29T16:44:15.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5342026-07-29T16:44:15.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5352026-07-29T16:44:15.560ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
5362026-07-29T16:44:15.560ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
5372026-07-29T16:44:15.560ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 1 producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
5382026-07-29T16:44:15.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5392026-07-29T16:44:15.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5402026-07-29T16:44:15.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5412026-07-29T16:44:16.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5422026-07-29T16:44:16.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5432026-07-29T16:44:16.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5442026-07-29T16:44:16.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5452026-07-29T16:44:16.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5462026-07-29T16:44:16.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5472026-07-29T16:44:17.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5482026-07-29T16:44:17.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5492026-07-29T16:44:17.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5502026-07-29T16:44:17.464ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
5512026-07-29T16:44:17.464ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
5522026-07-29T16:44:17.465ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
5532026-07-29T16:44:17.972ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
5542026-07-29T16:44:17.972ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
5552026-07-29T16:44:17.974ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
5562026-07-29T16:44:17.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5572026-07-29T16:44:17.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5582026-07-29T16:44:17.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5592026-07-29T16:44:18.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5602026-07-29T16:44:18.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5612026-07-29T16:44:18.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5622026-07-29T16:44:18.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 191
5632026-07-29T16:44:18.526ZDEBGoximeter (clickhouse-client): unrolling 191 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
5642026-07-29T16:44:18.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 191
5652026-07-29T16:44:18.526ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
5662026-07-29T16:44:18.532ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 136 table_name = fields_string
5672026-07-29T16:44:18.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 41 table_name = fields_u16
5682026-07-29T16:44:18.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 101 table_name = fields_uuid
5692026-07-29T16:44:18.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 110 table_name = measurements_cumulativeu64
5702026-07-29T16:44:18.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 41 table_name = measurements_histogramu64
5712026-07-29T16:44:18.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 40 table_name = measurements_u64
5722026-07-29T16:44:18.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5732026-07-29T16:44:18.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5742026-07-29T16:44:18.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5752026-07-29T16:44:18.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5762026-07-29T16:44:19.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5772026-07-29T16:44:19.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5782026-07-29T16:44:19.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5792026-07-29T16:44:19.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5802026-07-29T16:44:19.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5812026-07-29T16:44:19.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5822026-07-29T16:44:20.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5832026-07-29T16:44:20.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5842026-07-29T16:44:20.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5852026-07-29T16:44:20.297ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
5862026-07-29T16:44:20.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5872026-07-29T16:44:20.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5882026-07-29T16:44:20.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5892026-07-29T16:44:21.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5902026-07-29T16:44:21.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5912026-07-29T16:44:21.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5922026-07-29T16:44:21.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5932026-07-29T16:44:21.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5942026-07-29T16:44:21.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5952026-07-29T16:44:22.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5962026-07-29T16:44:22.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5972026-07-29T16:44:22.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5982026-07-29T16:44:22.570ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 8942d004-e9cf-4083-a1ed-ebaa94960d87 producer_ip = fd00:1122:3344:101::1 producer_port = 50470
5992026-07-29T16:44:22.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6002026-07-29T16:44:22.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6012026-07-29T16:44:22.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6022026-07-29T16:44:23.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6032026-07-29T16:44:23.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6042026-07-29T16:44:23.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6052026-07-29T16:44:23.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 154
6062026-07-29T16:44:23.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 154
6072026-07-29T16:44:23.526ZDEBGoximeter (clickhouse-client): unrolling 154 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
6082026-07-29T16:44:23.526ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
6092026-07-29T16:44:23.531ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 8 table_name = fields_ipaddr
6102026-07-29T16:44:23.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 58 table_name = fields_string
6112026-07-29T16:44:23.534ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 8 table_name = fields_u16
6122026-07-29T16:44:23.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 68 table_name = fields_uuid
6132026-07-29T16:44:23.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 114 table_name = measurements_cumulativeu64
6142026-07-29T16:44:23.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 40 table_name = measurements_u64
6152026-07-29T16:44:23.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6162026-07-29T16:44:23.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6172026-07-29T16:44:23.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6182026-07-29T16:44:23.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6192026-07-29T16:44:24.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6202026-07-29T16:44:24.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6212026-07-29T16:44:24.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6222026-07-29T16:44:24.119ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
6232026-07-29T16:44:24.119ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
6242026-07-29T16:44:24.121ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
6252026-07-29T16:44:24.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6262026-07-29T16:44:24.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6272026-07-29T16:44:24.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6282026-07-29T16:44:25.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6292026-07-29T16:44:25.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6302026-07-29T16:44:25.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6312026-07-29T16:44:25.560ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
6322026-07-29T16:44:25.560ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
6332026-07-29T16:44:25.560ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 1 producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
6342026-07-29T16:44:25.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6352026-07-29T16:44:25.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6362026-07-29T16:44:25.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6372026-07-29T16:44:26.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6382026-07-29T16:44:26.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6392026-07-29T16:44:26.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6402026-07-29T16:44:26.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6412026-07-29T16:44:26.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6422026-07-29T16:44:26.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6432026-07-29T16:44:27.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6442026-07-29T16:44:27.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6452026-07-29T16:44:27.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6462026-07-29T16:44:27.465ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
6472026-07-29T16:44:27.465ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
6482026-07-29T16:44:27.466ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
6492026-07-29T16:44:27.972ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
6502026-07-29T16:44:27.972ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
6512026-07-29T16:44:27.974ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
6522026-07-29T16:44:27.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6532026-07-29T16:44:27.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6542026-07-29T16:44:27.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6552026-07-29T16:44:28.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6562026-07-29T16:44:28.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6572026-07-29T16:44:28.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6582026-07-29T16:44:28.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 191
6592026-07-29T16:44:28.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 191
6602026-07-29T16:44:28.526ZDEBGoximeter (clickhouse-client): unrolling 191 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
6612026-07-29T16:44:28.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
6622026-07-29T16:44:28.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 136 table_name = fields_string
6632026-07-29T16:44:28.534ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 41 table_name = fields_u16
6642026-07-29T16:44:28.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 101 table_name = fields_uuid
6652026-07-29T16:44:28.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 110 table_name = measurements_cumulativeu64
6662026-07-29T16:44:28.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 41 table_name = measurements_histogramu64
6672026-07-29T16:44:28.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 40 table_name = measurements_u64
6682026-07-29T16:44:28.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6692026-07-29T16:44:28.660ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
6702026-07-29T16:44:28.660ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending
6712026-07-29T16:44:28.664ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f18b0ad-4db3-4266-8044-a5a5db8aab58", "content-length": "1276", "date": "Wed, 29 Jul 2026 16:44:28 GMT"} })
6722026-07-29T16:44:28.664ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzVhNjQ5Ny1iZGI5LTQ5NWItOGQyMi01ZTU4YTE4MzE5MzkifX0%3D
6732026-07-29T16:44:28.667ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzVhNjQ5Ny1iZGI5LTQ5NWItOGQyMi01ZTU4YTE4MzE5MzkifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "9689eaab-8461-4f2a-ae26-c900e4b1381a", "content-length": "29", "date": "Wed, 29 Jul 2026 16:44:28 GMT"} })
6742026-07-29T16:44:28.667ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 8 n_pruned_tasks = 0
6752026-07-29T16:44:28.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6762026-07-29T16:44:28.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6772026-07-29T16:44:28.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6782026-07-29T16:44:29.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6792026-07-29T16:44:29.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6802026-07-29T16:44:29.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6812026-07-29T16:44:29.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6822026-07-29T16:44:29.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6832026-07-29T16:44:29.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6842026-07-29T16:44:30.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6852026-07-29T16:44:30.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6862026-07-29T16:44:30.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6872026-07-29T16:44:30.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6882026-07-29T16:44:30.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6892026-07-29T16:44:30.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6902026-07-29T16:44:31.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6912026-07-29T16:44:31.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6922026-07-29T16:44:31.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6932026-07-29T16:44:31.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6942026-07-29T16:44:31.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6952026-07-29T16:44:31.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6962026-07-29T16:44:32.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6972026-07-29T16:44:32.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6982026-07-29T16:44:32.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6992026-07-29T16:44:32.525ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
7002026-07-29T16:44:32.977ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7012026-07-29T16:44:32.977ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7022026-07-29T16:44:32.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7032026-07-29T16:44:33.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7042026-07-29T16:44:33.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7052026-07-29T16:44:33.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7062026-07-29T16:44:33.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 152
7072026-07-29T16:44:33.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 152
7082026-07-29T16:44:33.526ZDEBGoximeter (clickhouse-client): unrolling 152 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
7092026-07-29T16:44:33.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
7102026-07-29T16:44:33.531ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
7112026-07-29T16:44:33.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 56 table_name = fields_string
7122026-07-29T16:44:33.534ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_u16
7132026-07-29T16:44:33.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 64 table_name = fields_uuid
7142026-07-29T16:44:33.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 112 table_name = measurements_cumulativeu64
7152026-07-29T16:44:33.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 40 table_name = measurements_u64
7162026-07-29T16:44:33.627ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7172026-07-29T16:44:33.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7182026-07-29T16:44:33.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7192026-07-29T16:44:33.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7202026-07-29T16:44:34.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7212026-07-29T16:44:34.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7222026-07-29T16:44:34.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7232026-07-29T16:44:34.118ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
7242026-07-29T16:44:34.118ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
7252026-07-29T16:44:34.121ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
7262026-07-29T16:44:34.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7272026-07-29T16:44:34.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7282026-07-29T16:44:34.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7292026-07-29T16:44:35.031ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 8942d004-e9cf-4083-a1ed-ebaa94960d87 producer_ip = fd00:1122:3344:101::1 producer_port = 50470
7302026-07-29T16:44:35.031ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 8942d004-e9cf-4083-a1ed-ebaa94960d87 producer_ip = fd00:1122:3344:101::1 producer_port = 50470
7312026-07-29T16:44:35.050ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1694 producer_id = 8942d004-e9cf-4083-a1ed-ebaa94960d87 producer_ip = fd00:1122:3344:101::1 producer_port = 50470
7322026-07-29T16:44:35.053ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 1755
7332026-07-29T16:44:35.053ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 1755
7342026-07-29T16:44:35.053ZDEBGoximeter (clickhouse-client): unrolling 1755 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
7352026-07-29T16:44:35.053ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
7362026-07-29T16:44:35.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7372026-07-29T16:44:35.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7382026-07-29T16:44:35.069ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 2455 table_name = fields_string
7392026-07-29T16:44:35.071ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 38 table_name = fields_u16
7402026-07-29T16:44:35.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7412026-07-29T16:44:35.072ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 801 table_name = fields_u32
7422026-07-29T16:44:35.074ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 1313 table_name = fields_uuid
7432026-07-29T16:44:35.076ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 1707 table_name = measurements_cumulativeu64
7442026-07-29T16:44:35.078ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 38 table_name = measurements_histogramu64
7452026-07-29T16:44:35.079ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 10 table_name = measurements_u64
7462026-07-29T16:44:35.153ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7472026-07-29T16:44:35.559ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
7482026-07-29T16:44:35.559ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
7492026-07-29T16:44:35.560ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 1 producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
7502026-07-29T16:44:35.943ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7512026-07-29T16:44:35.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7522026-07-29T16:44:35.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7532026-07-29T16:44:35.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7542026-07-29T16:44:36.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7552026-07-29T16:44:36.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7562026-07-29T16:44:36.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7572026-07-29T16:44:36.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7582026-07-29T16:44:36.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7592026-07-29T16:44:36.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7602026-07-29T16:44:37.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7612026-07-29T16:44:37.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7622026-07-29T16:44:37.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7632026-07-29T16:44:37.464ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
7642026-07-29T16:44:37.464ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
7652026-07-29T16:44:37.465ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
7662026-07-29T16:44:37.971ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
7672026-07-29T16:44:37.971ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
7682026-07-29T16:44:37.972ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
7692026-07-29T16:44:37.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7702026-07-29T16:44:37.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7712026-07-29T16:44:37.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7722026-07-29T16:44:38.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7732026-07-29T16:44:38.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7742026-07-29T16:44:38.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7752026-07-29T16:44:38.329ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
7762026-07-29T16:44:38.329ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
7772026-07-29T16:44:38.354ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 384 producer_id = c2ad9f3f-b9c9-4a13-ab3d-02f04f065ea5 producer_ip = fd00:1122:3344:101::2 producer_port = 59729
7782026-07-29T16:44:38.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 516
7792026-07-29T16:44:38.527ZDEBGoximeter (clickhouse-client): unrolling 516 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
7802026-07-29T16:44:38.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 516
7812026-07-29T16:44:38.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
7822026-07-29T16:44:38.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:38.527236175Z } timeseries_name = switch_port_control_data_link:bytes_received
7832026-07-29T16:44:38.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:38.527249035Z } timeseries_name = switch_port_control_data_link:bytes_sent
7842026-07-29T16:44:38.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:38.527218055Z } timeseries_name = switch_port_control_data_link:errors_received
7852026-07-29T16:44:38.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:38.527223785Z } timeseries_name = switch_port_control_data_link:errors_sent
7862026-07-29T16:44:38.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:38.527242955Z } timeseries_name = switch_port_control_data_link:packets_received
7872026-07-29T16:44:38.530ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T16:44:38.527254945Z } timeseries_name = switch_port_control_data_link:packets_sent
7882026-07-29T16:44:38.533ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
7892026-07-29T16:44:38.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 24 table_name = fields_i16
7902026-07-29T16:44:38.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
7912026-07-29T16:44:38.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 204 table_name = fields_string
7922026-07-29T16:44:38.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 30 table_name = fields_u16
7932026-07-29T16:44:38.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 24 table_name = fields_u32
7942026-07-29T16:44:38.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 12 table_name = fields_u8
7952026-07-29T16:44:38.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 114 table_name = fields_uuid
7962026-07-29T16:44:38.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 472 table_name = measurements_cumulativeu64
7972026-07-29T16:44:38.551ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 14 table_name = measurements_histogramu64
7982026-07-29T16:44:38.553ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 30 table_name = measurements_u64
7992026-07-29T16:44:38.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8002026-07-29T16:44:38.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8012026-07-29T16:44:38.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8022026-07-29T16:44:38.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8032026-07-29T16:44:39.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8042026-07-29T16:44:39.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8052026-07-29T16:44:39.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8062026-07-29T16:44:39.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8072026-07-29T16:44:39.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8082026-07-29T16:44:39.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8092026-07-29T16:44:40.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8102026-07-29T16:44:40.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8112026-07-29T16:44:40.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8122026-07-29T16:44:40.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8132026-07-29T16:44:40.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8142026-07-29T16:44:40.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8152026-07-29T16:44:41.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8162026-07-29T16:44:41.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8172026-07-29T16:44:41.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8182026-07-29T16:44:41.721ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
8192026-07-29T16:44:41.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8202026-07-29T16:44:41.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8212026-07-29T16:44:41.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8222026-07-29T16:44:42.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8232026-07-29T16:44:42.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8242026-07-29T16:44:42.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8252026-07-29T16:44:42.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8262026-07-29T16:44:42.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8272026-07-29T16:44:42.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8282026-07-29T16:44:43.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8292026-07-29T16:44:43.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8302026-07-29T16:44:43.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8312026-07-29T16:44:43.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 152
8322026-07-29T16:44:43.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 152
8332026-07-29T16:44:43.526ZDEBGoximeter (clickhouse-client): unrolling 152 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
8342026-07-29T16:44:43.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
8352026-07-29T16:44:43.531ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
8362026-07-29T16:44:43.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 56 table_name = fields_string
8372026-07-29T16:44:43.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_u16
8382026-07-29T16:44:43.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 64 table_name = fields_uuid
8392026-07-29T16:44:43.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 112 table_name = measurements_cumulativeu64
8402026-07-29T16:44:43.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 40 table_name = measurements_u64
8412026-07-29T16:44:43.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8422026-07-29T16:44:43.660ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
8432026-07-29T16:44:43.660ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending
8442026-07-29T16:44:43.663ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a048760-af91-4dca-87d3-ef9d7fdaa32b", "content-length": "1276", "date": "Wed, 29 Jul 2026 16:44:43 GMT"} })
8452026-07-29T16:44:43.663ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzVhNjQ5Ny1iZGI5LTQ5NWItOGQyMi01ZTU4YTE4MzE5MzkifX0%3D
8462026-07-29T16:44:43.666ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzVhNjQ5Ny1iZGI5LTQ5NWItOGQyMi01ZTU4YTE4MzE5MzkifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fc498cf-58da-47cb-b109-11f23d28a100", "content-length": "29", "date": "Wed, 29 Jul 2026 16:44:43 GMT"} })
8472026-07-29T16:44:43.666ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 8 n_pruned_tasks = 0
8482026-07-29T16:44:43.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8492026-07-29T16:44:43.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8502026-07-29T16:44:43.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8512026-07-29T16:44:44.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8522026-07-29T16:44:44.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8532026-07-29T16:44:44.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8542026-07-29T16:44:44.118ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
8552026-07-29T16:44:44.118ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
8562026-07-29T16:44:44.121ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
8572026-07-29T16:44:44.765ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8582026-07-29T16:44:44.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8592026-07-29T16:44:44.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8602026-07-29T16:44:44.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8612026-07-29T16:44:45.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8622026-07-29T16:44:45.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8632026-07-29T16:44:45.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8642026-07-29T16:44:45.559ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
8652026-07-29T16:44:45.559ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
8662026-07-29T16:44:45.560ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 1 producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
8672026-07-29T16:44:45.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8682026-07-29T16:44:45.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8692026-07-29T16:44:45.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8702026-07-29T16:44:46.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8712026-07-29T16:44:46.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8722026-07-29T16:44:46.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8732026-07-29T16:44:46.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8742026-07-29T16:44:46.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8752026-07-29T16:44:46.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8762026-07-29T16:44:47.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8772026-07-29T16:44:47.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8782026-07-29T16:44:47.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8792026-07-29T16:44:47.464ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
8802026-07-29T16:44:47.464ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
8812026-07-29T16:44:47.465ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
8822026-07-29T16:44:47.971ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
8832026-07-29T16:44:47.971ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
8842026-07-29T16:44:47.972ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
8852026-07-29T16:44:47.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8862026-07-29T16:44:47.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8872026-07-29T16:44:47.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8882026-07-29T16:44:48.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8892026-07-29T16:44:48.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8902026-07-29T16:44:48.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8912026-07-29T16:44:48.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 193
8922026-07-29T16:44:48.527ZDEBGoximeter (clickhouse-client): unrolling 193 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
8932026-07-29T16:44:48.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 193
8942026-07-29T16:44:48.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
8952026-07-29T16:44:48.532ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
8962026-07-29T16:44:48.534ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 138 table_name = fields_string
8972026-07-29T16:44:48.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 45 table_name = fields_u16
8982026-07-29T16:44:48.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 105 table_name = fields_uuid
8992026-07-29T16:44:48.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 112 table_name = measurements_cumulativeu64
9002026-07-29T16:44:48.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 41 table_name = measurements_histogramu64
9012026-07-29T16:44:48.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 40 table_name = measurements_u64
9022026-07-29T16:44:48.627ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
9032026-07-29T16:44:48.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9042026-07-29T16:44:48.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9052026-07-29T16:44:48.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9062026-07-29T16:44:49.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9072026-07-29T16:44:49.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9082026-07-29T16:44:49.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9092026-07-29T16:44:49.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9102026-07-29T16:44:49.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9112026-07-29T16:44:49.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9122026-07-29T16:44:50.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9132026-07-29T16:44:50.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9142026-07-29T16:44:50.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9152026-07-29T16:44:50.734ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
9162026-07-29T16:44:50.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9172026-07-29T16:44:50.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9182026-07-29T16:44:50.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9192026-07-29T16:44:51.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9202026-07-29T16:44:51.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9212026-07-29T16:44:51.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9222026-07-29T16:44:51.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9232026-07-29T16:44:51.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9242026-07-29T16:44:51.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9252026-07-29T16:44:52.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9262026-07-29T16:44:52.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9272026-07-29T16:44:52.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9282026-07-29T16:44:52.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9292026-07-29T16:44:52.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9302026-07-29T16:44:52.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9312026-07-29T16:44:53.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9322026-07-29T16:44:53.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9332026-07-29T16:44:53.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9342026-07-29T16:44:53.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 152
9352026-07-29T16:44:53.527ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 152
9362026-07-29T16:44:53.527ZDEBGoximeter (clickhouse-client): unrolling 152 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
9372026-07-29T16:44:53.527ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
9382026-07-29T16:44:53.532ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_ipaddr
9392026-07-29T16:44:53.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 56 table_name = fields_string
9402026-07-29T16:44:53.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 4 table_name = fields_u16
9412026-07-29T16:44:53.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 64 table_name = fields_uuid
9422026-07-29T16:44:53.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 112 table_name = measurements_cumulativeu64
9432026-07-29T16:44:53.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 40 table_name = measurements_u64
9442026-07-29T16:44:53.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
9452026-07-29T16:44:53.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9462026-07-29T16:44:53.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9472026-07-29T16:44:53.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9482026-07-29T16:44:54.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9492026-07-29T16:44:54.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9502026-07-29T16:44:54.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9512026-07-29T16:44:54.118ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
9522026-07-29T16:44:54.119ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
9532026-07-29T16:44:54.121ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 16c5ec1a-d270-44ed-b68a-27d5b5531e8e producer_ip = fd00:1122:3344:101::b producer_port = 38650
9542026-07-29T16:44:54.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9552026-07-29T16:44:54.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9562026-07-29T16:44:54.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9572026-07-29T16:44:55.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9582026-07-29T16:44:55.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9592026-07-29T16:44:55.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9602026-07-29T16:44:55.560ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
9612026-07-29T16:44:55.560ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
9622026-07-29T16:44:55.560ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 1 producer_id = ec5a6497-bdb9-495b-8d22-5e58a1831939 producer_ip = fd00:1122:3344:101::c producer_port = 60790
9632026-07-29T16:44:55.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9642026-07-29T16:44:55.975ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9652026-07-29T16:44:55.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9662026-07-29T16:44:56.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9672026-07-29T16:44:56.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9682026-07-29T16:44:56.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9692026-07-29T16:44:56.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9702026-07-29T16:44:56.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9712026-07-29T16:44:56.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9722026-07-29T16:44:57.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9732026-07-29T16:44:57.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9742026-07-29T16:44:57.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9752026-07-29T16:44:57.464ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
9762026-07-29T16:44:57.464ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
9772026-07-29T16:44:57.465ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = ce684516-1ef2-4c81-9750-25bcaac0fb40 producer_ip = fd00:1122:3344:101::a producer_port = 45133
9782026-07-29T16:44:57.972ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
9792026-07-29T16:44:57.972ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
9802026-07-29T16:44:57.973ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 032090c1-2d6c-43d2-8425-955aa59dc2e3 producer_ip = fd00:1122:3344:101::2 producer_port = 58633
9812026-07-29T16:44:57.975ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9822026-07-29T16:44:57.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9832026-07-29T16:44:57.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9842026-07-29T16:44:58.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9852026-07-29T16:44:58.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9862026-07-29T16:44:58.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9872026-07-29T16:44:58.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 191
9882026-07-29T16:44:58.526ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_samples = 191
9892026-07-29T16:44:58.526ZDEBGoximeter (clickhouse-client): unrolling 191 total samples collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
9902026-07-29T16:44:58.526ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220
9912026-07-29T16:44:58.532ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 136 table_name = fields_string
9922026-07-29T16:44:58.533ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 41 table_name = fields_u16
9932026-07-29T16:44:58.534ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 101 table_name = fields_uuid
9942026-07-29T16:44:58.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 110 table_name = measurements_cumulativeu64
9952026-07-29T16:44:58.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 41 table_name = measurements_histogramu64
9962026-07-29T16:44:58.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d id = 881f8560-f0f9-47e9-af09-45357d627220 n_rows = 40 table_name = measurements_u64
9972026-07-29T16:44:58.628ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
9982026-07-29T16:44:58.660ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
9992026-07-29T16:44:58.660ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending
10002026-07-29T16:44:58.664ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "1abdf94e-b870-4230-a9d8-d8229067acd2", "content-length": "1276", "date": "Wed, 29 Jul 2026 16:44:58 GMT"} })
10012026-07-29T16:44:58.664ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzVhNjQ5Ny1iZGI5LTQ5NWItOGQyMi01ZTU4YTE4MzE5MzkifX0%3D
10022026-07-29T16:44:58.667ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzVhNjQ5Ny1iZGI5LTQ5NWItOGQyMi01ZTU4YTE4MzE5MzkifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "8354e469-3ae7-41ea-bd76-1b82cabcef67", "content-length": "29", "date": "Wed, 29 Jul 2026 16:44:58 GMT"} })
10032026-07-29T16:44:58.667ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 8 n_pruned_tasks = 0
10042026-07-29T16:44:58.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10052026-07-29T16:44:58.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10062026-07-29T16:44:58.977ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10072026-07-29T16:44:59.070ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10082026-07-29T16:44:59.070ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10092026-07-29T16:44:59.072ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10102026-07-29T16:44:59.976ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10112026-07-29T16:44:59.976ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10122026-07-29T16:44:59.976ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = bd87db21-06c0-4a59-8075-892193a136f8 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10132026-07-29T16:45:00.069ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10142026-07-29T16:45:00.069ZDEBGoximeter (collection-task): collecting from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10152026-07-29T16:45:00.071ZDEBGoximeter (collection-task): collected results from producer collector_id = 7cb1c3ea-cb3f-4d7b-92b3-b28bd56c5e62 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 08af2d50-e814-4d92-8225-b8b8f2e0e560 producer_ip = fd00:1122:3344:101::1 producer_port = 8001