Max level shown:
1 [ Aug 13 21:28:34 Enabled. ]
2 [ Aug 13 21:28:34 Rereading configuration. ]
3 [ Aug 13 21:28:35 Rereading configuration. ]
4 [ Aug 13 21:28:37 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 &"). ]
5 [ Aug 13 21:28:37 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-08-13T21:28:37.648ZDEBGoximeter: registered DTrace probes
82026-08-13T21:28:37.650ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:299
92026-08-13T21:28:37.650ZDEBGoximeter: creating ClickHouse client
102026-08-13T21:28:37.654ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
112026-08-13T21:28:52.188ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 3543d94b-60ce-422c-a732-42149828058a
122026-08-13T21:28:52.188ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d
132026-08-13T21:28:52.188ZINFOoximeter (clickhouse-client): reading db version collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:788 id = 3543d94b-60ce-422c-a732-42149828058a
142026-08-13T21:28:52.189ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 3543d94b-60ce-422c-a732-42149828058a
152026-08-13T21:28:52.189ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:793 id = 3543d94b-60ce-422c-a732-42149828058a version = 0
162026-08-13T21:28:52.189ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:798 id = 3543d94b-60ce-422c-a732-42149828058a
172026-08-13T21:28:52.191ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
182026-08-13T21:28:52.386ZINFOoximeter (clickhouse-client): inserting current version collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:819 id = 3543d94b-60ce-422c-a732-42149828058a version = 14
192026-08-13T21:28:52.413ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = c599af5a-a30c-4a9f-bde2-de0c1672f180
202026-08-13T21:28:52.430ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-08-13T21:28:52.430ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-08-13T21:28:52.430ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-08-13T21:28:52.430ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-08-13T21:28:52.430ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-08-13T21:28:52.433ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-08-13T21:28:52.436ZDEBGoximeter: registered USDT probes
272026-08-13T21:28:52.436ZDEBGoximeter: contacting nexus
282026-08-13T21:28:52.459ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
292026-08-13T21:28:52.485ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "2638d123-ebb1-4c5e-b0de-3f21a721a04a", "date": "Thu, 13 Aug 2026 21:28:52 GMT"} })
302026-08-13T21:28:52.485ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:431 id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10
312026-08-13T21:28:52.485ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
322026-08-13T21:28:52.486ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
332026-08-13T21:28:52.487ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?sort_by=id_ascending
342026-08-13T21:28:52.501ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa0dd8dd-e9a2-4228-b658-fea40865ddf7", "content-length": "29", "date": "Thu, 13 Aug 2026 21:28:52 GMT"} })
352026-08-13T21:28:52.504ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 0 n_pruned_tasks = 0
362026-08-13T21:28:57.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 4
372026-08-13T21:28:57.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 4
382026-08-13T21:28:57.415ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
392026-08-13T21:28:57.420ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
402026-08-13T21:28:57.422ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:28:57.417742379Z } timeseries_name = oximeter_collector:database_queue_depth
412026-08-13T21:28:57.422ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:28:57.417738458Z } timeseries_name = oximeter_collector:database_samples_dropped
422026-08-13T21:28:57.422ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
432026-08-13T21:28:57.427ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = fields_ipaddr
442026-08-13T21:28:57.429ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = fields_string
452026-08-13T21:28:57.431ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = fields_u16
462026-08-13T21:28:57.434ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = fields_uuid
472026-08-13T21:28:57.436ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 2 table_name = measurements_cumulativeu64
482026-08-13T21:28:57.438ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 2 table_name = measurements_histogramu64
492026-08-13T21:28:57.516ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
502026-08-13T21:29:02.414ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d
512026-08-13T21:29:02.415ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d
522026-08-13T21:29:07.415ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d
532026-08-13T21:29:07.415ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d
542026-08-13T21:29:07.486ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
552026-08-13T21:29:07.486ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?sort_by=id_ascending
562026-08-13T21:29:07.489ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdf94759-0097-441e-a24a-bde4992c2eb0", "content-length": "577", "date": "Thu, 13 Aug 2026 21:29:07 GMT"} })
572026-08-13T21:29:07.489ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjU3MTExNC04MzIwLTQ2MjYtYmQ4Yi1kNTQzY2RmODE4MTQifX0%3D
582026-08-13T21:29:07.492ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjU3MTExNC04MzIwLTQ2MjYtYmQ4Yi1kNTQzY2RmODE4MTQifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "f680de2d-135f-489d-bf0a-2694d42c3878", "content-length": "29", "date": "Thu, 13 Aug 2026 21:29:07 GMT"} })
592026-08-13T21:29:07.492ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a
602026-08-13T21:29:07.492ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:59447 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9
612026-08-13T21:29:07.492ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:55153 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bb571114-8320-4626-bd8b-d543cdf81814
622026-08-13T21:29:07.492ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 3 n_pruned_tasks = 0
632026-08-13T21:29:08.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
642026-08-13T21:29:08.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
652026-08-13T21:29:08.027ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
662026-08-13T21:29:09.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
672026-08-13T21:29:09.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
682026-08-13T21:29:09.023ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
692026-08-13T21:29:10.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
702026-08-13T21:29:10.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
712026-08-13T21:29:10.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
722026-08-13T21:29:11.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
732026-08-13T21:29:11.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
742026-08-13T21:29:11.023ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
752026-08-13T21:29:12.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
762026-08-13T21:29:12.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
772026-08-13T21:29:12.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
782026-08-13T21:29:12.414ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 130
792026-08-13T21:29:12.414ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 130
802026-08-13T21:29:12.414ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
812026-08-13T21:29:12.414ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
822026-08-13T21:29:12.416ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414519951Z } timeseries_name = ddm_router:originated_tunnel_endpoints
832026-08-13T21:29:12.416ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414517040Z } timeseries_name = ddm_router:originated_underlay_prefixes
842026-08-13T21:29:12.416ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414528541Z } timeseries_name = ddm_session:advertisements_received
852026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414526481Z } timeseries_name = ddm_session:advertisements_sent
862026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414544621Z } timeseries_name = ddm_session:imported_tunnel_endpoints
872026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414543001Z } timeseries_name = ddm_session:imported_underlay_prefixes
882026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414532501Z } timeseries_name = ddm_session:peer_address_changes
892026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414530441Z } timeseries_name = ddm_session:peer_expirations
902026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414534681Z } timeseries_name = ddm_session:peer_sessions_established
912026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414524351Z } timeseries_name = ddm_session:solicitations_received
922026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414522551Z } timeseries_name = ddm_session:solicitations_sent
932026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414539991Z } timeseries_name = ddm_session:update_send_fail
942026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414538321Z } timeseries_name = ddm_session:updates_received
952026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:12.414536421Z } timeseries_name = ddm_session:updates_sent
962026-08-13T21:29:12.417ZDEBGoximeter (clickhouse-client): inserting 14 new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
972026-08-13T21:29:12.421ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 50 table_name = fields_string
982026-08-13T21:29:12.422ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 52 table_name = fields_uuid
992026-08-13T21:29:12.424ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 100 table_name = measurements_cumulativeu64
1002026-08-13T21:29:12.426ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 30 table_name = measurements_u64
1012026-08-13T21:29:12.516ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1022026-08-13T21:29:13.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1032026-08-13T21:29:13.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1042026-08-13T21:29:13.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1052026-08-13T21:29:14.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1062026-08-13T21:29:14.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1072026-08-13T21:29:14.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1082026-08-13T21:29:15.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1092026-08-13T21:29:15.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1102026-08-13T21:29:15.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1112026-08-13T21:29:15.644ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
1122026-08-13T21:29:15.644ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
1132026-08-13T21:29:15.666ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 186 producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
1142026-08-13T21:29:16.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1152026-08-13T21:29:16.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1162026-08-13T21:29:16.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1172026-08-13T21:29:17.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1182026-08-13T21:29:17.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1192026-08-13T21:29:17.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1202026-08-13T21:29:17.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 316
1212026-08-13T21:29:17.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 316
1222026-08-13T21:29:17.415ZDEBGoximeter (clickhouse-client): unrolling 316 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
1232026-08-13T21:29:17.415ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
1242026-08-13T21:29:17.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:17.415385838Z } timeseries_name = switch_port_control_data_link:bytes_received
1252026-08-13T21:29:17.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:17.415413489Z } timeseries_name = switch_port_control_data_link:bytes_sent
1262026-08-13T21:29:17.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:17.415375738Z } timeseries_name = switch_port_control_data_link:errors_received
1272026-08-13T21:29:17.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:17.415381008Z } timeseries_name = switch_port_control_data_link:errors_sent
1282026-08-13T21:29:17.420ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:17.415390388Z } timeseries_name = switch_port_control_data_link:packets_received
1292026-08-13T21:29:17.420ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:17.415419299Z } timeseries_name = switch_port_control_data_link:packets_sent
1302026-08-13T21:29:17.422ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
1312026-08-13T21:29:17.426ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 24 table_name = fields_i16
1322026-08-13T21:29:17.428ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 170 table_name = fields_string
1332026-08-13T21:29:17.429ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 12 table_name = fields_u16
1342026-08-13T21:29:17.431ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 24 table_name = fields_u32
1352026-08-13T21:29:17.432ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 12 table_name = fields_u8
1362026-08-13T21:29:17.434ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 88 table_name = fields_uuid
1372026-08-13T21:29:17.436ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 286 table_name = measurements_cumulativeu64
1382026-08-13T21:29:17.438ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 30 table_name = measurements_u64
1392026-08-13T21:29:17.515ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1402026-08-13T21:29:18.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1412026-08-13T21:29:18.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1422026-08-13T21:29:18.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1432026-08-13T21:29:18.043ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bb571114-8320-4626-bd8b-d543cdf81814 producer_ip = fd00:1122:3344:101::1 producer_port = 55153
1442026-08-13T21:29:18.043ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bb571114-8320-4626-bd8b-d543cdf81814 producer_ip = fd00:1122:3344:101::1 producer_port = 55153
1452026-08-13T21:29:18.195ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 6537 producer_id = bb571114-8320-4626-bd8b-d543cdf81814 producer_ip = fd00:1122:3344:101::1 producer_port = 55153
1462026-08-13T21:29:18.232ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 6563
1472026-08-13T21:29:18.232ZDEBGoximeter (clickhouse-client): unrolling 6563 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
1482026-08-13T21:29:18.232ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 6563
1492026-08-13T21:29:18.233ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
1502026-08-13T21:29:18.236ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233758839Z } timeseries_name = http_service:request_latency_histogram
1512026-08-13T21:29:18.236ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_hits"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233305977Z } timeseries_name = opte_port:in_uft_hits
1522026-08-13T21:29:18.236ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233307767Z } timeseries_name = opte_port:in_uft_misses
1532026-08-13T21:29:18.236ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_hits"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233309007Z } timeseries_name = opte_port:out_uft_hits
1542026-08-13T21:29:18.236ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233310117Z } timeseries_name = opte_port:out_uft_misses
1552026-08-13T21:29:18.236ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.232739672Z } timeseries_name = sled_cpu:cpu_nsec
1562026-08-13T21:29:18.237ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233282567Z } timeseries_name = sled_data_link:bytes_received
1572026-08-13T21:29:18.237ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233285087Z } timeseries_name = sled_data_link:bytes_sent
1582026-08-13T21:29:18.237ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233279547Z } timeseries_name = sled_data_link:errors_received
1592026-08-13T21:29:18.237ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233280987Z } timeseries_name = sled_data_link:errors_sent
1602026-08-13T21:29:18.237ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233283897Z } timeseries_name = sled_data_link:packets_received
1612026-08-13T21:29:18.237ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233286357Z } timeseries_name = sled_data_link:packets_sent
1622026-08-13T21:29:18.237ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233770399Z } timeseries_name = zfs_dataset:bytes_used
1632026-08-13T21:29:18.237ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233761649Z } timeseries_name = zfs_pool:bytes_allocated
1642026-08-13T21:29:18.237ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233763319Z } timeseries_name = zfs_pool:bytes_total
1652026-08-13T21:29:18.237ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:18.233598145Z } timeseries_name = zone:cpu_nsec
1662026-08-13T21:29:18.264ZDEBGoximeter (clickhouse-client): inserting 16 new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
1672026-08-13T21:29:18.271ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 3359 table_name = fields_string
1682026-08-13T21:29:18.272ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 2 table_name = fields_u16
1692026-08-13T21:29:18.274ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 977 table_name = fields_u32
1702026-08-13T21:29:18.277ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 1947 table_name = fields_uuid
1712026-08-13T21:29:18.280ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 6099 table_name = measurements_cumulativeu64
1722026-08-13T21:29:18.282ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 2 table_name = measurements_histogramu64
1732026-08-13T21:29:18.284ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 462 table_name = measurements_u64
1742026-08-13T21:29:18.333ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1752026-08-13T21:29:19.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1762026-08-13T21:29:19.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1772026-08-13T21:29:19.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1782026-08-13T21:29:20.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1792026-08-13T21:29:20.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-08-13T21:29:20.021ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-08-13T21:29:21.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1822026-08-13T21:29:21.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1832026-08-13T21:29:21.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1842026-08-13T21:29:22.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1852026-08-13T21:29:22.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-08-13T21:29:22.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-08-13T21:29:22.414ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 104
1882026-08-13T21:29:22.414ZDEBGoximeter (clickhouse-client): unrolling 104 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
1892026-08-13T21:29:22.414ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 104
1902026-08-13T21:29:22.414ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
1912026-08-13T21:29:22.419ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 50 table_name = fields_string
1922026-08-13T21:29:22.421ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 52 table_name = fields_uuid
1932026-08-13T21:29:22.423ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 80 table_name = measurements_cumulativeu64
1942026-08-13T21:29:22.424ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 24 table_name = measurements_u64
1952026-08-13T21:29:22.486ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
1962026-08-13T21:29:22.486ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?sort_by=id_ascending
1972026-08-13T21:29:22.490ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5bdc2ed-8faf-4e57-8964-2a8a2179011d", "content-length": "713", "date": "Thu, 13 Aug 2026 21:29:22 GMT"} })
1982026-08-13T21:29:22.490ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjU3MTExNC04MzIwLTQ2MjYtYmQ4Yi1kNTQzY2RmODE4MTQifX0%3D
1992026-08-13T21:29:22.493ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjU3MTExNC04MzIwLTQ2MjYtYmQ4Yi1kNTQzY2RmODE4MTQifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "88b9b74a-2cc1-484e-a479-478cdff8a9b5", "content-length": "29", "date": "Thu, 13 Aug 2026 21:29:22 GMT"} })
2002026-08-13T21:29:22.493ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba
2012026-08-13T21:29:22.493ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:39697 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9
2022026-08-13T21:29:22.493ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
2032026-08-13T21:29:22.493ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 4 n_pruned_tasks = 0
2042026-08-13T21:29:22.493ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:39697 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
2052026-08-13T21:29:22.516ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2062026-08-13T21:29:23.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2072026-08-13T21:29:23.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2082026-08-13T21:29:23.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2092026-08-13T21:29:23.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2102026-08-13T21:29:23.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2112026-08-13T21:29:23.273ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2122026-08-13T21:29:24.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2132026-08-13T21:29:24.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2142026-08-13T21:29:24.021ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2152026-08-13T21:29:24.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2162026-08-13T21:29:24.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2172026-08-13T21:29:24.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2182026-08-13T21:29:25.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2192026-08-13T21:29:25.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2202026-08-13T21:29:25.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2212026-08-13T21:29:25.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2222026-08-13T21:29:25.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2232026-08-13T21:29:25.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2242026-08-13T21:29:26.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2252026-08-13T21:29:26.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2262026-08-13T21:29:26.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2272026-08-13T21:29:26.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2282026-08-13T21:29:26.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2292026-08-13T21:29:26.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2302026-08-13T21:29:26.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
2312026-08-13T21:29:26.549ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
2322026-08-13T21:29:26.571ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
2332026-08-13T21:29:27.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2342026-08-13T21:29:27.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2352026-08-13T21:29:27.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-08-13T21:29:27.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2372026-08-13T21:29:27.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2382026-08-13T21:29:27.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2392026-08-13T21:29:27.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 290
2402026-08-13T21:29:27.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 290
2412026-08-13T21:29:27.415ZDEBGoximeter (clickhouse-client): unrolling 290 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
2422026-08-13T21:29:27.415ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
2432026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415213239Z } timeseries_name = dendrite:sample_collection_duration
2442026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415112336Z } timeseries_name = mg_lower:routes_blocked_by_link_state
2452026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415109306Z } timeseries_name = static_routing_config:static_nexthops
2462026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415108016Z } timeseries_name = static_routing_config:static_routes
2472026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415141547Z } timeseries_name = switch_data_link:link_enabled
2482026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415145897Z } timeseries_name = switch_data_link:link_up
2492026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415110486Z } timeseries_name = switch_rib:active_routes
2502026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415154087Z } timeseries_name = switch_table:capacity
2512026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415167198Z } timeseries_name = switch_table:collisions
2522026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415172938Z } timeseries_name = switch_table:delete_misses
2532026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415161978Z } timeseries_name = switch_table:deletes
2542026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415181878Z } timeseries_name = switch_table:exhaustion
2552026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415160158Z } timeseries_name = switch_table:inserts
2562026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415157298Z } timeseries_name = switch_table:occupancy
2572026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415170108Z } timeseries_name = switch_table:update_misses
2582026-08-13T21:29:27.419ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:27.415164838Z } timeseries_name = switch_table:updates
2592026-08-13T21:29:27.422ZDEBGoximeter (clickhouse-client): inserting 16 new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
2602026-08-13T21:29:27.425ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 280 table_name = fields_i16
2612026-08-13T21:29:27.427ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 775 table_name = fields_string
2622026-08-13T21:29:27.429ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 140 table_name = fields_u16
2632026-08-13T21:29:27.432ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 145 table_name = fields_u32
2642026-08-13T21:29:27.433ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 144 table_name = fields_u8
2652026-08-13T21:29:27.435ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 480 table_name = fields_uuid
2662026-08-13T21:29:27.437ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = measurements_bool
2672026-08-13T21:29:27.438ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 215 table_name = measurements_cumulativeu64
2682026-08-13T21:29:27.440ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 1 table_name = measurements_f64
2692026-08-13T21:29:27.441ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 70 table_name = measurements_u64
2702026-08-13T21:29:27.516ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2712026-08-13T21:29:28.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2722026-08-13T21:29:28.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2732026-08-13T21:29:28.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2742026-08-13T21:29:28.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2752026-08-13T21:29:28.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2762026-08-13T21:29:28.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2772026-08-13T21:29:29.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2782026-08-13T21:29:29.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2792026-08-13T21:29:29.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2802026-08-13T21:29:29.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2812026-08-13T21:29:29.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2822026-08-13T21:29:29.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2832026-08-13T21:29:30.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-08-13T21:29:30.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2852026-08-13T21:29:30.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2862026-08-13T21:29:30.159ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bb571114-8320-4626-bd8b-d543cdf81814 producer_ip = fd00:1122:3344:101::1 producer_port = 55153
2872026-08-13T21:29:30.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2882026-08-13T21:29:30.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2892026-08-13T21:29:30.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2902026-08-13T21:29:31.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2912026-08-13T21:29:31.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2922026-08-13T21:29:31.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2932026-08-13T21:29:31.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2942026-08-13T21:29:31.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2952026-08-13T21:29:31.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2962026-08-13T21:29:32.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2972026-08-13T21:29:32.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2982026-08-13T21:29:32.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2992026-08-13T21:29:32.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3002026-08-13T21:29:32.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3012026-08-13T21:29:32.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3022026-08-13T21:29:32.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 152
3032026-08-13T21:29:32.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 152
3042026-08-13T21:29:32.415ZDEBGoximeter (clickhouse-client): unrolling 152 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
3052026-08-13T21:29:32.415ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
3062026-08-13T21:29:32.418ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:32.415202972Z } timeseries_name = oximeter_collector:collections
3072026-08-13T21:29:32.418ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:32.415204972Z } timeseries_name = oximeter_collector:samples_collected
3082026-08-13T21:29:32.419ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
3092026-08-13T21:29:32.422ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = fields_ipaddr
3102026-08-13T21:29:32.424ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 56 table_name = fields_string
3112026-08-13T21:29:32.426ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = fields_u16
3122026-08-13T21:29:32.427ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 64 table_name = fields_uuid
3132026-08-13T21:29:32.429ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 112 table_name = measurements_cumulativeu64
3142026-08-13T21:29:32.431ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 40 table_name = measurements_u64
3152026-08-13T21:29:32.516ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3162026-08-13T21:29:33.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-08-13T21:29:33.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-08-13T21:29:33.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3192026-08-13T21:29:33.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3202026-08-13T21:29:33.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3212026-08-13T21:29:33.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3222026-08-13T21:29:34.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3232026-08-13T21:29:34.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3242026-08-13T21:29:34.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3252026-08-13T21:29:34.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3262026-08-13T21:29:34.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3272026-08-13T21:29:34.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3282026-08-13T21:29:35.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3292026-08-13T21:29:35.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3302026-08-13T21:29:35.023ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3312026-08-13T21:29:35.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3322026-08-13T21:29:35.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3332026-08-13T21:29:35.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3342026-08-13T21:29:36.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3352026-08-13T21:29:36.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3362026-08-13T21:29:36.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3372026-08-13T21:29:36.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3382026-08-13T21:29:36.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3392026-08-13T21:29:36.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3402026-08-13T21:29:36.550ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
3412026-08-13T21:29:36.550ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
3422026-08-13T21:29:36.557ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
3432026-08-13T21:29:37.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3442026-08-13T21:29:37.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3452026-08-13T21:29:37.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3462026-08-13T21:29:37.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3472026-08-13T21:29:37.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3482026-08-13T21:29:37.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3492026-08-13T21:29:37.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 290
3502026-08-13T21:29:37.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 290
3512026-08-13T21:29:37.415ZDEBGoximeter (clickhouse-client): unrolling 290 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
3522026-08-13T21:29:37.415ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
3532026-08-13T21:29:37.423ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 280 table_name = fields_i16
3542026-08-13T21:29:37.424ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 775 table_name = fields_string
3552026-08-13T21:29:37.426ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 140 table_name = fields_u16
3562026-08-13T21:29:37.427ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 145 table_name = fields_u32
3572026-08-13T21:29:37.429ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 144 table_name = fields_u8
3582026-08-13T21:29:37.430ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 480 table_name = fields_uuid
3592026-08-13T21:29:37.431ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = measurements_bool
3602026-08-13T21:29:37.432ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 215 table_name = measurements_cumulativeu64
3612026-08-13T21:29:37.433ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 1 table_name = measurements_f64
3622026-08-13T21:29:37.435ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 70 table_name = measurements_u64
3632026-08-13T21:29:37.486ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
3642026-08-13T21:29:37.486ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?sort_by=id_ascending
3652026-08-13T21:29:37.515ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3662026-08-13T21:29:37.520ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "c920b3cd-a1c0-4a2e-94c7-2781a8c69e6a", "content-length": "998", "date": "Thu, 13 Aug 2026 21:29:37 GMT"} })
3672026-08-13T21:29:37.520ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZWQ4N2E0Yi0xYjQzLTRhODctOWM0MS03NGYyYWI0ZjJjY2QifX0%3D
3682026-08-13T21:29:37.528ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZWQ4N2E0Yi0xYjQzLTRhODctOWM0MS03NGYyYWI0ZjJjY2QifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a5dcea1-37e9-4c18-ac99-051844c49695", "content-length": "29", "date": "Thu, 13 Aug 2026 21:29:37 GMT"} })
3692026-08-13T21:29:37.528ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869
3702026-08-13T21:29:37.528ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:49462 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bed87a4b-1b43-4a87-9c41-74f2ab4f2ccd
3712026-08-13T21:29:37.528ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 6 n_pruned_tasks = 0
3722026-08-13T21:29:37.766ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bed87a4b-1b43-4a87-9c41-74f2ab4f2ccd producer_ip = fd00:1122:3344:101::2 producer_port = 49462
3732026-08-13T21:29:37.766ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bed87a4b-1b43-4a87-9c41-74f2ab4f2ccd producer_ip = fd00:1122:3344:101::2 producer_port = 49462
3742026-08-13T21:29:37.773ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = bed87a4b-1b43-4a87-9c41-74f2ab4f2ccd producer_ip = fd00:1122:3344:101::2 producer_port = 49462
3752026-08-13T21:29:37.890ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3762026-08-13T21:29:37.890ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3772026-08-13T21:29:37.899ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3782026-08-13T21:29:38.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3792026-08-13T21:29:38.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3802026-08-13T21:29:38.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3812026-08-13T21:29:38.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3822026-08-13T21:29:38.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3832026-08-13T21:29:38.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3842026-08-13T21:29:38.890ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3852026-08-13T21:29:38.890ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3862026-08-13T21:29:38.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3872026-08-13T21:29:39.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3882026-08-13T21:29:39.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3892026-08-13T21:29:39.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3902026-08-13T21:29:39.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3912026-08-13T21:29:39.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3922026-08-13T21:29:39.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3932026-08-13T21:29:39.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3942026-08-13T21:29:39.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3952026-08-13T21:29:39.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3962026-08-13T21:29:40.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3972026-08-13T21:29:40.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3982026-08-13T21:29:40.023ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3992026-08-13T21:29:40.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4002026-08-13T21:29:40.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4012026-08-13T21:29:40.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4022026-08-13T21:29:40.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4032026-08-13T21:29:40.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4042026-08-13T21:29:40.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4052026-08-13T21:29:41.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4062026-08-13T21:29:41.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4072026-08-13T21:29:41.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4082026-08-13T21:29:41.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4092026-08-13T21:29:41.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4102026-08-13T21:29:41.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4112026-08-13T21:29:41.593ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
4122026-08-13T21:29:41.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4132026-08-13T21:29:41.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4142026-08-13T21:29:41.893ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4152026-08-13T21:29:42.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4162026-08-13T21:29:42.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4172026-08-13T21:29:42.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4182026-08-13T21:29:42.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4192026-08-13T21:29:42.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4202026-08-13T21:29:42.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4212026-08-13T21:29:42.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 233
4222026-08-13T21:29:42.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 233
4232026-08-13T21:29:42.415ZDEBGoximeter (clickhouse-client): unrolling 233 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
4242026-08-13T21:29:42.415ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
4252026-08-13T21:29:42.421ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = fields_ipaddr
4262026-08-13T21:29:42.422ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 104 table_name = fields_string
4272026-08-13T21:29:42.423ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 15 table_name = fields_u16
4282026-08-13T21:29:42.425ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 103 table_name = fields_uuid
4292026-08-13T21:29:42.426ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 162 table_name = measurements_cumulativeu64
4302026-08-13T21:29:42.428ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 11 table_name = measurements_histogramu64
4312026-08-13T21:29:42.429ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 60 table_name = measurements_u64
4322026-08-13T21:29:42.515ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4332026-08-13T21:29:42.890ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4342026-08-13T21:29:42.890ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4352026-08-13T21:29:42.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4362026-08-13T21:29:43.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4372026-08-13T21:29:43.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4382026-08-13T21:29:43.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4392026-08-13T21:29:43.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4402026-08-13T21:29:43.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4412026-08-13T21:29:43.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4422026-08-13T21:29:43.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4432026-08-13T21:29:43.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4442026-08-13T21:29:43.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4452026-08-13T21:29:44.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4462026-08-13T21:29:44.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4472026-08-13T21:29:44.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4482026-08-13T21:29:44.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4492026-08-13T21:29:44.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4502026-08-13T21:29:44.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4512026-08-13T21:29:44.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4522026-08-13T21:29:44.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4532026-08-13T21:29:44.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4542026-08-13T21:29:45.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4552026-08-13T21:29:45.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4562026-08-13T21:29:45.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4572026-08-13T21:29:45.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4582026-08-13T21:29:45.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4592026-08-13T21:29:45.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4602026-08-13T21:29:45.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4612026-08-13T21:29:45.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4622026-08-13T21:29:45.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4632026-08-13T21:29:46.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4642026-08-13T21:29:46.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4652026-08-13T21:29:46.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4662026-08-13T21:29:46.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4672026-08-13T21:29:46.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4682026-08-13T21:29:46.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4692026-08-13T21:29:46.550ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
4702026-08-13T21:29:46.550ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
4712026-08-13T21:29:46.557ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
4722026-08-13T21:29:46.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4732026-08-13T21:29:46.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4742026-08-13T21:29:46.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4752026-08-13T21:29:47.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-08-13T21:29:47.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4772026-08-13T21:29:47.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4782026-08-13T21:29:47.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4792026-08-13T21:29:47.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4802026-08-13T21:29:47.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4812026-08-13T21:29:47.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 360
4822026-08-13T21:29:47.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 360
4832026-08-13T21:29:47.415ZDEBGoximeter (clickhouse-client): unrolling 360 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
4842026-08-13T21:29:47.415ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
4852026-08-13T21:29:47.426ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 280 table_name = fields_i16
4862026-08-13T21:29:47.427ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 801 table_name = fields_string
4872026-08-13T21:29:47.429ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 140 table_name = fields_u16
4882026-08-13T21:29:47.430ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 145 table_name = fields_u32
4892026-08-13T21:29:47.432ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 144 table_name = fields_u8
4902026-08-13T21:29:47.434ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 508 table_name = fields_uuid
4912026-08-13T21:29:47.435ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = measurements_bool
4922026-08-13T21:29:47.437ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 265 table_name = measurements_cumulativeu64
4932026-08-13T21:29:47.438ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 1 table_name = measurements_f64
4942026-08-13T21:29:47.439ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 90 table_name = measurements_u64
4952026-08-13T21:29:47.516ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4962026-08-13T21:29:47.765ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bed87a4b-1b43-4a87-9c41-74f2ab4f2ccd producer_ip = fd00:1122:3344:101::2 producer_port = 49462
4972026-08-13T21:29:47.765ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bed87a4b-1b43-4a87-9c41-74f2ab4f2ccd producer_ip = fd00:1122:3344:101::2 producer_port = 49462
4982026-08-13T21:29:47.766ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = bed87a4b-1b43-4a87-9c41-74f2ab4f2ccd producer_ip = fd00:1122:3344:101::2 producer_port = 49462
4992026-08-13T21:29:47.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5002026-08-13T21:29:47.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5012026-08-13T21:29:47.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5022026-08-13T21:29:48.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5032026-08-13T21:29:48.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5042026-08-13T21:29:48.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5052026-08-13T21:29:48.043ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bb571114-8320-4626-bd8b-d543cdf81814 producer_ip = fd00:1122:3344:101::1 producer_port = 55153
5062026-08-13T21:29:48.043ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bb571114-8320-4626-bd8b-d543cdf81814 producer_ip = fd00:1122:3344:101::1 producer_port = 55153
5072026-08-13T21:29:48.065ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1915 producer_id = bb571114-8320-4626-bd8b-d543cdf81814 producer_ip = fd00:1122:3344:101::1 producer_port = 55153
5082026-08-13T21:29:48.073ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 1966
5092026-08-13T21:29:48.073ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 1966
5102026-08-13T21:29:48.073ZDEBGoximeter (clickhouse-client): unrolling 1966 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
5112026-08-13T21:29:48.073ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
5122026-08-13T21:29:48.094ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 3419 table_name = fields_string
5132026-08-13T21:29:48.096ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 19 table_name = fields_u16
5142026-08-13T21:29:48.098ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 977 table_name = fields_u32
5152026-08-13T21:29:48.101ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 1992 table_name = fields_uuid
5162026-08-13T21:29:48.104ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 1785 table_name = measurements_cumulativeu64
5172026-08-13T21:29:48.106ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 19 table_name = measurements_histogramu64
5182026-08-13T21:29:48.108ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 162 table_name = measurements_u64
5192026-08-13T21:29:48.174ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5202026-08-13T21:29:48.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5212026-08-13T21:29:48.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5222026-08-13T21:29:48.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5232026-08-13T21:29:48.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5242026-08-13T21:29:48.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5252026-08-13T21:29:48.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5262026-08-13T21:29:49.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5272026-08-13T21:29:49.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5282026-08-13T21:29:49.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5292026-08-13T21:29:49.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5302026-08-13T21:29:49.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5312026-08-13T21:29:49.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5322026-08-13T21:29:49.890ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5332026-08-13T21:29:49.890ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5342026-08-13T21:29:49.891ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5352026-08-13T21:29:50.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5362026-08-13T21:29:50.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5372026-08-13T21:29:50.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5382026-08-13T21:29:50.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5392026-08-13T21:29:50.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5402026-08-13T21:29:50.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5412026-08-13T21:29:50.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5422026-08-13T21:29:50.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5432026-08-13T21:29:50.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5442026-08-13T21:29:51.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5452026-08-13T21:29:51.021ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5462026-08-13T21:29:51.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5472026-08-13T21:29:51.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5482026-08-13T21:29:51.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5492026-08-13T21:29:51.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5502026-08-13T21:29:51.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5512026-08-13T21:29:51.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5522026-08-13T21:29:51.892ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5532026-08-13T21:29:51.893ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5542026-08-13T21:29:52.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5552026-08-13T21:29:52.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5562026-08-13T21:29:52.023ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5572026-08-13T21:29:52.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5582026-08-13T21:29:52.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5592026-08-13T21:29:52.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5602026-08-13T21:29:52.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 182
5612026-08-13T21:29:52.415ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 182
5622026-08-13T21:29:52.415ZDEBGoximeter (clickhouse-client): unrolling 182 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
5632026-08-13T21:29:52.415ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
5642026-08-13T21:29:52.420ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = fields_ipaddr
5652026-08-13T21:29:52.422ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 82 table_name = fields_string
5662026-08-13T21:29:52.423ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = fields_u16
5672026-08-13T21:29:52.424ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 92 table_name = fields_uuid
5682026-08-13T21:29:52.425ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 132 table_name = measurements_cumulativeu64
5692026-08-13T21:29:52.427ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 50 table_name = measurements_u64
5702026-08-13T21:29:52.486ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
5712026-08-13T21:29:52.486ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?sort_by=id_ascending
5722026-08-13T21:29:52.489ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "478beb54-4dd9-43af-95b9-b7263d2afe98", "content-length": "1412", "date": "Thu, 13 Aug 2026 21:29:52 GMT"} })
5732026-08-13T21:29:52.489ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmM4MGFlYi1lYTY5LTQ4NzEtOTBkMS0wZWRjMTZmYWVmNDUifX0%3D
5742026-08-13T21:29:52.492ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6bcf19f-dd15-4ecb-b64f-a21b947c8c10/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmM4MGFlYi1lYTY5LTQ4NzEtOTBkMS0wZWRjMTZmYWVmNDUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e48a3e47-4c78-44df-afff-a70579d83623", "content-length": "29", "date": "Thu, 13 Aug 2026 21:29:52 GMT"} })
5752026-08-13T21:29:52.493ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:56469 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 87bd9e59-ba1d-4a64-a79d-60c17e91b150
5762026-08-13T21:29:52.493ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:35452 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 95247c42-8a9b-428e-be43-565cc0cf9dad
5772026-08-13T21:29:52.493ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:45317 collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = cfc80aeb-ea69-4871-90d1-0edc16faef45
5782026-08-13T21:29:52.493ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 9 n_pruned_tasks = 0
5792026-08-13T21:29:52.516ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5802026-08-13T21:29:52.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5812026-08-13T21:29:52.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5822026-08-13T21:29:52.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5832026-08-13T21:29:53.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5842026-08-13T21:29:53.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5852026-08-13T21:29:53.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5862026-08-13T21:29:53.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5872026-08-13T21:29:53.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5882026-08-13T21:29:53.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5892026-08-13T21:29:53.302ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 87bd9e59-ba1d-4a64-a79d-60c17e91b150 producer_ip = fd00:1122:3344:101::b producer_port = 56469
5902026-08-13T21:29:53.302ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 87bd9e59-ba1d-4a64-a79d-60c17e91b150 producer_ip = fd00:1122:3344:101::b producer_port = 56469
5912026-08-13T21:29:53.305ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 12 producer_id = 87bd9e59-ba1d-4a64-a79d-60c17e91b150 producer_ip = fd00:1122:3344:101::b producer_port = 56469
5922026-08-13T21:29:53.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5932026-08-13T21:29:53.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5942026-08-13T21:29:53.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5952026-08-13T21:29:54.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5962026-08-13T21:29:54.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5972026-08-13T21:29:54.023ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5982026-08-13T21:29:54.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5992026-08-13T21:29:54.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6002026-08-13T21:29:54.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6012026-08-13T21:29:54.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6022026-08-13T21:29:54.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6032026-08-13T21:29:54.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6042026-08-13T21:29:55.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6052026-08-13T21:29:55.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6062026-08-13T21:29:55.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6072026-08-13T21:29:55.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6082026-08-13T21:29:55.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6092026-08-13T21:29:55.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6102026-08-13T21:29:55.292ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 95247c42-8a9b-428e-be43-565cc0cf9dad producer_ip = fd00:1122:3344:101::c producer_port = 35452
6112026-08-13T21:29:55.292ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 95247c42-8a9b-428e-be43-565cc0cf9dad producer_ip = fd00:1122:3344:101::c producer_port = 35452
6122026-08-13T21:29:55.297ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 7 producer_id = 95247c42-8a9b-428e-be43-565cc0cf9dad producer_ip = fd00:1122:3344:101::c producer_port = 35452
6132026-08-13T21:29:55.890ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6142026-08-13T21:29:55.890ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6152026-08-13T21:29:55.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6162026-08-13T21:29:56.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6172026-08-13T21:29:56.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6182026-08-13T21:29:56.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6192026-08-13T21:29:56.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6202026-08-13T21:29:56.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6212026-08-13T21:29:56.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6222026-08-13T21:29:56.550ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
6232026-08-13T21:29:56.550ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
6242026-08-13T21:29:56.558ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = b13c9a5f-6308-42d5-9060-bc61b1e828e9 producer_ip = fd00:1122:3344:101::2 producer_port = 59447
6252026-08-13T21:29:56.892ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6262026-08-13T21:29:56.892ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6272026-08-13T21:29:56.893ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6282026-08-13T21:29:57.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6292026-08-13T21:29:57.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6302026-08-13T21:29:57.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6312026-08-13T21:29:57.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6322026-08-13T21:29:57.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6332026-08-13T21:29:57.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6342026-08-13T21:29:57.414ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 383
6352026-08-13T21:29:57.414ZDEBGoximeter (database-inserter): inserting samples into database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_samples = 383
6362026-08-13T21:29:57.414ZDEBGoximeter (clickhouse-client): unrolling 383 total samples collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
6372026-08-13T21:29:57.415ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
6382026-08-13T21:29:57.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:57.414893568Z } timeseries_name = collection_target:cpus_provisioned
6392026-08-13T21:29:57.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:57.414894648Z } timeseries_name = collection_target:ram_provisioned
6402026-08-13T21:29:57.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:57.414895638Z } timeseries_name = collection_target:virtual_disk_space_provisioned
6412026-08-13T21:29:57.417ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-13T21:29:57.414897738Z } timeseries_name = database_transaction:retry_data
6422026-08-13T21:29:57.420ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a
6432026-08-13T21:29:57.423ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 280 table_name = fields_i16
6442026-08-13T21:29:57.425ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = fields_ipaddr
6452026-08-13T21:29:57.426ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 823 table_name = fields_string
6462026-08-13T21:29:57.427ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 152 table_name = fields_u16
6472026-08-13T21:29:57.429ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 147 table_name = fields_u32
6482026-08-13T21:29:57.430ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 144 table_name = fields_u8
6492026-08-13T21:29:57.432ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 529 table_name = fields_uuid
6502026-08-13T21:29:57.433ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 4 table_name = measurements_bool
6512026-08-13T21:29:57.434ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 267 table_name = measurements_cumulativeu64
6522026-08-13T21:29:57.435ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 3 table_name = measurements_f64
6532026-08-13T21:29:57.437ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 10 table_name = measurements_histogramu64
6542026-08-13T21:29:57.438ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 9 table_name = measurements_i64
6552026-08-13T21:29:57.439ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d id = 3543d94b-60ce-422c-a732-42149828058a n_rows = 90 table_name = measurements_u64
6562026-08-13T21:29:57.469ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = cfc80aeb-ea69-4871-90d1-0edc16faef45 producer_ip = fd00:1122:3344:101::a producer_port = 45317
6572026-08-13T21:29:57.469ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = cfc80aeb-ea69-4871-90d1-0edc16faef45 producer_ip = fd00:1122:3344:101::a producer_port = 45317
6582026-08-13T21:29:57.475ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = cfc80aeb-ea69-4871-90d1-0edc16faef45 producer_ip = fd00:1122:3344:101::a producer_port = 45317
6592026-08-13T21:29:57.516ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6602026-08-13T21:29:57.766ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bed87a4b-1b43-4a87-9c41-74f2ab4f2ccd producer_ip = fd00:1122:3344:101::2 producer_port = 49462
6612026-08-13T21:29:57.766ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = bed87a4b-1b43-4a87-9c41-74f2ab4f2ccd producer_ip = fd00:1122:3344:101::2 producer_port = 49462
6622026-08-13T21:29:57.768ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = bed87a4b-1b43-4a87-9c41-74f2ab4f2ccd producer_ip = fd00:1122:3344:101::2 producer_port = 49462
6632026-08-13T21:29:57.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6642026-08-13T21:29:57.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6652026-08-13T21:29:57.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6662026-08-13T21:29:58.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6672026-08-13T21:29:58.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6682026-08-13T21:29:58.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6692026-08-13T21:29:58.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6702026-08-13T21:29:58.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6712026-08-13T21:29:58.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6722026-08-13T21:29:58.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6732026-08-13T21:29:58.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6742026-08-13T21:29:58.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6752026-08-13T21:29:59.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6762026-08-13T21:29:59.020ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6772026-08-13T21:29:59.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6782026-08-13T21:29:59.263ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6792026-08-13T21:29:59.263ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6802026-08-13T21:29:59.264ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6812026-08-13T21:29:59.757ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = cfc80aeb-ea69-4871-90d1-0edc16faef45 producer_ip = fd00:1122:3344:101::a producer_port = 45317
6822026-08-13T21:29:59.891ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6832026-08-13T21:29:59.891ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6842026-08-13T21:29:59.892ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9bfd2a13-f0c0-49cd-a1b0-bb79448e6869 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6852026-08-13T21:30:00.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6862026-08-13T21:30:00.021ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6872026-08-13T21:30:00.022ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 8971df7e-e602-4773-8f56-f5faa63e4a6a producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6882026-08-13T21:30:00.262ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6892026-08-13T21:30:00.262ZDEBGoximeter (collection-task): collecting from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6902026-08-13T21:30:00.263ZDEBGoximeter (collection-task): collected results from producer collector_id = c6bcf19f-dd15-4ecb-b64f-a21b947c8c10 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 9dcf17a0-5209-425a-8a5b-b5b06a9b2bba producer_ip = fd00:1122:3344:101::2 producer_port = 4677